XRMoCap Release v0.8.0

XRMoCap 0.8.0 Release Notes:

Highlights:

• Refactor evaluation for MvP, mvpose_tracking, mvpose and fourdag, sharing the same super-class.
• Add smpl visualization and unit test, based on minimal_pytorch_rasterizer. Multi-person and multi-gender are supported.
• Add mmdeploy for faster human perception.

New Features:

• Add PriorConstraint optimizer for 3D keypoints, filtering out poorly quality bboxes and limbs.
• Add mmdeploy for faster human perception.
• Add mask in smpl_data. The person whose mask is zero will not be plotted.
• Add function auto_load_smpl_data, it chooses a correct class when you forget of which type the npz file is.
• Add smpl visualization and unit test, based on minimal_pytorch_rasterizer. Multi-person and multi-gender are supported.
• Add class Timer for recording average time consumption.

Refactors:

• Refactor evaluation metrics including MPJPE, PA-MPJPE, PCK, PCP, mAP, and recall.
• Refactor evaluation for MvP, mvpose_tracking, mvpose and fourdag, sharing the same super-class.

Improvements:

• Update dockerfiles and docker images.
• Add sample config for SMPL-X estimation.
• Add SMPLifyx support in process_smc tool. Allow process_smc tool not writing images to file system. It runs faster in large RAM machine.
• Clarify difference between param_dict and dict(smpl_data) in SMPLData code.
• Improve visualize_smpl.py by VideoWriter. Now we can visualize a really long video on a machine with poor RAM.
• Improve import dependency, do not require h5py if there's no SMCReader instance.

Documentations:

• Add docs for changes in evaluation results.
• Update benchmark.

CICD:

• Update workflow OS from ubt18 to ubt20, since ubt18 is no longer supported by GitHub.

Bug Fixes:

• Fix the bug when setting expression from param_dict to SMPLXData.
• Remove reference of np.float which is no longer supported after numpy-1.24.0.
• Fix wrong gender type when calling SMPLData.fromfile().
• Fix error when smooth joint loss gets one-frame input.
• Fix wrong hands shape in SMPLXData.to_param_dict()
• Fix the issue that SMPLify was not running correctly with initialized betas.
• Fix wrong displacement shape in SMPLXDData.

New Contributors:

@Yamato-01