Skip to content

CHELSEA234/SkelNet_motion_prediction

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SkelNet_motion_prediction

This repository contains our work in AAAI2019. We proposed novel architectures for the Human motion prediction from motion capture data. First, Skeleton Network (SkelNet) learns different local moving pattern from body components, and employs such locality for predicting the future human motion. Then, we built up Skeleton Temporal Network (Skel-TNet) that consists SkelNet and RNN, which have advantages in learning spatial and temporal dependencies for predicting human motion, respectively. Our methods achieve state-of-the-art results on the Human3.6M dataset and the CMU motion capture dataset. You can also check our paper for a details.

Xiao Guo, Jongmoo Choi. Human Motion Prediction via Learning Local Structure Representations and Temporal Dependencies. In AAAI2019. Paper.

Dependencies

  • Tensorflow-gpu 1.3.0
  • Python 3.6 or 3.5

Files and commands:

User can decide long-term or short-term prediction based on input argument. Specifically, three components in proposed Skel-TNet should be optimized independently.

Supposed target action is walking, required commands are shown below:

  • SkelNet:

python3 SkelNet/src/long_pre_extraction.py --action walking

  • C-RNN:

python3 C-RNN/src/long_pre_extraction.py --action walking

  • Merging_network:

python3 Merging_network/src/long_pre_extraction.py --action walking --iterations 1500

  • Data contains preprocessing the Human3.6M dataset
  • spatial_model_walking and temporal_model_walking represent pretained models sending to the Merging Network.

Acknowledgement:

if you find our work useful in your research, please consider to cite our work:

@inproceedings{guo2019human,
    title={Human motion prediction via learning local structure representations and temporal dependencies},
    author={Guo, Xiao and Choi, Jongmoo},
    booktitle={AAAI},
    year={2019}
}

About

Motion Prediction Work (AAAI2019)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages