Skip to content

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

License

Notifications You must be signed in to change notification settings

gurkirt/TrackAwareActionDetection

 
 

Repository files navigation

Track Aware Action Detection (TAAD)

Here you find the evaluation and training for TAAD on MultiSports Dataset. TAAD finished in the top spot in MultiSport challenge held in conjunction with ECCV 2022.

License

This repo heavily relies on PySlowFast so it contains a lot of stuff from there. It has the same License as PySlowFast, which is released under the Apache 2.0 license.

Model Zoo and Baselines

Multisport TAAD TCN model and multisports tracks generteted using Yolov5 and DeepSORT are availble to Download from Googl-Drive.

Installation

Please find installation instructions for PyTorch and PySlowFast in INSTALL.md.

Dataset Preparation

Download Track from Googl-Drive. and Extract frame using multisport script provided by authors of Mulitsports.

Eval

Given the extracted frames and downloaed tracks and TAAD-TCN model from Googl-Drive. Now, you shoiuld be able to run TAAD-TCN which achives the best perfromance on Mulitsports.

Train

Unfortunalty I do not have the bandwidth to reproduce this myself. But it should be doable with given current set of code base.

Contributors

TAAD is written by Gurkirt Singh. I am happy to recieve a pull request for training reproduction.

Citing PySlowFast

If you find this useful in your research, please use the following BibTeX entry for citation.

@InProceedings{Singh_2023_WACV,
    author    = {Singh, Gurkirt and Choutas, Vasileios and Saha, Suman and Yu, Fisher and Van Gool, Luc},
    title     = {Spatio-Temporal Action Detection Under Large Motion},
    booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
    month     = {January},
    year      = {2023},
    pages     = {6009-6018}
}

Don't forget to cite orignal PySlowfast Repo.

@misc{fan2020pyslowfast,
  author =       {Haoqi Fan and Yanghao Li and Bo Xiong and Wan-Yen Lo and
                  Christoph Feichtenhofer},
  title =        {PySlowFast},
  howpublished = {\url{https://github.com/facebookresearch/slowfast}},
  year =         {2020}
}

About

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%