pacman100 / hf_fsdp Public

forked from tmabraham/hf_fsdp

A very basic fsdp wrapper for HF.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 21 Commits
together		together
.gitignore		.gitignore
README.md		README.md
accelerate_config.yaml		accelerate_config.yaml
accelerate_launch.sh		accelerate_launch.sh
calc_loss.py		calc_loss.py
conda-env.yml		conda-env.yml
llama_flash_attn_monkey_patch.py		llama_flash_attn_monkey_patch.py
requirements.txt		requirements.txt
start_multinode.sh		start_multinode.sh
train.py		train.py