Skip to content

Commit

Permalink
Fix: Cannot tokenize with bf16 and on cpu (#766)
Browse files Browse the repository at this point in the history
  • Loading branch information
NanoCode012 committed Oct 22, 2023
1 parent 9923b72 commit afedc47
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -819,7 +819,7 @@ accelerate launch -m axolotl.cli.train your_config.yml

You can optionally pre-tokenize dataset with the following before finetuning:
```bash
CUDA_VISIBLE_DEVICES="" accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
CUDA_VISIBLE_DEVICES=0 accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
```

##### Config
Expand Down

0 comments on commit afedc47

Please sign in to comment.