Skip to content

Commit

Permalink
Fix: Cannot tokenize with bf16 and on cpu (axolotl-ai-cloud#766)
Browse files Browse the repository at this point in the history
  • Loading branch information
NanoCode012 committed Oct 22, 2023
1 parent 1c1a59f commit 5da7a36
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -819,7 +819,7 @@ accelerate launch -m axolotl.cli.train your_config.yml

You can optionally pre-tokenize dataset with the following before finetuning:
```bash
CUDA_VISIBLE_DEVICES="" accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
CUDA_VISIBLE_DEVICES=0 accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
```

##### Config
Expand Down

0 comments on commit 5da7a36

Please sign in to comment.