Set eval_sample_packing to false in mistral config.yaml (#1003)

Without eval_sampling_packing set to false, ValueError occurs with eval dataset split is too small for sample_packing.
axolotl-ai-cloud · Dec 28, 2023 · 384b817 · 384b817
1 parent db9094d
commit 384b817
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/examples/mistral/config.yml b/examples/mistral/config.yml
@@ -17,6 +17,7 @@ output_dir: ./out
 sequence_len: 8192
 sample_packing: true
 pad_to_sequence_len: true
+eval_sample_packing: false
 
 wandb_project:
 wandb_entity: