Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Set eval_sample_packing to false in mistral config.yaml #1003

Merged
merged 1 commit into from
Dec 28, 2023
Merged

Set eval_sample_packing to false in mistral config.yaml #1003

merged 1 commit into from
Dec 28, 2023

Conversation

kmsydney
Copy link
Contributor

Without eval_sampling_packing set to false, running accelerate launch -m axolotl.cli.train examples/mistral/config.yml returns the following error:

ValueError: eval dataset split is too small for sample_packing. You should set `eval_sample_packing: False`.

@kmsydney
Set eval_sample_packing to false in mistral config.yaml
0165788 
Without eval_sampling_packing set to false, ValueError occurs with eval dataset split is too small for sample_packing.
@kmsydney
Copy link
Contributor Author

Related to Issue #999.

@hamelsmu hamelsmu merged commit 384b817 into axolotl-ai-cloud:main Dec 28, 2023
@hamelsmu
Copy link
Collaborator

Went ahead and merged this since was a small docs change

@kmsydney kmsydney deleted the kmsydney/example-mistral-config branch December 29, 2023 06:27
@NanoCode012 NanoCode012 mentioned this pull request Dec 29, 2023
Closed
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@winglian winglian winglian approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@kmsydney @hamelsmu @winglian