Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: Warns to add to modules_to_save when adding tokens or switching special_tokens #787

Merged

Conversation

NanoCode012
Copy link
Collaborator

No description provided.

@NanoCode012 NanoCode012 marked this pull request as draft October 26, 2023 12:45
@NanoCode012
Copy link
Collaborator Author

The code now errors when the config is incorrect in these adapter training cases:

  • adding new tokens without proper modules_to_save
  • changing special tokens without proper modules_to_save

Breaking change: This means that all training configs without proper modules_to_save won't work now, which should be as intended as they may have been incorrect.

@NanoCode012 NanoCode012 marked this pull request as ready for review December 19, 2023 08:38
@NanoCode012 NanoCode012 changed the title Feat: Auto add to modules_to_save when adding tokens Feat: Warns to add to modules_to_save when adding tokens or switching special_tokens Dec 19, 2023
@NanoCode012 NanoCode012 merged commit 1ffa386 into axolotl-ai-cloud:main Dec 22, 2023
4 checks passed
@NanoCode012 NanoCode012 deleted the fix/add_modules_to_save branch December 22, 2023 12:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants