Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Aya 23 models. #1707

Open
5 tasks done
SoshyHayami opened this issue Jun 13, 2024 · 0 comments
Open
5 tasks done

Support for Aya 23 models. #1707

SoshyHayami opened this issue Jun 13, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@SoshyHayami
Copy link

SoshyHayami commented Jun 13, 2024

⚠️ Please check that this feature request hasn't been suggested before.

  • I searched previous Ideas in Discussions didn't find any similar feature requests.
  • I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

This model is one of the Decoder-only LLMs (unlike the previous Aya model which was seq2seq) has some of the best multilingual capabilities I've ever seen. probably one of the best options for further fine tuning.

✔️ Solution

it'd be amazing if we can have a training script and support added for this family of models in Axolotl.

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

  • My issue title is concise, descriptive, and in title casing.
  • I have searched the existing issues to make sure this feature has not been requested yet.
  • I have provided enough information for the maintainers to understand and evaluate this request.
@SoshyHayami SoshyHayami added the enhancement New feature or request label Jun 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant