Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable export paths for LLMs [CodeGen, OPT, Bloom] #1562

Merged
merged 3 commits into from
May 19, 2023
Merged

Enable export paths for LLMs [CodeGen, OPT, Bloom] #1562

merged 3 commits into from
May 19, 2023

Conversation

dbogunowicz
Copy link
Contributor

Minimal ONNX export path for LLMs through sparseml.transformers.

Testing plan:

  • Successfully exported CodeGen, OPT and Bloom on sequence len 1 and 128
  • Bloom has been detected to be a large model (larger than protobuf size) and exported accordingly
  • Visually expected the resulting ONNX models, they look correct.

@natuan natuan merged commit 934ec0e into main May 19, 2023
12 checks passed
@natuan natuan deleted the feature/damian/export_llms branch May 19, 2023 11:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@natuan natuan natuan approved these changes

@bfineran bfineran bfineran approved these changes

@anmarques anmarques Awaiting requested review from anmarques

@shubhra shubhra Awaiting requested review from shubhra

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@dbogunowicz @natuan @bfineran