Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Audit the onnx pathways to make them robust against >2Gb models #1540

Merged
merged 7 commits into from
May 11, 2023

Conversation

dbogunowicz
Copy link
Contributor

Uses the helper functions from sparsezoo to work reliably with the larger models (bigger than protobuf size, where the large data information is stored in the additional accompanying file).

Replaced all the instances where onnx model is saved with the sparsezoo helper function.
Replaced all the instances where onnx model is checked with the sparsezoo helper function.

GHA fail because we are not using the updated sparsezoo repository.
After pip installing this branch: neuralmagic/sparsezoo#308 locally, I got all green tests for pytorch and onnx test targets.

bfineran
bfineran previously approved these changes May 8, 2023
@dbogunowicz dbogunowicz merged commit 5a8a333 into main May 11, 2023
12 checks passed
@dbogunowicz dbogunowicz deleted the feature/damian/adapt_large_models branch May 11, 2023 05:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants