New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add convert_int8 option #315

Closed

jpata opened this issue Apr 30, 2024 · 1 comment

Labels

medium

Owner

jpata commented Apr 30, 2024

Similar to https://github.com/jpata/particleflow/blob/main/mlpf/pyg/training.py#L821
add an optional flag to convert the model to int8 before the ONNX export.

jpata added the medium label

jpata mentioned this issue

Provide an efficient inference implementation using sparsification/quantization #206

Closed

Owner Author

jpata commented May 27, 2024

I think converting the ONNX model is a better path. Descoping this.

jpata closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment