Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue converting moss-moon-003-sft-int4 model to ONNX format #1980

Open
4 tasks
ZhiChengWHU opened this issue Aug 2, 2024 · 0 comments
Open
4 tasks

Issue converting moss-moon-003-sft-int4 model to ONNX format #1980

ZhiChengWHU opened this issue Aug 2, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@ZhiChengWHU
Copy link

System Info

I've been working with the owlv2 model and have encountered an issue while attempting to convert it into ONNX format using the provided command:
optimum-cli export onnx --task text-generation -m"/HDD/cz/tools/moss/" --trust-remote-code "HDD/cz/moss_onnx/"
Unfortunately, I'm facing the following error:
Trying to export a moss model, that is a custom or unsupported architecture, but no custom onnx configuration was passed as `custom_onnx_configs`.
As I am relatively new to this process, I'm unsure about the necessity and usage of custom ONNX configuration. Could you please provide some guidance on how to address this issue? Any assistance or insights would be greatly appreciated.

Thank you for your attention to this matter.

Who can help?

No response

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

https://huggingface.co/fnlp/moss-moon-003-sft-int4/tree/main

Expected behavior

Convert the model to onnx format

@ZhiChengWHU ZhiChengWHU added the bug Something isn't working label Aug 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant