New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

支持的量化类型 #196

Open

deleteeeee opened this issue Jun 14, 2024 · 1 comment

Labels

question

deleteeeee commented Jun 14, 2024

您好，请问一下，目前只支持F16和Q4_0这两种么，我在运行其它量化类型的的模型时会出现unsupported type

deleteeeee added the question label

Dujianhua1008 commented Jun 17, 2024

？？？原来是这里的问题我做了 Q8 Q4_k 跑起来都是 ###

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment