You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
transformers has been updated to 4.45.1, but optimum requires transformers[sentencepiece]<4.45.0,>=4.29, which restricts me from using the new transformers version
Motivation
Because I need the from transformers import Qwen2VLForConditionalGeneration
transformers must be updated to 4.45.1
Otherwise, the following error will be reported
Unrecognized keys in `rope_scaling` for 'rope_type'='default': {'mrope_section'}
Traceback (most recent call last):
File "/home/pon/code/me/modelscope_example/Qwen2-VL-7B-Instruct-GPTQ-Int4.py", line 7, in <module>
model = Qwen2VLForConditionalGeneration.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pon/.local/share/virtualenvs/modelscope_example-DACykz4b/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3447, in from_pretrained
hf_quantizer = AutoHfQuantizer.from_config(config.quantization_config, pre_quantized=pre_quantized)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pon/.local/share/virtualenvs/modelscope_example-DACykz4b/lib/python3.11/site-packages/transformers/quantizers/auto.py", line 144, in from_config
return target_cls(quantization_config, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pon/.local/share/virtualenvs/modelscope_example-DACykz4b/lib/python3.11/site-packages/transformers/quantizers/quantizer_gptq.py", line 47, in __init__
from optimum.gptq import GPTQQuantizer
ModuleNotFoundError: No module named 'optimum'
Your contribution
There is no pr to provide, but I think it is possible to remove the upper limit version constraint of transformers in future versions and only keep the lower limit constraint
The text was updated successfully, but these errors were encountered:
Feature request
transformers has been updated to 4.45.1, but optimum requires transformers[sentencepiece]<4.45.0,>=4.29, which restricts me from using the new transformers version
Motivation
Because I need the
from transformers import Qwen2VLForConditionalGeneration
transformers must be updated to 4.45.1
Otherwise, the following error will be reported
Your contribution
There is no pr to provide, but I think it is possible to remove the upper limit version constraint of transformers in future versions and only keep the lower limit constraint
The text was updated successfully, but these errors were encountered: