Commits on Nov 9, 2023

1. Pin optimum package …

   Without this, I get this error:
   
   ```
   Traceback (most recent call last):
     File "/axolotl/src/axolotl/utils/models.py", line 306, in load_model
       model = AutoModelForCausalLM.from_pretrained(
     File "/usr/local/lib/python3.10/dist-packages/transformers/models/auto/auto_factory.py", line 565, in from_pretrained
       return model_class.from_pretrained(
     File "/usr/local/lib/python3.10/dist-packages/transformers/modeling_utils.py", line 2713, in from_pretrained
       from optimum.gptq import GPTQQuantizer
     File "/usr/local/lib/python3.10/dist-packages/optimum/gptq/__init__.py", line 15, in <module>
       from .quantizer import GPTQQuantizer, load_quantized_model
     File "/usr/local/lib/python3.10/dist-packages/optimum/gptq/quantizer.py", line 44, in <module>
       if is_auto_gptq_available():
     File "/usr/local/lib/python3.10/dist-packages/optimum/utils/import_utils.py", line 116, in is_auto_gptq_available
       raise ImportError(
   ImportError: Found an incompatible version of auto-gptq. Found version 0.4.2, but only version above 0.4.99 are supported
   
   ```

   

   brthor committed Nov 9, 2023
   Configuration menu

   • View commit details
   • Copy full SHA for 2d6b99e
   • Browse repository at this point

   Copy the full SHA

   2d6b99e View commit details

   Browse the repository at this point in the history