Skip to content

Commit

Permalink
update datasets version to cut down the warnings due to pyarrow arg c…
Browse files Browse the repository at this point in the history
…hange (axolotl-ai-cloud#897)

* update datasets to cut down the warnings

* set versions for tokenizers and gradio

* upgrade transformers to latest version
  • Loading branch information
winglian committed Nov 25, 2023
1 parent 726371f commit 37776d6
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,14 +2,15 @@
auto-gptq==0.5.1
packaging
peft==0.6.0
transformers==4.35.1
transformers==4.35.2
tokenizers==0.15.0
bitsandbytes>=0.41.1
accelerate==0.24.1
deepspeed
addict
fire
PyYAML>=6.0
datasets>=2.14.0
datasets>=2.15.0
flash-attn==2.3.3
sentencepiece
wandb
Expand All @@ -29,7 +30,7 @@ scikit-learn==1.2.2
pynvml
art
fschat==0.2.29
gradio
gradio==3.50.2
tensorboard

# remote filesystems
Expand Down

0 comments on commit 37776d6

Please sign in to comment.