Fix(version): Update FA to work with Mistral SWA (#673)

axolotl-ai-cloud · Oct 4, 2023 · 43856c0 · 43856c0
1 parent e62d590
commit 43856c0
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/requirements.txt b/requirements.txt
@@ -12,7 +12,7 @@ addict
 fire
 PyYAML>=6.0
 datasets
-flash-attn>=2.2.1
+flash-attn>=2.3.0
 sentencepiece
 wandb
 einops