Skip to content

Commit

Permalink
update support matrix with btlm and phi (#579)
Browse files Browse the repository at this point in the history
  • Loading branch information
winglian committed Sep 15, 2023
1 parent 861ceca commit a5a625f
Showing 1 changed file with 10 additions and 8 deletions.
18 changes: 10 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,14 +51,16 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, o
## Axolotl supports

| | fp16/fp32 | lora | qlora | gptq | gptq w/flash attn | flash attn | xformers attn |
|----------|:----------|:-----|-------|------|-------------------|------------|---------------|
| llama ||||||||
| Pythia ||||||||
| cerebras ||||||||
| mpt ||||||||
| falcon ||||||||
| gpt-j ||||||||
| XGen ||||||||
|----------|:----------|:-----|-------|------|-------------------|------------|--------------|
| llama ||||||||
| Pythia ||||||||
| cerebras ||||||||
| btlm ||||||||
| mpt ||||||||
| falcon ||||||||
| gpt-j ||||||||
| XGen ||||||||
| phi ||||||||


## Quickstart ⚡
Expand Down

0 comments on commit a5a625f

Please sign in to comment.