Skip to content

Commit

Permalink
eval_table isn't quite stable enough to be in default llama configs (#…
Browse files Browse the repository at this point in the history
  • Loading branch information
winglian authored Sep 26, 2023
1 parent 19a600a commit d887ad8
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion examples/llama-2/lora.yml
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ flash_attention: true

warmup_steps: 10
eval_steps: 20
eval_table_size: 5
eval_table_size:
eval_table_max_new_tokens: 128
save_steps:
debug:
Expand Down
2 changes: 1 addition & 1 deletion examples/llama-2/qlora.yml
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ flash_attention: true

warmup_steps: 10
eval_steps: 20
eval_table_size: 5
eval_table_size:
save_steps:
debug:
deepspeed:
Expand Down
2 changes: 1 addition & 1 deletion examples/llama-2/tiny-llama.yml
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ flash_attention: true

warmup_steps: 10
eval_steps: 20
eval_table_size: 5
eval_table_size:
save_steps:
debug:
deepspeed:
Expand Down

0 comments on commit d887ad8

Please sign in to comment.