Skip to content

Commit

Permalink
Update sharegpt.py
Browse files Browse the repository at this point in the history
Resolves the double EOS token issue at the end of prompts when using Chatml template with shareGPT.py. 

axolotl-ai-cloud#922 (comment)
  • Loading branch information
noobmaster29 authored and winglian committed Jan 6, 2024
1 parent 553c80f commit d4eb95f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/axolotl/prompt_strategies/sharegpt.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,8 @@
system_template="<|im_start|>system\n{system_message}",
system_message="You are a helpful assistant.",
roles=["<|im_start|>user", "<|im_start|>assistant"],
sep_style=SeparatorStyle.CHATML,
sep="<|im_end|>",
stop_str="<|im_end|>"
)
)

Expand Down

0 comments on commit d4eb95f

Please sign in to comment.