Skip to content

Commit

Permalink
Update sharegpt.py
Browse files Browse the repository at this point in the history
Resolves the double EOS token issue at the end of prompts when using Chatml template with shareGPT.py. 

axolotl-ai-cloud#922 (comment)
  • Loading branch information
noobmaster29 committed Dec 18, 2023
1 parent d25c34c commit dc33178
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/axolotl/prompt_strategies/sharegpt.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,8 @@
system_template="<|im_start|>system\n{system_message}",
system_message="You are a helpful assistant.",
roles=["<|im_start|>user", "<|im_start|>assistant"],
sep_style=SeparatorStyle.CHATML,
sep="<|im_end|>",
stop_str="<|im_end|>"
)
)

Expand Down

0 comments on commit dc33178

Please sign in to comment.