Skip to content

Commit

Permalink
Update src/deepsparse/transformers/infer.py
Browse files Browse the repository at this point in the history
  • Loading branch information
mgoin committed Oct 7, 2023
1 parent 15f4698 commit 4bf02ff
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions src/deepsparse/transformers/infer.py
Original file line number Diff line number Diff line change
Expand Up @@ -181,10 +181,10 @@ def _display_generation_speed(prompt_sequence_length, pipeline):
def _display_bot_response(stream: bool, response):
# print response from pipeline, streaming or not

print("Bot:", end=" ")
print("Bot:", end="")
if stream:
for generation in response:
print(generation.generations[0].text, end=" ")
print(generation.generations[0].text, end="")
print()
else:
print(response.generations[0].text)
Expand Down

0 comments on commit 4bf02ff

Please sign in to comment.