Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feat] Add streaming to chatbot #1272

Merged
merged 11 commits into from
Oct 16, 2023
Merged

[Feat] Add streaming to chatbot #1272

merged 11 commits into from
Oct 16, 2023
+65 −36

Commits on Oct 11, 2023

  1. Add changes needed on parent class side

    @rahul-tuli @mgoin
    rahul-tuli authored and mgoin committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    1d3c54f View commit details
    Browse the repository at this point in the history

  2. Add stream mode to chatbot 

    Clean functions
    @rahul-tuli @mgoin
    rahul-tuli authored and mgoin committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    3b9a00a View commit details
    Browse the repository at this point in the history

  3. Update sampling temperature to temperature

    @rahul-tuli @mgoin
    rahul-tuli authored and mgoin committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    e4fb27c View commit details
    Browse the repository at this point in the history

  4. Update src/deepsparse/transformers/infer.py

    @mgoin
    mgoin committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    9886574 View commit details
    Browse the repository at this point in the history

  5. Rebase and fix streaming

    @mgoin
    mgoin committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    8c2e74f View commit details
    Browse the repository at this point in the history

  6. Fix broken data pathway

    @rahul-tuli
    rahul-tuli committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    a29478f View commit details
    Browse the repository at this point in the history

  7. Add stream to data mode 

    update arg name to prompt
    @rahul-tuli
    rahul-tuli committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    86379d1 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into add-streaming-to-chatbot

    @rahul-tuli
    rahul-tuli committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    f92c313 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. Update prompt prefill tok/s

    @mgoin
    mgoin committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    68d7c59 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into add-streaming-to-chatbot

    @rahul-tuli
    rahul-tuli committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    c59607d View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Merge branch 'main' into add-streaming-to-chatbot

    @rahul-tuli
    rahul-tuli committed Oct 16, 2023
    Configuration menu
    Copy the full SHA
    2e12bac View commit details
    Browse the repository at this point in the history