Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TextGeneration] Add Streaming Functionality #1246

Merged
merged 13 commits into from
Sep 21, 2023
Merged

[TextGeneration] Add Streaming Functionality #1246

merged 13 commits into from
Sep 21, 2023

Commits on Sep 21, 2023

  1. add streaming functionality

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    46361d2 View commit details
    Browse the repository at this point in the history

  2. remove print

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    c0c7e37 View commit details
    Browse the repository at this point in the history

  3. set back default value

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    ab838e7 View commit details
    Browse the repository at this point in the history

  4. rebase

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    7c2ec5d View commit details
    Browse the repository at this point in the history

  5. update to yield

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    444f0a2 View commit details
    Browse the repository at this point in the history

  6. update pipeline.py

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    5bd29aa View commit details
    Browse the repository at this point in the history

  7. update tests

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    20a46a7 View commit details
    Browse the repository at this point in the history

  8. refactor out streaming functions and remove yield in process_engine_o… 

    …utput
    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    fb38e2f View commit details
    Browse the repository at this point in the history

  9. fix tests

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    fd40bf9 View commit details
    Browse the repository at this point in the history

  10. update pipeline to use kwargs

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    592c81c View commit details
    Browse the repository at this point in the history

  11. rebase

    @dsikka
    dsikka committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    3a18e5f View commit details
    Browse the repository at this point in the history

  12. Update src/deepsparse/transformers/pipelines/text_generation.py 

    Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
    @dsikka @rahul-tuli
    dsikka and rahul-tuli committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    b833a22 View commit details
    Browse the repository at this point in the history

  13. Update src/deepsparse/pipeline.py 

    Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
    @dsikka @rahul-tuli
    dsikka and rahul-tuli committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    7db3f39 View commit details
    Browse the repository at this point in the history