Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[server] Update server routes to be compliant with MLServer #1237

Merged
merged 16 commits into from
Oct 11, 2023
Merged

[server] Update server routes to be compliant with MLServer #1237

merged 16 commits into from
Oct 11, 2023

Commits on Sep 11, 2023

  1. update/clean-up server to match mlserver docs

    @dsikka
    dsikka committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    141a6b1 View commit details
    Browse the repository at this point in the history

  2. update server tests

    @dsikka
    dsikka committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    ff03ad6 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Sep 12, 2023
    Configuration menu
    Copy the full SHA
    36e5649 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Sep 13, 2023
    Configuration menu
    Copy the full SHA
    a09fe4a View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Sep 26, 2023
    Configuration menu
    Copy the full SHA
    a774639 View commit details
    Browse the repository at this point in the history

  2. add back ping

    @dsikka
    dsikka committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    750e422 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Sep 27, 2023
    Configuration menu
    Copy the full SHA
    6cffa85 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. [server] Refactor + OpenAI Chat Completion Support (#1288) 

    * refactor server for different integrations; additional functionality for chat completion streaming and non streaming

* further refactor server

* add support such that openai can host multiple models

* update all tests

* fix output for n > 1

* add inline comment explaining ProxyPipeline

* [server] Update OpenAI Model Support (#1300)

* update server

* allow users to send requests with new models

* use v1; move around baseroutes

* add openai path

* PR comments

* clean-up output classes to be dataclasses, add docstrings, cleanup generation kwargs
    @dsikka
    dsikka authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    d99a82c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    0afcd7e View commit details
    Browse the repository at this point in the history

  3. update readme, update route cleaning, update docstring

    @dsikka
    dsikka committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    f2327d3 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    c13832b View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    4f7e697 View commit details
    Browse the repository at this point in the history

  6. fix README for QA

    @dsikka
    dsikka committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    18913d4 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'match_mlserver' of https://github.com/neuralmagic/deeps… 

    …parse into match_mlserver
    @dsikka
    dsikka committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    c550799 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    d40fce7 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' into match_mlserver

    @dsikka
    dsikka authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    1283671 View commit details
    Browse the repository at this point in the history