Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add example for side-by-side chat comparison #1207

Closed
wants to merge 7 commits into from
Closed

Conversation

mgoin
Copy link
Member

@mgoin mgoin commented Aug 25, 2023

python app.py zoo:nlg/text_generation/codegen_mono-350m/pytorch/huggingface/bigpython_bigquery_thepile/base_quant-none
DeepSparse, Copyright 2021-present / Neuralmagic, Inc. version: 1.6.0.20230824 COMMUNITY | (9bc2d6e5) (release) (optimized) (system=avx512_vnni, binary=avx512)
Welcome to the interactive text generation interface!
Type 'exit' to end the session.
> def fib():

<DeepSparse output>

def fib():
    a, b = 0, 1
    while True:
        yield a
        a, b = b, a + b

def fib2(n):
    a, b = 0, 1
    while a < n:
        yield a
        a, b = b, a + b
        
<ORT output>

def fib():
    a, b = 0, 1
    while True:
        yield a
        a, b = b, a + b

def fib2(n):
    a, b = 0, 1
    while a < n:
        yield a
        a, b = b, a + b

dbogunowicz
dbogunowicz previously approved these changes Aug 28, 2023
examples/chat-compare/app.py Outdated Show resolved Hide resolved
examples/chat-compare/app.py Outdated Show resolved Hide resolved
Copy link
Member

@bfineran bfineran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - what's the intended use case?

@dbogunowicz
Copy link
Contributor

dbogunowicz commented Sep 14, 2023

@bfineran I assume demos. @mgoin we can land this, but are you aware of this chat CLI that @rahul-tuli has just finished? It's almost identical to this PR. -> #1235

@mgoin mgoin closed this Oct 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants