-
Notifications
You must be signed in to change notification settings - Fork 419
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add lmdeploy tis python backend model #1014
Conversation
Hi @lvhan028, this is the evaluation code for TIS python backend. Shall we add it here? |
yes. I'll review it tomorrow. Thanks a lot |
Oh, sorry. |
Hi @tonysy Could you help merge this PR? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
Also it would be great if you can update the documentation .
@@ -0,0 +1,41 @@ | |||
from mmengine.config import read_base | |||
from opencompass.models.lmdeploy_tis import LmdeployTisModel |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@lvhan028 Shall we add a note for this backend here?
- If you evaluate the InternLM 7B model, please modify `eval_internlm_turbomind.py` or `eval_internlm_chat_turbomind.py` by changing to the setting `models = [internlm_7b]` in the last line. |
* add lmdeploy tis python backend model * fix pr check * update
* add lmdeploy tis python backend model * fix pr check * update
Motivation
Propose evaluation code for LMDeploy TIS Python backend.
Modification
Add evaluation model and config files.
Use cases
Checklist
Before PR:
After PR: