-
Notifications
You must be signed in to change notification settings - Fork 212
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[NeuralChat] Support user management in backend server #952
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Let's take a look how vLLM and TGI supports. we can leverage them and add what we need if missing. |
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
They are serving framework, so they don't support user management. |
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…extension-for-transformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
…ransformers into lvl/user_management Signed-off-by: lvliang-intel <liang1.lv@intel.com>
fschat==0.2.32 | ||
git+https://github.com/EleutherAI/lm-evaluation-harness.git@cc9778fbe4fa1a709be2abed9deb6180fd40e7e2 | ||
neural-compressor | ||
neural-compressor |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
already have neural-compressor
numpy==1.23.5 | ||
optimum | ||
optimum-intel | ||
peft | ||
pydantic==1.10.13 | ||
python-dotenv | ||
python-dotenv |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
python-dotenv is also there
|
||
|
||
class Settings(BaseSettings): | ||
mysql_user: str = os.environ.get("MYSQL_USER", "root") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
better to organize those settings in a more structured way e.g., database related, auth related (base auth, child auth ...)
Type of Change
feature
API not changed
Description
Support user management in backend server
Expected Behavior & Potential Risk
Support user management in backend server
How has this PR been tested?
Local test and pre-CI test.
Dependency Change?
None