#
openai-compatible-api
Here are 4 public repositories matching this topic...
LLM inference server implementation based on llama.cpp.
-
Updated
Aug 22, 2024 - C++
A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.
python
api
docker
rest
rest-api
transformers
torch
python3
pytorch
spacy
uvicorn
fastapi
huggingface-transformers
hugging-face
hugging-face-transformers
keybert
llm
openai-compatible-api
-
Updated
Aug 13, 2024 - Python
A Discordjs bot that uses OpenAI compatible endpoints for chatting.
discordjs
discord-bot
discordjs-bot
openai-api
llm
text-generation-webui
tabby-api
openai-compatible-api
-
Updated
Aug 7, 2024 - JavaScript
Improve this page
Add a description, image, and links to the openai-compatible-api topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the openai-compatible-api topic, visit your repo's landing page and select "manage topics."