🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
-
Updated
Oct 15, 2024 - Python
🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
This repo introduces MagicData-CLAM, a Chinese SFT dataset, and provides to the community two relevant models that we finetuned. Contact business@magicdatatech.com for more information.
GUI version of text-generation-inference
RisuAI backend with python only. TextGen works, need more memory related updates
Deploy the Defog sqlcoder2 llm on Modal (https://modal.com) using Hugging Face Text Generation Inference (TGI)
Text Generation Interference example in Windows (docker, WSL is needed)
Add a description, image, and links to the text-generation-inference topic page so that developers can more easily learn about it.
To associate your repository with the text-generation-inference topic, visit your repo's landing page and select "manage topics."