Pinned Loading

1. TabbyML/tabby TabbyML/tabby Public

   Self-hosted AI coding assistant

   Rust 21k 953

2. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++ 8.1k 897

3. NVIDIA/FasterTransformer NVIDIA/FasterTransformer Public

   Transformer related optimization, including BERT, GPT

   C++ 5.8k 884

4. codefuse-ai/FasterTransformer4CodeFuse codefuse-ai/FasterTransformer4CodeFuse Public

   High-performance LLM inference based on our optimized version of FastTransfomer

   C++ 124 9