Skip to content

@analytics-zoo analytics-zoo

Change the repository type filter

All

    Repositories list

    50 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •4.3k•1•0•8•Updated Oct 22, 2024Oct 22, 2024

    • ipex-llm

      Public
      Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.
      Python
      •
      Apache License 2.0
      •1.3k•0•0•0•Updated Aug 24, 2024Aug 24, 2024

    • inference

      Public
      Reference implementations of MLPerf™ inference benchmarks
      Python
      •
      Apache License 2.0
      •530•0•0•0•Updated Aug 7, 2024Aug 7, 2024

    • vllm-benchmark

      Public
      Store the benchmark config for vllm
      Shell
      •0•0•0•0•Updated Jul 10, 2024Jul 10, 2024

    • DeepSpeed

      Public
      DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
      Python
      •
      Apache License 2.0
      •4.1k•0•0•0•Updated May 16, 2024May 16, 2024

    • FastChat

      Public
      An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
      Python
      •
      Apache License 2.0
      •4.5k•1•0•0•Updated May 14, 2024May 14, 2024

    • ollama

      Public
      Get up and running with Llama 2, Mistral, Gemma, and other large language models.
      C++
      •
      MIT License
      •7.5k•0•0•0•Updated Mar 19, 2024Mar 19, 2024

    • transformers-PPML

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •27k•0•0•2•Updated Dec 12, 2023Dec 12, 2023

    • FastChat-bench

      Public
      Lua
      •3•0•0•0•Updated Nov 15, 2023Nov 15, 2023

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of autoregressive language models.
      Python
      •
      MIT License
      •1.8k•0•1•0•Updated Nov 9, 2023Nov 9, 2023

    • gha-cicd-env

      Public
      GitHub Action CI/CD environments
      Python
      •6•0•0•0•Updated Oct 16, 2023Oct 16, 2023

    • GPTCache

      Public
      Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
      Python
      •
      MIT License
      •502•0•0•0•Updated Oct 13, 2023Oct 13, 2023

    • pytorch-serve

      Public
      Serve, optimize and scale PyTorch models in production
      Java
      •
      Apache License 2.0
      •858•0•0•0•Updated Sep 4, 2023Sep 4, 2023

    • gramine

      Public
      A library OS for Linux multi-process applications, with Intel SGX support
      C
      •
      GNU Lesser General Public License v3.0
      •196•0•0•0•Updated Jul 24, 2023Jul 24, 2023

    • bloomz.cpp

      Public
      C++ implementation for BLOOM
      C
      •
      MIT License
      •65•0•0•0•Updated Jul 5, 2023Jul 5, 2023

    • MLServer

      Public
      An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
      Python
      •
      Apache License 2.0
      •180•0•0•0•Updated Jul 4, 2023Jul 4, 2023

    • libjpeg-turbo

      Public
      Main libjpeg-turbo repository
      C
      •
      Other
      •1k•0•0•0•Updated Jun 29, 2023Jun 29, 2023

    • tcmalloc

      Public
      C++
      •
      Apache License 2.0
      •473•0•0•0•Updated Apr 23, 2023Apr 23, 2023

    • hadoop

      Public
      Apache Hadoop
      Java
      •
      Apache License 2.0
      •8.9k•0•0•1•Updated Apr 18, 2023Apr 18, 2023

    • LightGBM

      Public
      A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
      C++
      •
      MIT License
      •3.8k•1•0•0•Updated Apr 17, 2023Apr 17, 2023

    • hive

      Public
      Apache Hive
      Java
      •
      Apache License 2.0
      •4.7k•0•0•0•Updated Apr 4, 2023Apr 4, 2023

    • keywhiz

      Public
      A system for distributing and managing secrets
      Java
      •
      Apache License 2.0
      •216•0•0•0•Updated Apr 4, 2023Apr 4, 2023

    • zeppelin

      Public
      Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
      Java
      •
      Apache License 2.0
      •2.8k•0•0•0•Updated Feb 15, 2023Feb 15, 2023

    • jemalloc

      Public
      C
      •
      Other
      •1.4k•0•0•0•Updated Jan 29, 2023Jan 29, 2023

    • kvdi

      Public
      A Kubernetes-native Virtual Desktop Infrastructure
      Go
      •
      GNU General Public License v3.0
      •47•0•0•0•Updated Nov 29, 2022Nov 29, 2022

    • BigDL

      Public
      Fast, distributed, secure AI for Big Data
      Jupyter Notebook
      •
      Apache License 2.0
      •1.3k•1•0•0•Updated Nov 28, 2022Nov 28, 2022

    • analytics-zoo.github.io

      Public
      HTML
      •
      Apache License 2.0
      •9•8•1•0•Updated Nov 21, 2022Nov 21, 2022

    • gloo

      Public
      Collective communications library with various primitives for multi-machine training.
      C++
      •
      Other
      •303•0•0•0•Updated Nov 16, 2022Nov 16, 2022

    • pytorch

      Public
      Tensors and Dynamic neural networks in Python with strong GPU acceleration
      C++
      •
      Other
      •22k•0•0•0•Updated Nov 16, 2022Nov 16, 2022

    • tensorflow

      Public
      An Open Source Machine Learning Framework for Everyone
      C++
      •
      Apache License 2.0
      •74k•1•0•1•Updated Nov 10, 2022Nov 10, 2022