Skip to content

Latest commit

 

History

History
23 lines (13 loc) · 850 Bytes

README.md

File metadata and controls

23 lines (13 loc) · 850 Bytes
Raw

Docker Pulls

Full-featured Docker image for Kobold-C++ (KoboldCPP)

Docker Hub | GitHub

This is a Docker image for Kobold-C++ (KoboldCPP) that includes all the tools needed to build and run KoboldCPP, with almost all BLAS backends supported.

The image is based on Ubuntu 20.04 LTS, and has both an NVIDIA CUDA and a generic/OpenCL/ROCm version.

Usage

Simply run Docker to build and run KoboldCPP, refer to the docker-compose.yml file for an example.

To use the non-NVIDIA version, use the nocuda tag.

Building

To build the image, run:

docker compose build