Skip to content

Commit

Permalink
new readme
Browse files Browse the repository at this point in the history
  • Loading branch information
korewaChino committed Aug 27, 2023
1 parent 0f000f4 commit 4d8ef23
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,16 +2,18 @@

## Full-featured Docker image for Kobold-C++ (KoboldCPP)

[Docker Hub](https://hub.docker.com/r/korewachino/koboldcpp)
[Docker Hub](https://hub.docker.com/r/korewachino/koboldcpp) | [GitHub](https://github.com/korewaChino/koboldCppDocker)

This is a Docker image for Kobold-C++ (KoboldCPP) that includes all the tools needed to build and run KoboldCPP, with almost all BLAS backends supported.

The image is based on Rocky Linux 9 with CUDA 12.2.0.
The image is based on Ubuntu 20.04 LTS, and has both an NVIDIA CUDA and a generic/OpenCL/ROCm version.

## Usage

Simply run Docker to build and run KoboldCPP, refer to the [docker-compose.yml](docker-compose.yml) file for an example.

To use the non-NVIDIA version, use the `nocuda` tag.

## Building

To build the image, run:
Expand Down

0 comments on commit 4d8ef23

Please sign in to comment.