Install pre-built version of llama.cpp

Homebrew

On Mac and Linux, the homebrew package manager can be used via

brew install llama.cpp

The formula is automatically updated with new llama.cpp releases. More info: ggerganov#7668

On Mac and Linux, the Nix package manager can be used via

nix profile install nixpkgs#llama-cpp

For flake enabled installs.

Or

nix-env --file '<nixpkgs>' --install --attr llama-cpp

For non-flake enabled installs.

This expression is automatically updated within the nixpkgs repo.

On Mac and Linux, Flox can be used to install llama.cpp within a Flox environment via

flox install llama-cpp

Flox follows the nixpkgs build of llama.cpp.