llama.cpp (llm/llama.cpp) Updated: 3 days, 1 hour ago Add to my watchlist

LLM inference in C/C++

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

Version: 5785 License: MIT

GitHub

Maintainers	i0ntempest
Categories	llm
Homepage	https://github.com/ggerganov/llama.cpp
Platforms	darwin
Variants	blas (Uses BLAS, improves performance) debug (Enable debug binaries) model_converters (install extra model conversion Python scripts) native (Force local build and optimize for CPU) openmp (enable parallelism support using OpenMP) universal (Build for multiple architectures)

"llama.cpp" depends on

lib (2)

curl

libomp

build (3)

clang-17

cmake

pkgconfig

Ports that depend on "llama.cpp"

No ports

Port Health:

Loading Port Health

Installations (30 days)

3

Requested Installations (30 days)

3

Livecheck results

llama.cpp seems to have been updated (port version: 5785, new version: 5797)

livecheck ran: 1 day, 15 hours ago

llama.cpp (llm/llama.cpp) Updated: 3 days, 1 hour ago Add to my watchlist 3