llama.cpp (llm/llama.cpp) Updated: 1 week, 2 days ago Add to my watchlist 5

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

+ Show more

GitHub

• Details
• Builds
• Installation Stats
• Trac Tickets
• Report an Issue with this port
• API
• Stats FAQ

Statistics for selected duration

2026-May-14 to 2026-Jun-13

Variants table

Monthly Statistics

Can remain cached for up to 24 hours