llama.cpp (llm/llama.cpp) Updated: 2 days, 14 hours ago Add to my watchlist 5

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

+ Show more

GitHub

• Details
• Builds
• Installation Stats
• Trac Tickets
• Report an Issue with this port
• API
• Stats FAQ

Statistics for selected duration

2026-Feb-18 to 2026-Mar-20

Variants table

Monthly Statistics

Can remain cached for up to 24 hours