llama.cpp (llm/llama.cpp) Updated: 1 week ago Add to my watchlist 5

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

+ Show more

GitHub

• Details
• Builds
• Installation Stats
• Trac Tickets
• Report an Issue with this port
• API
• Stats FAQ

Statistics for selected duration

2025-Sep-27 to 2025-Oct-27

Variants table

Monthly Statistics

Can remain cached for up to 24 hours