llama.cpp (llm/llama.cpp) Updated: 2 months, 1 week ago Add to my watchlist 1

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

+ Show more

GitHub

• Details
• Builds
• Installation Stats
• Trac Tickets
• Report an Issue with this port
• API
• Stats FAQ

Statistics for selected duration

2025-Mar-08 to 2025-Apr-07

Variants table

Monthly Statistics

Can remain cached for up to 24 hours