llmfit

v 0.9.2 Updated: 1 week, 1 day ago

A terminal tool for finding best fitted LLM models for your machine.

A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine. Ships with an interactive TUI (default) and a classic CLI mode. Supports multi-GPU setups, MoE architectures, dynamic quantization selection, speed estimation, and local runtime providers (Ollama, llama.cpp, MLX, Docker Model Runner, LM Studio).

https://github.com/AlexsJones/llmfit

To install llmfit, paste this into the macOS Terminal after installing MacPorts

sudo port install llmfit

Add to my watchlist

Installations 0
Requested Installations 0