llama-swap (llm/llama-swap) Updated: 1 day, 14 hours ago Add to my watchlist
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm etcRun multiple generative AI models on your machine and hot-swap between them on demand. llama-swap works with any OpenAI and Anthropic API compatible server and is used by thousands of people to power their local AI workflows.
Version: 224 License: MIT
GitHub
| Maintainers | oytech |
| Categories | llm |
| Homepage | https://github.com/mostlygeek/llama-swap |
| Platforms | darwin freebsd linux |
| Variants | - |
"llama-swap" depends on
build (3)
Ports that depend on "llama-swap"
No ports
Port notes
Optionally install mactop to see full GPU performance data in web ui.
Port Health:
Loading Port Health