llama-swap (llm/llama-swap) Updated: 3 days, 21 hours ago Add to my watchlist
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm etcRun multiple generative AI models on your machine and hot-swap between them on demand. llama-swap works with any OpenAI and Anthropic API compatible server and is used by thousands of people to power their local AI workflows.
Version: 224 License: MIT
GitHub
| Maintainers | oytech |
| Categories | llm |
| Homepage | https://github.com/mostlygeek/llama-swap |
| Platforms | darwin freebsd linux |
| Variants | - |
"llama-swap" depends on
build (3)
Ports that depend on "llama-swap"
No ports
Port notes
Optionally install mactop to see full GPU performance data in web ui.
Port Health:
Loading Port Health
Installations (30 days)
0
Requested Installations (30 days)
0
Livecheck results
llama-swap seems to have been updated (port version: 224, new version: 226)
livecheck ran: 10 hours ago