Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm etc
Run multiple generative AI models on your machine and hot-swap between them on demand. llama-swap works with any OpenAI and Anthropic API compatible server and is used by thousands of people to power their local AI workflows.
Run multiple generative AI models on your machine and hot-swap between them on demand. llama-swap works with any OpenAI and Anthropic API compatible server and is used by thousands of people to power their local AI workflows.
To install llama-swap, run the following command in macOS terminal (Applications->Utilities->Terminal)
sudo port install llama-swap
To see what files were installed by llama-swap, run:
port contents llama-swap
To later upgrade llama-swap, run:
sudo port selfupdate && sudo port upgrade llama-swap
Reporting an issue on MacPorts Trac
The MacPorts Project uses a system called Trac to file tickets to report bugs and enhancement requests.
Though anyone may search Trac for tickets, you must have a GitHub account in order to login to Trac to create tickets.