llama-swap (llm/llama-swap) Updated: 1 week ago Add to my watchlist

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm etc

Run multiple generative AI models on your machine and hot-swap between them on demand. llama-swap works with any OpenAI and Anthropic API compatible server and is used by thousands of people to power their local AI workflows.

Version: 214 License: MIT GitHub
Maintainers oytech
Categories llm
Homepage https://github.com/mostlygeek/llama-swap
Platforms darwin freebsd linux
Variants -

"llama-swap" depends on

build (3)

Ports that depend on "llama-swap"

No ports


Port Health:

Loading Port Health

Installations (30 days)

0

Requested Installations (30 days)

0

Livecheck results

llama-swap seems to have been updated (port version: 214, new version: 217)

livecheck ran: 14 hours ago