Tool Hut
Best llama.cpp alternatives
llama.cpp is one of 20 local & on-device ai in the Tool Hut catalog. If it isn't the right fit — on price, features, or focus — here are 8 alternatives worth comparing.
Track llama.cpp & its alternatives in your hut →8 alternatives to llama.cpp
- Ollama
Run Llama, Mistral, Gemma, and 100+ models locally with one CLI command.
- LM Studio
Desktop GUI for downloading and running local LLMs — beginner-friendly, GPU-optimised.
- Jan
Offline-first desktop AI app — runs local models with OpenAI-compatible API on localhost.
- AnythingLLM
All-in-one private AI workspace — chat with documents, multi-user, local or cloud models.
- Civitai (local runner)
AUTOMATIC1111's Stable Diffusion web UI — the standard local interface for running open image models.
Visit Civitai (local runner) → · Civitai (local runner) alternatives →
- GPT4All
Nomic's desktop app to run open LLMs privately on your machine.
- Open WebUI
Self-hosted, feature-rich web UI for Ollama and local models.
- Text Generation WebUI
The 'oobabooga' all-in-one web UI for running text models locally.
Visit Text Generation WebUI → · Text Generation WebUI alternatives →