Best Local & on-device AI
20 local & on-device ai in the Tool Hut catalog — compare them, find alternatives, and track the ones you actually use.
Open Tool Hut — it's free →- Ollama
Run Llama, Mistral, Gemma, and 100+ models locally with one CLI command.
- LM Studio
Desktop GUI for downloading and running local LLMs — beginner-friendly, GPU-optimised.
- Jan
Offline-first desktop AI app — runs local models with OpenAI-compatible API on localhost.
- AnythingLLM
All-in-one private AI workspace — chat with documents, multi-user, local or cloud models.
- Civitai (local runner)
AUTOMATIC1111's Stable Diffusion web UI — the standard local interface for running open image models.
- GPT4All
Nomic's desktop app to run open LLMs privately on your machine.
- Open WebUI
Self-hosted, feature-rich web UI for Ollama and local models.
- Text Generation WebUI
The 'oobabooga' all-in-one web UI for running text models locally.
- KoboldCpp
Single-file local LLM runner popular for writing and roleplay.
- ComfyUI
Node-based local interface for Stable Diffusion image and video.
- Fooocus
Simplified local Stable Diffusion focused on great defaults.
- LocalAI
Self-hosted, OpenAI-compatible API for running models on your hardware.
- Msty
Polished one-click desktop app for local and cloud models.
- PrivateGPT
Ask questions of your documents fully offline, no data leaves your box.
- llamafile
Mozilla's project to ship an entire LLM as one runnable file.
- Pinokio
One-click installer and launcher for local AI apps and scripts.
- Whisper.cpp
Fast C++ port of Whisper for on-device speech transcription.
- Backyard AI
Run AI character chat locally with an easy desktop app.
- llama.cpp
The core C/C++ engine that powers much local LLM inference.
- SillyTavern
Power-user front-end for local and API roleplay and chat.