Tool Hut
Best Local & on-device AI
These 20 local and on-device AI tools run models on your own hardware — private, offline, and free of per-token bills. Compare model support, hardware requirements, and setup effort before going local.
Open Tool Hut — it's free →-
Ollama
Run Llama, Mistral, Gemma, and 100+ models locally with one CLI command.
Best for Running LLMs locally, privacy-first AI, local OpenAI-compatible API, developer use
-
LM Studio
Desktop GUI for downloading and running local LLMs — beginner-friendly, GPU-optimised.
Best for Beginner-friendly local LLMs, Mac Apple Silicon, desktop GUI, model discovery
-
Jan
Offline-first desktop AI app — runs local models with OpenAI-compatible API on localhost.
Best for Offline local AI, OpenAI-compatible local API, privacy, developer model switching
-
AnythingLLM
All-in-one private AI workspace — chat with documents, multi-user, local or cloud models.
Best for Private document chat, self-hosted RAG, team AI workspace, local + cloud LLMs
-
Civitai (local runner)
AUTOMATIC1111's Stable Diffusion web UI — the standard local interface for running open image models.
Best for Stable Diffusion, Local Workflows, Open-Source Deployments, Private And Local AI
-
GPT4All
Nomic's desktop app to run open LLMs privately on your machine.
Best for Local Workflows, Desktop, Open-Source Deployments, Private And Local AI
-
Open WebUI
Self-hosted, feature-rich web UI for Ollama and local models.
Best for Local Workflows, Self-Hosted Setups, Ui, Private And Local AI
-
Text Generation WebUI
The 'oobabooga' all-in-one web UI for running text models locally.
Best for Local Workflows, Web Ui, Open-Source Deployments, Private And Local AI
-
KoboldCpp
Single-file local LLM runner popular for writing and roleplay.
Best for Local Workflows, Writing, Roleplay, Private And Local AI
-
ComfyUI
Node-based local interface for Stable Diffusion image and video.
Best for Local Workflows, Image Generation, Node Based, Private And Local AI
-
Fooocus
Simplified local Stable Diffusion focused on great defaults.
Best for Local Workflows, Image Generation, Simple, Private And Local AI
-
LocalAI
Self-hosted, OpenAI-compatible API for running models on your hardware.
Best for Local Workflows, Self-Hosted Setups, API Access, Private And Local AI
-
Msty
Polished one-click desktop app for local and cloud models.
Best for Local Workflows, Desktop, Offline, Private And Local AI
-
PrivateGPT
Ask questions of your documents fully offline, no data leaves your box.
Best for Local Workflows, RAG Pipelines, Privacy-Sensitive Work, Private And Local AI
-
llamafile
Mozilla's project to ship an entire LLM as one runnable file.
Best for Local Workflows, Portable, Open-Source Deployments, Private And Local AI
-
Pinokio
One-click installer and launcher for local AI apps and scripts.
Best for Local Workflows, Installer, Launcher, Private And Local AI
-
Whisper.cpp
Fast C++ port of Whisper for on-device speech transcription.
Best for Local Workflows, Transcription, Open-Source Deployments, Private And Local AI
-
Backyard AI
Run AI character chat locally with an easy desktop app.
Best for Local Workflows, Characters, Roleplay, Private And Local AI
-
llama.cpp
The core C/C++ engine that powers much local LLM inference.
Best for Local Workflows, Model Inference, Open-Source Deployments, Private And Local AI
-
SillyTavern
Power-user front-end for local and API roleplay and chat.
Best for Local Workflows, Roleplay, Front End, Private And Local AI