Best Local & on-device AI

20 local & on-device ai in the Tool Hut catalog — compare them, find alternatives, and track the ones you actually use.

• Ollama

  Run Llama, Mistral, Gemma, and 100+ models locally with one CLI command.

• LM Studio

  Desktop GUI for downloading and running local LLMs — beginner-friendly, GPU-optimised.

• Jan

  Offline-first desktop AI app — runs local models with OpenAI-compatible API on localhost.

• AnythingLLM

  All-in-one private AI workspace — chat with documents, multi-user, local or cloud models.

• Civitai (local runner)

  AUTOMATIC1111's Stable Diffusion web UI — the standard local interface for running open image models.

• GPT4All

  Nomic's desktop app to run open LLMs privately on your machine.

• Open WebUI

  Self-hosted, feature-rich web UI for Ollama and local models.

• Text Generation WebUI

  The 'oobabooga' all-in-one web UI for running text models locally.

• KoboldCpp

  Single-file local LLM runner popular for writing and roleplay.

• ComfyUI

  Node-based local interface for Stable Diffusion image and video.

• Fooocus

  Simplified local Stable Diffusion focused on great defaults.

• LocalAI

  Self-hosted, OpenAI-compatible API for running models on your hardware.

• Msty

  Polished one-click desktop app for local and cloud models.

• PrivateGPT

  Ask questions of your documents fully offline, no data leaves your box.

• llamafile

  Mozilla's project to ship an entire LLM as one runnable file.

• Pinokio

  One-click installer and launcher for local AI apps and scripts.

• Whisper.cpp

  Fast C++ port of Whisper for on-device speech transcription.

• Backyard AI

  Run AI character chat locally with an easy desktop app.

• llama.cpp

  The core C/C++ engine that powers much local LLM inference.

• SillyTavern

  Power-user front-end for local and API roleplay and chat.