Local AI Tools

Everything you need to run, manage, and chat with AI models on your own hardware

ComfyUI

hard

Powerful node-based interface for Stable Diffusion and AI image generation. Create complex image generation workflows with a visua...

windowsmaclinuxdocker

AI artists and developers who need a powerful, flexible image generation pipeline

GPT4All

easy

Privacy-focused desktop app by Nomic AI for running LLMs completely offline. Emphasizes ease of use and local document Q&A without...

windowsmaclinux

Privacy-conscious users who want a simple offline AI assistant with document Q&A

Jan

easy

Open-source ChatGPT alternative that runs 100% offline. Clean, modern desktop app with local API server, extensions, and support f...

windowsmaclinux

Users who want a beautiful, modern ChatGPT alternative that works offline

KoboldCpp

medium

High-performance llama.cpp-based inference engine with built-in web UI. Popular in the creative writing and roleplay community for...

windowsmaclinux

Creative writers and roleplay enthusiasts who want maximum control over text generation

LM Studio

easy

Beautiful desktop app for discovering, downloading, and running LLMs locally. Features a chat UI, model search, and local server w...

windowsmaclinux

Users who want a polished desktop experience with built-in chat UI

Ollama

easy

The easiest way to run LLMs locally. One-command install, one-command run. Manages model downloads, quantization, and serves a loc...

windowsmaclinuxdocker

Getting started with local AI — the simplest path from zero to running models

Open WebUI

medium

Feature-rich, self-hosted ChatGPT-like interface for local LLMs. Supports Ollama and OpenAI-compatible APIs with multi-user suppor...

dockerlinux

Teams and power users who want a full-featured ChatGPT replacement

Text Generation Web UI

hard

The Swiss Army knife of local LLM interfaces by oobabooga. Supports virtually every model format and backend with extensive custom...

windowsmaclinuxdocker

Power users who need maximum flexibility and support for every model format