Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Documentation Model Gallery Import Model

Operations in Progress

Installed Models

6 models ready to use

llama-3-sauerkrautlm-8b-instruct

cpu-llama-cpp

Chat

Edit

mistral-7b-instruct-v0.3

cpu-llama-cpp

Chat

Edit

moondream2-20250414

cpu-llama-cpp

Chat

Edit

phi-3.5-mini-instruct

cpu-llama-cpp

Chat

Edit

qwen3-4b

cpu-llama-cpp

Chat

Edit

moondream2-mmproj-f16-20250414.gguf

Auto Backend No Config

Configuration required for full functionality

Installed Backends

0 backend ready to use

No backends installed yet

Backends power your AI models. Install them from the backend gallery to get started

Browse Backend Gallery Documentation