LocalAI
Self-hosted, drop-in replacement REST API compatible with OpenAI specifications.
Why consider LocalAI?
LocalAI is an open-source, local inference engine written in Go and C++ by Ettore Di Giacinto. Designed as a drop-in replacement for the OpenAI API, LocalAI runs LLMs, audio transcription (Whisper), text-to-speech, and image generation (Stable Diffusion) on consumer hardware without GPUs.
Learn LocalAI by building
Practical setup notes, real use cases, and copy-ready examples in one focused guide.
In this guide2 sections
Overview of LocalAI
LocalAI translates OpenAI SDK requests into local model executions without outbound cloud telemetry.
Docker Quickstart
docker run -p 8080:8080 --name local-ai -ti localai/localai:latest-cpuLocalAI is licensed under the permissive MIT License.
Related tools
More options with a similar category or technology profile.
diskus
Minimal, fast alternative to du -sh written in Rust using multi-threaded directory traversal.
peco
Simplistic interactive filtering tool for Unix pipelines, process lists, and file trees.
Dapr CLI
Command-line tool for managing Dapr distributed application runtime environments and sidecars.
Freeze
Generate beautiful image screenshots and SVGs of code snippets and terminal outputs.