Launch offer — 40% off every tier for a limited time. Prices shown are already reduced.
Stacks / Code / Atlas / docs/localai.md
docs/localai.md 25 lines · 531 B · markdown
# LocalAI

**Licence:** MIT  |  **Language:** Go  |  **Source:** https://github.com/mudler/LocalAI

## Role in the stack

Drop-in OpenAI replacement for local models

## Why it's here

Speaks the OpenAI API and can serve LLMs, image and audio models from one process - useful when you want one endpoint for everything.

## Using it

See the project README in the fetched source:

```bash
./fetch-sources.sh ./sources
tar xzf ./sources/LocalAI.tar.gz -C ./sources
```

## Running it

Started by `docker compose up -d` on port 8081.