docs/localai.md
25 lines · 531 B · markdown
# LocalAI
**Licence:** MIT | **Language:** Go | **Source:** https://github.com/mudler/LocalAI
## Role in the stack
Drop-in OpenAI replacement for local models
## Why it's here
Speaks the OpenAI API and can serve LLMs, image and audio models from one process - useful when you want one endpoint for everything.
## Using it
See the project README in the fetched source:
```bash
./fetch-sources.sh ./sources
tar xzf ./sources/LocalAI.tar.gz -C ./sources
```
## Running it
Started by `docker compose up -d` on port 8081.