docs/ollama.md
25 lines · 523 B · markdown
# ollama
**Licence:** MIT | **Language:** Go | **Source:** https://github.com/ollama/ollama
## Role in the stack
Local model runner with an OpenAI-compatible API
## Why it's here
Pull and run open models locally with one command. Exposes an OpenAI-compatible endpoint, so existing SDKs work unchanged.
## Using it
See the project README in the fetched source:
```bash
./fetch-sources.sh ./sources
tar xzf ./sources/ollama.tar.gz -C ./sources
```
## Running it
Started by `docker compose up -d` on port 11434.