Ollama
Run answer generation on a local model through Ollama's OpenAI-compatible API.
Ollama runs open models on your own machine and exposes an OpenAI-compatible API. answerLoops talks to it through the OpenAI-compatible provider option — point it at Ollama's base URL, leave the key blank.
The OpenAI-compatible provider (any custom endpoint, Ollama included) is part of Custom AI model configuration, which is on the Enterprise plan. Self-hosted deployments have it unconditionally.
Chat runs locally. Embeddings can too (Ollama serves embedding models), or you can keep embeddings on OpenAI's hosted API — that's the only part that would leave your network.
1. Run Ollama
ollama serve
ollama pull llama3.2
ollama pull nomic-embed-text # only if you want local embeddings2. Configure in answerLoops
- Settings → AI Model → Edit (owner or admin).
- Chat provider: OpenAI-compatible.
- Base URL:
http://localhost:11434/v1— or, when answerLoops runs in Docker on macOS/Windows,http://host.docker.internal:11434/v1. - Model ID:
llama3.2(or whatever you pulled). - API key: leave blank — Ollama doesn't authenticate.
- Embeddings: either
- OpenAI-compatible with the same base URL and model
nomic-embed-text, or - OpenAI with a hosted key (embeddings then leave your network).
- OpenAI-compatible with the same base URL and model
- Click Test connection — it will fail if the base URL isn't reachable from the answerLoops server — then Save.
Ollama runs on the host, not inside the answerLoops container. Use
host.docker.internal (Mac/Windows) or the host's LAN IP (Linux) as the base
URL, not localhost.
Related
- Self-hosting: AI providers — the same setup from the self-hoster's angle
- AI Model settings