Integrations
Groq
Use Groq's fast inference for answer generation, with an OpenAI key for embeddings.
Groq runs open models (Llama, Gemma, Mixtral) on its own hardware at very low latency and cost. Good when you want quick, cheap drafts. This integration covers chat only — knowledge-base search still needs an OpenAI key for embeddings alongside it.
Available on every plan. Usage bills to your Groq account.
1. Get an API key
Create a key in the Groq Console. It starts
with gsk_.
2. Configure in answerLoops
- Settings → AI Model → Edit (owner or admin).
- Chat provider: Groq.
- Model ID: e.g.
llama-3.3-70b-versatile,llama-3.1-8b-instant— the field suggests current options; see the Groq models list for exact names. - API key: paste your
gsk_key. - Embeddings: leave the provider on OpenAI and enter an OpenAI API key in the embedding key field — required, or knowledge-base search and KB imports fail after you save.
- Click Test connection, then Save.
Models
| Use | Choice |
|---|---|
| Best answers | llama-3.3-70b-versatile |
| Fastest / cheapest | llama-3.1-8b-instant |
| Alternatives | gemma2-9b-it, mixtral-8x7b-32768 |
Related
- AI Model settings
- OpenAI integration — for the embedding key