Groq
Use Groq's fast inference for answer generation. Knowledge-base processing (embeddings) runs on OpenAI.
Your channels
answerLoops
What you control
Groq runs open models (Llama, Gemma, Mixtral) on its own hardware at very low latency and cost. Good when you want quick, cheap drafts. This integration covers chat only, because Groq doesn't offer embeddings.
OpenAI is the only provider that can handle knowledge-base processing (embeddings) today. Google Gemini and Mistral are coming soon. On a hosted plan, knowledge-base processing runs on your plan's included AI usage until you add an OpenAI key under Embeddings, which removes that limit. Self-hosted installs need an OpenAI key (or a custom embedding endpoint).
Available on every plan. Usage bills to your Groq account.
1. Get an API key
Create a key in the Groq Console. It starts
with gsk_.
2. Configure in answerLoops
- Settings → AI Model → Edit (owner or admin).
- Chat provider: Groq.
- Model ID: e.g.
llama-3.3-70b-versatile,llama-3.1-8b-instant— the field suggests current options; see the Groq models list for exact names. - API key: paste your
gsk_key. - Embeddings: leave the provider on OpenAI. On a hosted plan the OpenAI API key field is optional: leave it blank to use included AI usage for knowledge-base processing, or add a key to remove the limit. Self-hosted installs must enter one, or knowledge-base search and KB imports fail after you save. answerLoops tells you if it's missing.
- Click Test connection, then Save.
Models
| Use | Choice |
|---|---|
| Best answers | llama-3.3-70b-versatile |
| Fastest / cheapest | llama-3.1-8b-instant |
| Alternatives | gemma2-9b-it, mixtral-8x7b-32768 |
Related
- AI Model settings
- OpenAI integration — for an OpenAI embedding key