answerLoopsanswerLoopsDocs

Groq

Use Groq's fast inference for answer generation. Knowledge-base processing (embeddings) runs on OpenAI.

Your channels

answerLoops

What you control

Answering is billed to your Groq account
Questions from your channels. Customers ask in the channels you have connected, such as Slack, Discord, email, or the website widget. Every question goes through the same answering pipeline.

Groq runs open models (Llama, Gemma, Mixtral) on its own hardware at very low latency and cost. Good when you want quick, cheap drafts. This integration covers chat only, because Groq doesn't offer embeddings.

OpenAI is the only provider that can handle knowledge-base processing (embeddings) today. Google Gemini and Mistral are coming soon. On a hosted plan, knowledge-base processing runs on your plan's included AI usage until you add an OpenAI key under Embeddings, which removes that limit. Self-hosted installs need an OpenAI key (or a custom embedding endpoint).

Available on every plan. Usage bills to your Groq account.

1. Get an API key

Create a key in the Groq Console. It starts with gsk_.

2. Configure in answerLoops

  1. Settings → AI Model → Edit (owner or admin).
  2. Chat provider: Groq.
  3. Model ID: e.g. llama-3.3-70b-versatile, llama-3.1-8b-instant — the field suggests current options; see the Groq models list for exact names.
  4. API key: paste your gsk_ key.
  5. Embeddings: leave the provider on OpenAI. On a hosted plan the OpenAI API key field is optional: leave it blank to use included AI usage for knowledge-base processing, or add a key to remove the limit. Self-hosted installs must enter one, or knowledge-base search and KB imports fail after you save. answerLoops tells you if it's missing.
  6. Click Test connection, then Save.

Models

UseChoice
Best answersllama-3.3-70b-versatile
Fastest / cheapestllama-3.1-8b-instant
Alternativesgemma2-9b-it, mixtral-8x7b-32768

On this page