Groq

Groq delivers high-speed processing and low-latency performance.

Endpoint

https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/groq

URL structure

When making requests to Groq, replace https://api.groq.com/openai/v1 in the URL you’re currently using with https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/groq.

Examples

Example fetch request

curl https://gateway.ai.cloudflare.com/v1/{account_id}/{gateway_id}/groq/chat/completions \
  --header 'Authorization: Bearer {groq_api_key}' \
  --header 'Content-Type: application/json' \
  --data '{
    "messages": [
      {
        "role": "user",
        "content": "What is Cloudflare?"
      }
    ],
    "model": "mixtral-8x7b-32768"
}'

If using the groq-sdk, set your endpoint like this:

JavaScript

import Groq from 'groq-sdk';

const apiKey = env.GROQ_API_KEY;
const accountId = '{account_id}';
const gatewayId = '{gateway_id}';
const baseURL = `https://gateway.ai.cloudflare.com/v1/${accountId}/${gatewayId}/groq`;

const groq = new Groq({
  apiKey,
  baseURL,
});

const messages = [{ role: 'user', content: 'What is Cloudflare?' }];
const model = 'mixtral-8x7b-32768';

const chatCompletion = await groq.chat.completions.create({
  messages,
  model,
});