MoreAI.tools
G
Groq MCP
33
Stack Score
Editorial pick✓ Verified workingMCP server
Groq MCP logo

Groq MCP

Ultra-fast OSS-model inference via Groq.

Try Groq MCP

Best for

Best for latency-critical AI apps using OSS models.

At a glance

Pricing
open-source
Setup time
10 minutes
Learning curve
easy
Last verified
5/25/2026

What we love

  • ✓Groq-maintained
  • ✓Fastest inference for OSS models
  • ✓Generous free tier

Where it falls short

  • −Free tier rate limits
  • −Only hosted OSS models
  • −Cost climbs on paid tier

Pricing

✓ Pricing verified Jun 14, 2026

1 tier

Open-source

$0

perpetual

  • ✓MIT

Overview

MCP server for Groq — run Llama, Mixtral, and other OSS models on Groq's LPU hardware with sub-100ms latency. Groq API key.

Key features

  • ●Sub-100ms inference
  • ●OSS model catalog
  • ●Token streaming
  • ●Function calling
  • ●API key

Best use cases

Latency-critical OSS

Run OSS models at frontier-class latency for real-time UX.

Cheap fast inference

Use Groq when low cost + low latency outweighs model quality.

Integrations

Groq
Llama
Mixtral
Gemma

Similar tools

See all LLMs →

One AI Stack pick every week.

The tool we’d pay for this week, why we’d pay for it, and what we’d skip. No promo spam.