MoreAI.tools
G
Groq MCP
38
Stack Score
Editorial pick✓ Verified workingMCP server
Groq MCP logo

Groq MCP

Ultra-fast OSS-model inference via Groq.

Try Groq MCP

Best for

Best for latency-critical AI apps using OSS models.

At a glance

Pricing
open-source
Setup time
10 minutes
Learning curve
easy
Last verified
5/25/2026

What we love

  • Groq-maintained
  • Fastest inference for OSS models
  • Generous free tier

Where it falls short

  • Free tier rate limits
  • Only hosted OSS models
  • Cost climbs on paid tier

Pricing

✓ Pricing verified Jun 14, 2026

1 tier

Open-source

$0

perpetual

  • MIT

Overview

MCP server for Groq — run Llama, Mixtral, and other OSS models on Groq's LPU hardware with sub-100ms latency. Groq API key.

Key features

  • Sub-100ms inference
  • OSS model catalog
  • Token streaming
  • Function calling
  • API key

Best use cases

Latency-critical OSS

Run OSS models at frontier-class latency for real-time UX.

Cheap fast inference

Use Groq when low cost + low latency outweighs model quality.

Integrations

Groq
Llama
Mixtral
Gemma

Similar tools

See all LLMs

One AI Stack pick every week.

The tool we’d pay for this week, why we’d pay for it, and what we’d skip. No promo spam.