P
Phi-3 Medium
36
Stack Score
Best for
Best for engineers wanting a tiny model that punches above its weight class.
At a glance
- Pricing
- open-source
- Setup time
- 30 minutes
- Learning curve
- easy
- Last verified
- 5/25/2026
What we love
- ✓Best quality-per-parameter on the market
- ✓Runs on consumer GPUs
- ✓Permissive license
Where it falls short
- −Smaller raw capacity than 70B+ models
- −Limited multilingual
- −Best for short-context use
Pricing
2 tiers
Open-source
$0
perpetual
- ✓MIT license
Azure AI
Usage
per token
- ✓Hosted
Overview
Phi-3 Medium is Microsoft's open-weights 14B-parameter LLM tuned to punch far above its weight class. Designed for on-device + edge deployment with surprising reasoning quality.
Key features
- ●14B params, 128K context
- ●Optimized for edge/on-device
- ●MIT license
- ●Azure-hosted option
- ●Strong reasoning per param
Best use cases
On-device assistant
Run Phi-3 on a laptop or phone for offline AI assistance.
Cost-controlled inference
Replace 70B model calls with Phi-3 for tasks where its quality is enough.
Integrations
Similar tools
See all LLMs →One AI Stack pick every week.
The tool we’d pay for this week, why we’d pay for it, and what we’d skip. No promo spam.