Added Oct 28, 2026
Groq
FreemiumVery fast inference API for open models on custom LPU chips
What is Groq?
Groq runs open models on its own Language Processing Unit chips through GroqCloud, an API known for very high tokens-per-second output. Developers use it for chat, voice and agent apps where latency matters, starting on a free tier with no card.
GroqCloud offers OpenAI-compatible endpoints for models such as gpt-oss, Llama, Qwen and Whisper, plus batch processing at a discount. Speed comes from the LPU architecture, which keeps model weights in on-chip memory.
In December 2025 Nvidia signed a non-exclusive licensing deal for Groq's technology and hired its founders, while GroqCloud kept operating independently. Groq later joined the Nvidia Cloud Partner program.
Features
- LPU-based inference
- OpenAI-compatible API
- Speech-to-text models
- Batch API
- Free developer tier
Tags
Releases
+ Submit new release- Listed
Groq was added to the directory.
Organization
Groq
๐บ๐ธ United States
Listed by kitio.ai ยท unverified owner
Pricing
- Pricing model
- Freemium
- Paid options from
- Not listed
Groq plans
Free
Free
- Rate-limited API access
- For prototyping
Developer
Pay per token
- Higher rate limits
- Pay-as-you-go by model
Enterprise
Contact sales
- Dedicated capacity
- Enterprise support
Prices in USD, checked Oct 28, 2026. Plans change often, so confirm on the Groq site.Official pricing
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.
Top Groq alternatives
View allModels & APIs
Wafer-scale chips serving open models at record inference speeds
Models & APIs
Free playground and API keys for Google's Gemini and Gemma models
Models & APIs
NVIDIA's optimized model containers and hosted API catalog
Models & APIs
Run and deploy open-source AI models through a simple API
If you liked Groq
Fast inference and fine-tuning platform for open models
PaidModels & APIsMade in United StatesFast inference platform for image, video and audio generation models
PaidModels & APIsMade in United StatesFast inference for large open models on SambaNova's RDU chips
FreemiumModels & APIsMade in United StatesLow-cost serverless API for hundreds of open-source models
PaidModels & APIsMade in United StatesAffordable model APIs and GPU cloud for open-source AI
PaidModels & APIsMade in United States
Pros and cons
Pros
- Extremely fast output
- Free tier without a card
- Low prices on small models
Cons
- Smaller model catalog
- Some models moved to enterprise pricing
- Rate limits on the free tier
Prompts & results
No prompts yet. Add your own prompt and output to help others use this tool.
Share a prompt
Reviews
Q&A
What is Groq?
Groq runs open models on its own Language Processing Unit chips through GroqCloud, an API known for very high tokens-per-second output. Developers use it for chat, voice and agent apps where latency matters, starting on a free tier with no card.
How much does Groq cost?
Groq is freemium.
Is there a free version of Groq?
Yes. Groq has a free plan, and paid plans add more usage and features.
What are the main features of Groq?
LPU-based inference, OpenAI-compatible API, Speech-to-text models, Batch API, Free developer tier.
Who makes Groq?
Groq is made by Groq.
What are the best alternatives to Groq?
Popular alternatives include Cerebras, Google AI Studio, NVIDIA NIM.