Currently listed through:
Model details
Compound Mini
Compound Mini is a compound AI system designed to deliver faster, more grounded responses than a single language model by orchestrating external tools. As one of two compound systems offered by Groq, it shares the same underlying approach with its sibling but is positioned as the streamlined variant: each request can trigger up to one tool call rather than the deeper multi-step orchestration available in the full Compound system. Both systems draw on the same external tool set, which includes web search for fetching up-to-date information and code execution for running small programs, so the difference is primarily about how much orchestration happens per query.
In practical terms, Compound Mini fits scenarios where speed and a single grounded lookup matter more than multi-stage reasoning, such as answering questions that benefit from a quick web search or verifying a calculation. Groq highlights roughly three times lower average latency than the full Compound system while keeping token throughput in the same range, which makes it well suited to interactive applications and lightweight agents that do not need chains of tool calls. Users should keep in mind that the system is explicitly not offered as a HIPAA Covered Cloud Service for protected health information, so it is better matched to general-purpose assistants and developer tooling than to clinical workflows.
Quick Info
Powered by- Provider
- Groq
- Model key
- groq/compound-mini
- Release date
- Sep 4, 2025
- Last updated
- Sep 4, 2025
- Input modalities
- Output modalities
- Capabilities
Limits
- Output tokens
- 8,192 tokens
- Context window
- 131,072 tokens
Latest news about Compound Mini
No articles yet. Fetch the latest news to show it here.