Model details
Gemma 3 4B (Pretrained)
Gemma 3 4B (Pretrained) is positioned as a lightweight, pretrained text-only foundation model intended to serve as a starting point for downstream specialization rather than as a ready-to-use assistant. Its role as a base layer for further fine-tuning is reflected in third-party usage, where it underpins a 4-billion-parameter language model adapted to Macedonian through continued training on a high-quality domain corpus. This downstream application illustrates the model's practical appeal: small enough to train on a single high-end GPU while still providing a coherent backbone for language-specific extensions.
Because Gemma 3 4B is a pretrained base rather than an instruction-tuned or chat-aligned release, it is best suited to developers and researchers who want to control alignment, safety tuning, and behavior through their own post-training pipelines. Its compact parameter scale and text-only design make it a practical choice for teams targeting modest hardware budgets or specialized domains where a general-purpose pretrained starting point is preferable to a finished conversational system.
Quick Info
Powered by- Provider
- Pioneer
- Model key
- google/gemma-3-4b-pt
- Release date
- Feb 28, 2025
- Last updated
- Feb 28, 2025
- Input modalities
- Output modalities
- Capabilities
Cost
- Input token cost
- $0.15
- Output token cost
- $0.15
Limits
- Output tokens
- 32,768 tokens
- Context window
- 32,768 tokens
Latest news about Gemma 3 4B (Pretrained)
No articles yet. Fetch the latest news to show it here.