Currently listed through these providers:
Model details
Llama 3.1 Nemotron 70B Instruct (Deep Infra)
Llama 3.1 Nemotron 70B Instruct is presented as a text-focused generation and chat model offered through DeepInfra, with NVIDIA indicated as the underlying model creator in the serving listing. The directory entry frames it as a general-purpose conversational model rather than a narrowly specialized tool, and pairs it with features such as streaming and function calling that are useful for interactive assistants, agent-style workflows, and code or tool-augmented tasks that need to hand off results to external services. JSON mode and reasoning flags are also surfaced alongside it, suggesting the deployment is intended for structured-output pipelines and step-by-step problem solving in addition to open-ended dialogue.
On the practical side, the DeepInfra listing shows an 8K max output ceiling for responses, which makes it well suited to medium-length completions such as detailed answers, summaries, and multi-turn conversations rather than very long-form generation. Input and output are both restricted to text, so the model is a fit for language-only use cases and not for direct image or audio understanding. The entry advertises per-million-token pricing of $1.20 for both input and output, providing a flat cost profile that is straightforward to budget for steady inference workloads routed through DeepInfra.
Quick Info
Powered by- Provider
- Eden AI
- Model key
- deepinfra/nvidia/Llama-3.1-Nemotron-70B-Instruct
- Release date
- Apr 15, 2025
- Last updated
- Apr 15, 2025
- Input modalities
- Output modalities
- Capabilities
Cost
- Input token cost
- $0.60
- Output token cost
- $0.60
Limits
- Output tokens
- 8,192 tokens
- Context window
- 131,072 tokens
Latest news about Llama 3.1 Nemotron 70B Instruct (Deep Infra)
We haven't found any news about Llama 3.1 Nemotron 70B Instruct (Deep Infra) yet. New models can take a few days to get coverage, so check back soon or look again now.
