NVIDIA: Llama 3.1 Nemotron 70B Instruct

Public pricingIntelligence 69/100Medium memoryツール利用

NVIDIA: Llama 3.1 Nemotron 70B Instruct は テキスト モデルで、汎用チャット、分析、業務利用 に向いています。安定した汎用性能、131K tokensのコンテキスト、バランス型コストの特性を組み合わせ、general chat, analysis, and production workloads で安定した動作を支えます。品質・速度・コスト が重要な場面に合っており、安定した出力、柔軟な導入、拡張性を求めるチームに実用的です。 安定した応答、長い文脈処理、そして試作から本番まで広く使える柔軟さが必要な場面で役立ちます。 安定した応答、長い文脈処理、そして試作から本番まで広く使える柔軟さが必要な場面で役立ちます。 安定した応答、長い文脈処理、そして試作から本番まで広く使える柔軟さが必要な場面で役立ちます。

Input

$1.20/1M

Output

$1.20/1M

Cached

$0.01/1M

Batch

$0.06/1M

Calculate your Llama 3.1 Nemotron 70B Instruct bill.

Set your workload — see cost at your exact volume.

What would Llama 3.1 Nemotron 70B Instruct cost you?

Adjust the workload to see your monthly bill.

1,00010,00050,000250,0001M10M

Technical specifications

Llama 3.1 Nemotron 70B Instruct at a glance.

Memory

131,072

tokens

Max reply

16,384

tokens

Memory tier

Medium

a long report or a codebase file

Tokenizer

llama3

Released

Oct 2024

Training cutoff

Dec 2023

Availability

Public pricing

Status

active

Benchmarks

Quality benchmarks

Independent evaluations from public leaderboards. Higher is better.

  • mt_bench

    8.98

  • chatbot_arena_elo

    1267

  • ifeval

    73.81

  • bbh

    47.11

  • mmlu_pro

    43.54

What it can do

Capabilities & limits.

  • Understands images
  • Deep step-by-step thinking
  • Uses tools / calls functions
  • Strict JSON output
  • Streams replies
  • Fine-tunable on your data

When to pick Llama 3.1 Nemotron 70B Instruct

  • Agentic workflows that call tools or APIs.

When to look elsewhere

  • Your workload involves images — pick a vision-capable model instead.

Alternatives

Similar models to compare.

FAQ

Llama 3.1 Nemotron 70B Instruct — the questions we see most.

Pricing, capabilities, alternatives — generated from the same data that powers the calculator above.

Get instant answers from our AI agent

At a typical workload of 50,000 conversations a month with 1,500-token prompts and 800-token replies, Llama 3.1 Nemotron 70B Instruct costs roughly $138 per month. Input is $1.20 /1M tokens and output is $1.20 /1M tokens.
Llama 3.1 Nemotron 70B Instruct has a 131,072-token context window (medium memory — a long report or a codebase file). That means you can fit about 24,576 words of input and history in a single call.
Beyond text generation, Llama 3.1 Nemotron 70B Instruct supports calling functions / tools, strict JSON output, fine-tuning on your own data. It streams replies by default.
Llama 3.1 Nemotron 70B Instruct was released in October 2024, with training data cut off around December 2023.
Models in a similar class include Nemotron Nano 12B 2 VL, Llama 3.3 Nemotron Super 49B V1.5, Nemotron 3 Super. The "Similar models" section below this FAQ links into each.

Still unsure?

Compare Llama 3.1 Nemotron 70B Instruct against 100+ other models.

Open the full wizard — pick a use case, set your usage, and see side-by-side monthly costs in under a minute.

Open the comparison wizard