Nvidia Models

16 modelsGeneral models free to startUp to 1.05M context

Usage

Last 28 days · 2026-07-13 to 2026-08-11

Tokens

207M

Requests

10.2K

Models in use

15 of 16

Tokens per day

023.6M47.3M07-1307-2207-2908-052026-07-13 — 47,268,345 tokens2026-07-14 — 61,385 tokens2026-07-15 — 3,145 tokens2026-07-16 — 0 tokens2026-07-17 — 0 tokens2026-07-19 — 267,210 tokens2026-07-21 — 110,935 tokens2026-07-22 — 2,487,620 tokens2026-07-23 — 2,362,980 tokens2026-07-24 — 307,965 tokens2026-07-25 — 3,107,350 tokens2026-07-26 — 71,040 tokens2026-07-27 — 2,081,385 tokens2026-07-28 — 14,670,435 tokens2026-07-29 — 2,706,910 tokens2026-07-30 — 7,445,900 tokens2026-07-31 — 583,715 tokens2026-08-01 — 14,005,950 tokens2026-08-02 — 10,010,130 tokens2026-08-03 — 21,756,130 tokens2026-08-04 — 9,633,660 tokens2026-08-05 — 7,636,555 tokens2026-08-06 — 4,000,035 tokens2026-08-07 — 8,665,700 tokens2026-08-08 — 8,759,405 tokens2026-08-09 — 14,730,095 tokens2026-08-10 — 13,128,625 tokens2026-08-11 — 11,363,790 tokens

The two views disagree on purpose: a model can take a large share of the calls and a small share of the tokens — many short requests — or the reverse. Which one matters depends on whether your cost is driven by call volume or by prompt length. Measured on AIHubMix over the last 28 days, counting the 16 model IDs listed on this page; traffic routed through upstream-specific IDs that are not in the public catalog is not included.

All 16 Nvidia Models

Open in model list
Nvidia models on AIHubMix with input and output modalities, context length, maximum output, price per million tokens including cache read and cache write rates, and measured throughput and latency.
Modalities
nemotron-3-super-120b-a12b-freeTakes text, returns text.1.05MFreeFree/M
nemotron-3-ultra-550b-a55b-freeTakes text, returns text.1MFreeFree/M
nemotron-3.5-lightning-freeTakes text, returns text.1MFreeFree/M
nvidia-nemotron-3-super-120b-a12bTakes text, returns text.1M$0.11$0.55/M$0.03/M
nemotron-3-nano-30b-a3b-freeTakes text, returns text.256KFreeFree/M
nemotron-3-nano-omni-30b-a3b-reasoning-freeTakes text, vision, returns text.256KFreeFree/M
nemotron-nano-12b-v2-vl-freeTakes text, vision, returns text.131KFreeFree/M
nemotron-nano-9b-v2-freeTakes text, returns text.131KFreeFree/M
nemotron-3.5-content-safety-freeTakes text, vision, returns text.128KFreeFree/M
nvidia-nemotron-nano-9b-v2$0.04$0.18/M88 tok/s4.97 s
deepinfra-nvidia-nemotron-3-nano-30b-a3b2$0.07$0.26/M
nvidia-nemotron-3-nano-30b-a3b$0.07$0.26/M85 tok/s5.83 s
nvidia-llama-3.3-nemotron-super-49b-v1.5$0.11$0.44/M35 tok/s0.90 s
nvidia-nemotron-nano-12b-v2-vl$0.22$0.66/M37 tok/s0.84 s
nvidia/Llama-3_1-Nemotron-Ultra-253B-v1$0.50$0.50/M
nvidia-llama-3.1-nemotron-70b-instruct$1.32$1.32/M14 tok/s1.08 s

Prices are USD per million tokens; cache read and cache write are the rates for prompt-cache hits and for writing a prompt into the cache. Throughput and latency are measured on AIHubMix — the same figures the model detail page shows — not vendor claims. A dash means the catalog does not publish that field for that model, which is not the same as the model not supporting it.

Nvidia on AIHubMix

Which Nvidia model should I start with?

nemotron-3-nano-30b-a3b-free is free on input — the cheapest entry here that declares tool calling, and it carries a 256K context. Move up to nvidia-llama-3.1-nemotron-70b-instruct when answer quality matters more than cost, or to nemotron-3-super-120b-a12b-free for long-form reasoning.

Which of these models reason before answering?

9 of the 16 models here declare a reasoning phase — they work through the problem before producing an answer, which helps on multi-step problems at the cost of extra output tokens. Use the Reasoning filter above the table to see them. The catalog does not record anything further about how they differ, so this page does not sort them into families.

Why are there several entries for the same model?

Because each row is a route you can call, not a model release. Some IDs name an upstream (azure-, alicloud-, cc-), some are the open-weight repository form (nvidia/…), and some differ only in capitalisation, kept so older integrations keep working.

The catalog does not carry a field saying which of those a given row is, so this page does not sort them into buckets it would have to invent. Every row shows that route’s own price, context and speed — compare those directly, and open a model to see the upstreams that serve it.

How is cached input billed?

The Cache read column is the rate for input tokens served from the prompt cache — for example nvidia-nemotron-3-super-120b-a12b bills cache hits at 25% of the input rate. Cache write is the surcharge for putting a prompt into the cache in the first place, and only a few upstreams bill it separately. A dash in either column means the catalog carries no cache rate for that model, so plan on paying the full input rate.

Do I need a separate Nvidia account?

No. One AIHubMix key covers every model on this page, and switching between them is a change to the model string — billing, rate limits, and logs stay in one place.

Start calling Nvidia in one line

One key, one endpoint, 844 models across 35 providers.