// head_to_head

Gemini 3.1 Pro Preview vs GPT-5.4 Nano

Published LiveBench scores across all seven categories, live list pricing, context windows, and the measured cost of a point of capability — for both models, side by side.

OpenRouter + LiveBenchAll comparisonsFull leaderboard

Gemini 3.1 Pro Preview scores higher, GPT-5.4 Nano costs less — it depends on your workload.

Gemini 3.1 Pro Preview is ahead by 7.4 points overall, and GPT-5.4 Nano lists 9.7× cheaper per blended million tokens. Whether 7.4 points is worth that depends on how much a wrong answer costs you. GPT-5.4 Nano also leads on measured cost per point of capability, at $0.0500 per point.

google

Gemini 3.1 Pro Preview

Blended / 1M
$4.50
Context
1.0M
Released
Feb 19, 2026
Overall score
77.0
reasoningtool callingaudio inputfile inputimage inputvideo inputprompt caching

openai

GPT-5.4 Nano

Blended / 1M
$0.463
Context
400K
Released
Mar 17, 2026
Overall score
69.6
reasoningtool callingfile inputimage inputprompt caching

Specs and pricing

MetricGemini 3.1 Pro PreviewGPT-5.4 Nano
LiveBench overall

Mean of the seven LiveBench category scores, 0–100. Higher is better.

77.0win69.6
Cost per point

Measured benchmark spend divided by overall score — dollars per point of capability.

$0.1567$0.0500win
Blended price / 1M

3:1 input:output mix, the usual shape of production traffic.

$4.50$0.463win
Input price / 1M$2.00$0.200win
Output price / 1M$12.00$1.25win
Cached input / 1M

Price of an input token served from the prompt cache, where the provider publishes one.

$0.200$0.020win
Context window1.0Mwin400K
Max output tokens66K128Kwin

Benchmarks by category

An overall score averages away the thing you probably care about. These are the seven LiveBench categories scored separately — Gemini 3.1 Pro Preview on top, GPT-5.4 Nano below, both out of 100.

Agentic coding
44.1
46.8
Coding
76.5
70.8
Reasoning
84.0
81.1
Mathematicstoo close to call
91.0
91.0
Data analysis
78.5
67.6
Language
85.4
62.5
Instruction following
79.1
67.2

What each one costs to run

Per-token prices are hard to feel. These are monthly list costs for both models across five workload shapes, using each provider's published cached-input rate where there is one.

WorkloadGemini 3.1 Pro PreviewGPT-5.4 Nano
Support chatbot

1.2K in / 400 out × 200K requests

$1310.40/mo$135.04/mo
RAG assistant

8K in / 600 out × 100K requests

$1600.00/mo$163.00/mo
Coding agent

40K in / 4K out × 20K requests

$1552.00/mo$159.20/mo
Document extraction

20K in / 1.5K out × 50K requests

$2810.00/mo$284.75/mo
Bulk classification

500 in / 20 out × 5M requests

$5300.00/mo$535.00/mo
Run these two through the cost calculator

Which should you pick?

You are running this at volume

GPT-5.4 Nano

Lowest measured cost per point of capability at $0.0500 per point — the gap compounds with every request.

Quality matters more than the bill

Gemini 3.1 Pro Preview

Highest overall LiveBench score of the two at 77.0.

The workload is coding or agentic work

GPT-5.4 Nano

Leads on agentic coding — 46.8 against 44.1.

You need to fit large documents in one call

Gemini 3.1 Pro Preview

Wider context window — 1.0M against 400K.

Gemini 3.1 Pro Preview vs GPT-5.4 Nano FAQ

Which is better, Gemini 3.1 Pro Preview or GPT-5.4 Nano?

Gemini 3.1 Pro Preview scores higher, GPT-5.4 Nano costs less — it depends on your workload. Gemini 3.1 Pro Preview is ahead by 7.4 points overall, and GPT-5.4 Nano lists 9.7× cheaper per blended million tokens. Whether 7.4 points is worth that depends on how much a wrong answer costs you. GPT-5.4 Nano also leads on measured cost per point of capability, at $0.0500 per point.

Is Gemini 3.1 Pro Preview cheaper than GPT-5.4 Nano?

GPT-5.4 Nano is cheaper. On a 3:1 input:output blend, Gemini 3.1 Pro Preview lists at $4.50 per million tokens and GPT-5.4 Nano at $0.463 — GPT-5.4 Nano is 9.7× cheaper. Input and output are priced separately — Gemini 3.1 Pro Preview charges $2.00 in and $12.00 out, GPT-5.4 Nano charges $0.200 and $1.25 — so the model that looks cheaper flips depending on how output-heavy your workload is.

Gemini 3.1 Pro Preview vs GPT-5.4 Nano: which scores higher on benchmarks?

Gemini 3.1 Pro Preview scores 77.0 and GPT-5.4 Nano scores 69.6 overall on LiveBench, the mean of its seven categories. That is a 7.4-point lead for Gemini 3.1 Pro Preview. Category scores differ from the overall figure — a model can lead on reasoning and trail on coding, which the per-category table above breaks out.

Which gives better value for money, Gemini 3.1 Pro Preview or GPT-5.4 Nano?

GPT-5.4 Nano. Cost per point divides the measured dollars LiveBench spent running the benchmark by the score it earned, so it captures something token pricing misses: a reasoning model can emit many times more tokens than its per-token rate suggests. Gemini 3.1 Pro Preview works out at $0.1567 per point and GPT-5.4 Nano at $0.0500.

Does Gemini 3.1 Pro Preview or GPT-5.4 Nano have a bigger context window?

Gemini 3.1 Pro Preview has the larger context window: 1.0M for Gemini 3.1 Pro Preview against 400K for GPT-5.4 Nano. Note that a window you can fill is not a window you should fill — retrieval quality usually degrades well before the limit, and you pay for every token you put in it.

Do Gemini 3.1 Pro Preview and GPT-5.4 Nano support prompt caching?

Both publish a cached-input rate: $0.200 per million for Gemini 3.1 Pro Preview and $0.020 for GPT-5.4 Nano, against full input rates of $2.00 and $0.200. On a workload with a long stable prefix — a system prompt, a tool schema, a retrieved corpus — that changes the economics more than the headline price does.

Related comparisons

How these numbers are produced

  • Price — provider list price from OpenRouter, refreshed every 15 minutes. “Blended” is a 3:1 input:output mix.
  • ScoresLiveBench release 2026-06-25, using their own category map. Each model shows its strongest published run. A blank means “not evaluated”, never “bad”.
  • Cost per point — the measured dollars LiveBench spent on the run, divided by the score it earned.
  • “Win” — awarded only past a threshold: one full point on a benchmark score, 10% on a price, 25% on a context window. Anything tighter reports as a tie, because effort settings alone move a LiveBench score by more than that.

Published benchmarks rank models on someone else's tasks. Before committing, see LLM & agent evaluation for building an eval on your own.