// head_to_head

GPT-5.4 vs Qwen3.8 27B

Published LiveBench scores across all seven categories, live list pricing, context windows, and the measured cost of a point of capability — for both models, side by side.

OpenRouter + LiveBenchAll comparisonsFull leaderboard

GPT-5.4 scores higher, Qwen3.8 27B costs less — it depends on your workload.

GPT-5.4 is ahead by 2.7 points overall, and Qwen3.8 27B lists 4.9× cheaper per blended million tokens. Whether 2.7 points is worth that depends on how much a wrong answer costs you. Qwen3.8 27B also leads on measured cost per point of capability, at $0.0556 per point.

openai

GPT-5.4

Blended / 1M
$5.63
Context
1.1M
Released
Mar 5, 2026
Overall score
78.0
reasoningtool callingimage inputfile inputprompt caching

qwen

Qwen3.8 27B

Blended / 1M
$1.14
Context
1M
Released
Aug 14, 2026
Overall score
75.3
reasoningtool callingimage inputvideo inputprompt caching

Specs and pricing

MetricGPT-5.4Qwen3.8 27B
LiveBench overall

Mean of the seven LiveBench category scores, 0–100. Higher is better.

78.0win75.3
Cost per point

Measured benchmark spend divided by overall score — dollars per point of capability.

$0.2198$0.0556win
Blended price / 1M

3:1 input:output mix, the usual shape of production traffic.

$5.63$1.14win
Input price / 1M$2.50$0.450win
Output price / 1M$15.00$3.20win
Cached input / 1M

Price of an input token served from the prompt cache, where the provider publishes one.

$0.250$0.050win
Context window1.1M1M
Max output tokens128K131K

Benchmarks by category

An overall score averages away the thing you probably care about. These are the seven LiveBench categories scored separately — GPT-5.4 on top, Qwen3.8 27B below, both out of 100.

Agentic coding
53.8
61.4
Coding
77.5
75.7
Reasoning
88.1
80.0
Mathematics
94.1
86.2
Data analysis
79.3
76.6
Language
82.6
74.3
Instruction following
70.2
72.7

What each one costs to run

Per-token prices are hard to feel. These are monthly list costs for both models across five workload shapes, using each provider's published cached-input rate where there is one.

WorkloadGPT-5.4Qwen3.8 27B
Support chatbot

1.2K in / 400 out × 200K requests

$1638.00/mo$335.20/mo
RAG assistant

8K in / 600 out × 100K requests

$2000.00/mo$392.00/mo
Coding agent

40K in / 4K out × 20K requests

$1940.00/mo$392.00/mo
Document extraction

20K in / 1.5K out × 50K requests

$3512.50/mo$670.00/mo
Bulk classification

500 in / 20 out × 5M requests

$6625.00/mo$1245.00/mo
Run these two through the cost calculator

Which should you pick?

You are running this at volume

Qwen3.8 27B

Lowest measured cost per point of capability at $0.0556 per point — the gap compounds with every request.

Quality matters more than the bill

GPT-5.4

Highest overall LiveBench score of the two at 78.0.

The workload is coding or agentic work

Qwen3.8 27B

Leads on agentic coding — 61.4 against 53.8.

GPT-5.4 vs Qwen3.8 27B FAQ

Which is better, GPT-5.4 or Qwen3.8 27B?

GPT-5.4 scores higher, Qwen3.8 27B costs less — it depends on your workload. GPT-5.4 is ahead by 2.7 points overall, and Qwen3.8 27B lists 4.9× cheaper per blended million tokens. Whether 2.7 points is worth that depends on how much a wrong answer costs you. Qwen3.8 27B also leads on measured cost per point of capability, at $0.0556 per point.

Is GPT-5.4 cheaper than Qwen3.8 27B?

Qwen3.8 27B is cheaper. On a 3:1 input:output blend, GPT-5.4 lists at $5.63 per million tokens and Qwen3.8 27B at $1.14 — Qwen3.8 27B is 4.9× cheaper. Input and output are priced separately — GPT-5.4 charges $2.50 in and $15.00 out, Qwen3.8 27B charges $0.450 and $3.20 — so the model that looks cheaper flips depending on how output-heavy your workload is.

GPT-5.4 vs Qwen3.8 27B: which scores higher on benchmarks?

GPT-5.4 scores 78.0 and Qwen3.8 27B scores 75.3 overall on LiveBench, the mean of its seven categories. That is a 2.7-point lead for GPT-5.4. Category scores differ from the overall figure — a model can lead on reasoning and trail on coding, which the per-category table above breaks out.

Which gives better value for money, GPT-5.4 or Qwen3.8 27B?

Qwen3.8 27B. Cost per point divides the measured dollars LiveBench spent running the benchmark by the score it earned, so it captures something token pricing misses: a reasoning model can emit many times more tokens than its per-token rate suggests. GPT-5.4 works out at $0.2198 per point and Qwen3.8 27B at $0.0556.

Does GPT-5.4 or Qwen3.8 27B have a bigger context window?

They are effectively the same — 1.1M for GPT-5.4 and 1M for Qwen3.8 27B.

Do GPT-5.4 and Qwen3.8 27B support prompt caching?

Both publish a cached-input rate: $0.250 per million for GPT-5.4 and $0.050 for Qwen3.8 27B, against full input rates of $2.50 and $0.450. On a workload with a long stable prefix — a system prompt, a tool schema, a retrieved corpus — that changes the economics more than the headline price does.

Related comparisons

How these numbers are produced

  • Price — provider list price from OpenRouter, refreshed every 15 minutes. “Blended” is a 3:1 input:output mix.
  • ScoresLiveBench release 2026-06-25, using their own category map. Each model shows its strongest published run. A blank means “not evaluated”, never “bad”.
  • Cost per point — the measured dollars LiveBench spent on the run, divided by the score it earned.
  • “Win” — awarded only past a threshold: one full point on a benchmark score, 10% on a price, 25% on a context window. Anything tighter reports as a tie, because effort settings alone move a LiveBench score by more than that.

Published benchmarks rank models on someone else's tasks. Before committing, see LLM & agent evaluation for building an eval on your own.