Pairwise benchmark snapshot · Aug 17, 2026noindex (thin pair)

GPT-4 Turbo vs Mistral: Voxtral Small 24B 2507 benchmark

Name: GPT-4 Turbo vs Mistral: Voxtral Small 24B 2507 AI benchmark comparison
Creator: CompareLLM
License: https://creativecommons.org/licenses/by/4.0/

In this head-to-head showdown, Mistral: Voxtral Small 24B 2507 is more budget-friendly at $0.3/1M per 1M output tokens. Review the complete breakdown below to determine which model best fits your performance and budget requirements.

Share Analysis:Share:

WhatsApp Telegram X LinkedIn

Executive Verdict Summary

Mistral: Voxtral Small 24B 2507 holds empirical advantage (2 of 3 metrics)

Coding / SWESWE-bench

GPT-4 TurboTop code solve rate

ReasoningGPQA / Live

GPT-4 TurboTop logical accuracy

Best Value$/1M Tok

Mistral: Voxtral Small 24B 2507Lowest API billing cost

Speed / TokTok/Sec

GPT-4 TurboFastest stream rate

Verified Advantage Breakdown

3 benchmarks evaluated across capability, speed, and cost

GPT-4 Turbo (1)Mistral: Voxtral Small 24B 2507 (2)

GPT-4 Turbo

1 of 3 Wins

✓Context window

Mistral: Voxtral Small 24B 2507

2 of 3 Wins

✓Input price✓Output price

OpenAI

Leads 1 of 3

GPT-4 Turbo

GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.

Elo 1,255In: $10 · Out: $30/1M

Mistral

Leads 2 of 3

Mistral: Voxtral Small 24B 2507

Auto-discovered from OpenRouter (mistralai/voxtral-small-24b-2507). Preview until a second source matches.

In: $0.1 · Out: $0.3/1M

Top Rival Showdowns for GPT-4 Turbo

All Matchups

Compare vs:vs Claude Opus 4.5 vs Gemini 3 Pro vs Grok 4.6 vs DeepSeek V4 Pro vs Qwen 3 Max

Preference Leader

No shared data

Single model data

Throughput Leader

No shared data

No latency data

Value per Dollar LeaderMistral: Voxtral Small 24B 2507 Wins

Mistral: Voxtral Small 24B 2507

$0.3 / 1M output

Capability Percentiles

Relative percentile scores computed across all active models in the benchmark catalog.

Multi-Dimensional Capability Radar

Leaders Matchup Capability Radar

Comparing top standard models across 6 key capability dimensions. Tap any spoke or dot to inspect.

Tap any node to inspect

0–100 %ile

Overall Matchup Breakdown

Category wins across reasoning intelligence, generation speed, and token cost.

GPT-4 Turbo (7)vsMistral: Voxtral Small 24B 2507 (2)

GPT-4 Turbo: 7W (78%)Mistral: Voxtral Small 24B 2507: 2W (22%)

← GPT-4 TurboMistral: Voxtral Small 24B 2507 →

🏆GPT-4 Turbo Leads(4/5)

Intelligence & Reasoning

Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy

Benchmark

GPT-4 TurbovsMistral: Voxtral Small 24B 2507

Preference Elo

1,255vs—

Coding Elo

—vs—

SWE-bench

33.2%vs—

LiveBench

47%vs—

GPQA Diamond

48%vs—

GPT-4 Turbo: 4WMistral: Voxtral Small 24B 2507: 0W

🏆GPT-4 Turbo Leads(2/2)

Speed & Latency

Generation throughput and time to first token responsiveness

Benchmark

GPT-4 TurbovsMistral: Voxtral Small 24B 2507

Output speed

55 tok/svs—

Time to first token

350 msvs—

GPT-4 Turbo: 2WMistral: Voxtral Small 24B 2507: 0W

🏆Mistral: Voxtral Small 24B 2507 Leads(2/3)

Pricing & Capacity

Cost per million tokens and max context window length

Benchmark

GPT-4 TurbovsMistral: Voxtral Small 24B 2507

Output price

$30/1Mvs$0.3/1M+$29.7/1M

Input price

$10/1Mvs$0.1/1M+$9.9/1M

Context window

128kvs32k+96k

GPT-4 Turbo: 1WMistral: Voxtral Small 24B 2507: 2W

Side-by-Side Benchmark Matrix

GPT-4 TurboMistral: Voxtral Small 24B 2507

Preference Elo

GPT-4 Turbo1,255

Mistral: Voxtral Small 24B 2507—

LiveBench

GPT-4 Turbo47%

Mistral: Voxtral Small 24B 2507—

SWE-bench

GPT-4 Turbo33.2%

Mistral: Voxtral Small 24B 2507—

GPQA Diamond

GPT-4 Turbo48%

Mistral: Voxtral Small 24B 2507—

Time to first token

GPT-4 Turbo350 ms

Mistral: Voxtral Small 24B 2507—

Output speed

GPT-4 Turbo55 tok/s

Mistral: Voxtral Small 24B 2507—

Input priceMistral: Voxtral Small 24B 2507 +$9.9/1M

GPT-4 Turbo$10/1M

Mistral: Voxtral Small 24B 2507$0.1/1M

Output priceMistral: Voxtral Small 24B 2507 +$29.7/1M

GPT-4 Turbo$30/1M

Mistral: Voxtral Small 24B 2507$0.3/1M

Context windowGPT-4 Turbo +96k

GPT-4 Turbo128k

Mistral: Voxtral Small 24B 250732k

Benchmark	GPT-4 Turbo	Mistral: Voxtral Small 24B 2507	Advantage Delta
Preference Elo	1,255 lmarena · Aug 17, 2026	—	—
LiveBench	47% livebench · Aug 17, 2026	—	—
SWE-bench	33.2% swebench · Aug 17, 2026	—	—
GPQA Diamond	48% seed-bootstrap · Aug 1, 2026	—	—
Time to first token	350 ms seed-bootstrap · Aug 1, 2026	—	—
Output speed	55 tok/s seed-bootstrap · Aug 1, 2026	—	—
Input price	$10/1M openrouter · Aug 17, 2026	$0.1/1M openrouter · Aug 17, 2026	+$9.9/1M
Output price	$30/1M openrouter · Aug 17, 2026	$0.3/1M openrouter · Aug 17, 2026	+$29.7/1M
Context window	128k openrouter · Aug 17, 2026	32k openrouter · Aug 17, 2026	+96k

Workload Cost & Savings Calculator

Simulate monthly production API costs in USD (US Dollar).

Save 99% with Mistral: Voxtral Small 24B 2507

Monthly Volume50M tokens/mo

Quick Presets:

Token Ratio (In vs Out)70% In / 30% Out

RAG / Search (10% out)Coding / Chat (50% out)

GPT-4 Turbo$800.00 / mo

In: $350Out: $450

Mistral: Voxtral Small 24B 2507$8.00 / mo

In: $3.5Out: $4.5

Estimated Cost Delta

Mistral: Voxtral Small 24B 2507 is estimated to save $792.00/month ($9,504/year).

Based on 50M tokens (30% gen)

Key Selection Recommendations

1
Mistral: Voxtral Small 24B 2507:Pick Mistral: Voxtral Small 24B 2507 when you are optimizing output cost.

Recommended Workload Routing

Repo / coding agentsinsufficient data

Need SWE-bench on both sides.

High-volume chatMistral: Voxtral Small 24B 2507

Lower output list price ($0.3/1M).

Voice / low-latency UIinsufficient data

Need TTFT on both sides.

Long-document RAGGPT-4 Turbo

Larger window (128k).

Screenshots / visionGPT-4 Turbo

GPT-4 Turbo is the side marked multimodal in the catalog.

Target Workload	Recommended Pick	Evaluation Rationale
Repo / coding agents	insufficient data	Need SWE-bench on both sides.
High-volume chat	Mistral: Voxtral Small 24B 2507	Lower output list price ($0.3/1M).
Voice / low-latency UI	insufficient data	Need TTFT on both sides.
Long-document RAG	GPT-4 Turbo	Larger window (128k).
Screenshots / vision	GPT-4 Turbo	GPT-4 Turbo is the side marked multimodal in the catalog.

Cast Your Matchup Vote

0 total votes

Community Discussions (0)

No comments posted on this matchup yet. Be the first to share an evaluation note!

Social Share Card Preview

Dynamic OpenGraph banner generated at /compare/gpt-4-turbo-vs-voxtral-small-24b-2507/opengraph-image

Save PNG

CompareLLM AI Matrix

Verified Head-to-Head Telemetry

LIVE BENCHMARK

OpenAI

GPT-4 Turbo

Elo 1,255

SWE-bench33.2%

Speed (tok/s)55 tok/s

Input / 1M Tokens$10/1M

Output / 1M Tokens$30/1M

Mistral

Mistral: Voxtral Small 24B 2507

Elo n/a

SWE-bench—

Speed (tok/s)32k

Input / 1M Tokens$0.1/1M

Output / 1M Tokens$0.3/1M

Frequently Asked Questions

Which is better overall, GPT-4 Turbo or Mistral: Voxtral Small 24B 2507?: We do not have preference Elo for both models, so we do not declare an overall winner. Compare the metrics that exist.
Which is better at coding, GPT-4 Turbo or Mistral: Voxtral Small 24B 2507?: SWE-bench is missing for at least one model, so we do not rank coding from a single number.
Which is cheaper to run in production?: Mistral: Voxtral Small 24B 2507 output tokens are $0.3/1M versus $30/1M. Input prices and retry rates still move the real bill.
Which is faster, GPT-4 Turbo or Mistral: Voxtral Small 24B 2507?: We do not have TTFT for both models.
Which has the larger context window?: GPT-4 Turbo accepts 128k tokens versus 32k.
Can I self-host either model?: Neither model is marked open-weights here. You are comparing hosted APIs.
Are these scores from CompareLLM’s own evals?: No. V1 aggregates public leaderboards (and optional first-party latency pings). Each cell names its source and date. Read /methodology.
What does preference Elo mean on this page?: Preference Elo is a crowd vote from LMArena / Arena. People see two hidden answers and pick the one they like more. The model that wins more often gets a higher Elo. That means people preferred it — not that it passed a school test. It is not SWE-bench, not accuracy, and not a number we invent. GPT-4 Turbo and Mistral: Voxtral Small 24B 2507 Elo cells are dated snapshots from the named source — we do not compute Arena ourselves.

Similar Head-to-Head Comparisons

All GPT-4 Turbo matchups →|All Mistral: Voxtral Small 24B 2507 matchups →

GPT-4 Turbo vs GPT-4o (next gpt-flagship)GPT-5 vs GPT-4 Turbo GPT-4.5 Orion vs GPT-4 Turbo Mistral Large 3 vs GPT-4 Turbo GPT-5.6 Sol vs GPT-4 Turbo GPT-5.6 Terra vs GPT-4 Turbo

Capability Percentiles

Relative percentile scores computed across all active models in the benchmark catalog.

Multi-Dimensional Capability Radar

Leaders Matchup Capability Radar

Comparing top standard models across 6 key capability dimensions. Tap any spoke or dot to inspect.

Tap any node to inspect

0–100 %ile

Side-by-Side Benchmark Matrix

GPT-4 TurboMistral: Voxtral Small 24B 2507

Preference Elo

GPT-4 Turbo1,255

Mistral: Voxtral Small 24B 2507—

LiveBench

GPT-4 Turbo47%

Mistral: Voxtral Small 24B 2507—

SWE-bench

GPT-4 Turbo33.2%

Mistral: Voxtral Small 24B 2507—

GPQA Diamond

GPT-4 Turbo48%

Mistral: Voxtral Small 24B 2507—

Time to first token

GPT-4 Turbo350 ms

Mistral: Voxtral Small 24B 2507—

Output speed

GPT-4 Turbo55 tok/s

Mistral: Voxtral Small 24B 2507—

Input priceMistral: Voxtral Small 24B 2507 +$9.9/1M

GPT-4 Turbo$10/1M

Mistral: Voxtral Small 24B 2507$0.1/1M

Output priceMistral: Voxtral Small 24B 2507 +$29.7/1M

GPT-4 Turbo$30/1M

Mistral: Voxtral Small 24B 2507$0.3/1M

Context windowGPT-4 Turbo +96k

GPT-4 Turbo128k

Mistral: Voxtral Small 24B 250732k

Benchmark

GPT-4 Turbo

Mistral: Voxtral Small 24B 2507

Advantage Delta

Preference Elo

1,255

lmarena · Aug 17, 2026

—

LiveBench

47%

livebench · Aug 17, 2026

—

SWE-bench

33.2%

swebench · Aug 17, 2026

—

GPQA Diamond

48%

seed-bootstrap · Aug 1, 2026

—

Time to first token

350 ms

seed-bootstrap · Aug 1, 2026

—

Output speed

55 tok/s

seed-bootstrap · Aug 1, 2026

—

Input price

$10/1M

openrouter · Aug 17, 2026

$0.1/1M

openrouter · Aug 17, 2026

+$9.9/1M

Output price

$30/1M

openrouter · Aug 17, 2026

$0.3/1M

openrouter · Aug 17, 2026

+$29.7/1M

Context window

128k

openrouter · Aug 17, 2026

32k

openrouter · Aug 17, 2026

+96k

Recommended Workload Routing

Repo / coding agentsinsufficient data

Need SWE-bench on both sides.

High-volume chatMistral: Voxtral Small 24B 2507

Lower output list price ($0.3/1M).

Voice / low-latency UIinsufficient data

Need TTFT on both sides.

Long-document RAGGPT-4 Turbo

Larger window (128k).

Screenshots / visionGPT-4 Turbo

GPT-4 Turbo is the side marked multimodal in the catalog.

Target Workload	Recommended Pick	Evaluation Rationale
Repo / coding agents	insufficient data	Need SWE-bench on both sides.
High-volume chat	Mistral: Voxtral Small 24B 2507	Lower output list price ($0.3/1M).
Voice / low-latency UI	insufficient data	Need TTFT on both sides.
Long-document RAG	GPT-4 Turbo	Larger window (128k).
Screenshots / vision	GPT-4 Turbo	GPT-4 Turbo is the side marked multimodal in the catalog.

Frequently Asked Questions

Which is better overall, GPT-4 Turbo or Mistral: Voxtral Small 24B 2507?

We do not have preference Elo for both models, so we do not declare an overall winner. Compare the metrics that exist.

Which is better at coding, GPT-4 Turbo or Mistral: Voxtral Small 24B 2507?

SWE-bench is missing for at least one model, so we do not rank coding from a single number.

Which is cheaper to run in production?

Mistral: Voxtral Small 24B 2507 output tokens are $0.3/1M versus $30/1M. Input prices and retry rates still move the real bill.

Which is faster, GPT-4 Turbo or Mistral: Voxtral Small 24B 2507?

We do not have TTFT for both models.

Which has the larger context window?

GPT-4 Turbo accepts 128k tokens versus 32k.

Can I self-host either model?

Neither model is marked open-weights here. You are comparing hosted APIs.

Are these scores from CompareLLM’s own evals?

No. V1 aggregates public leaderboards (and optional first-party latency pings). Each cell names its source and date. Read /methodology.

What does preference Elo mean on this page?

Preference Elo is a crowd vote from LMArena / Arena. People see two hidden answers and pick the one they like more. The model that wins more often gets a higher Elo. That means people preferred it — not that it passed a school test. It is not SWE-bench, not accuracy, and not a number we invent. GPT-4 Turbo and Mistral: Voxtral Small 24B 2507 Elo cells are dated snapshots from the named source — we do not compute Arena ourselves.