CompareLLM.ai
Live
Leaderboard
Models
Compare
Best of & Stacks
Research & News
…
CompareLLM.ai
Precision Benchmarks

Programmatic, dated AI model benchmarks, head-to-head comparisons, and Stack Engine presets.

Daily ingest · 06:00 UTC

Analytics & Benchmarks

  • AI Model Leaderboard
  • Head-to-Head Compare Hub
  • Models Directory
  • Stack Engine Presets
  • Frontier Models
  • Open Weights Catalog

Guides & Intent Lists

  • Best LLM Lists (2026)
  • Best Coding LLM
  • Best Cheap LLM
  • Fastest Low-Latency LLM
  • Claude vs GPT Benchmark
  • What is Elo?
  • Methodology Guides
  • News & Dispatches

Transparency & API

  • Evaluation Methodology
  • Benchmark Changelog
  • Public JSON API
  • llms.txt Specification
  • Privacy Policy
  • Sign In / Account

© 2026 CompareLLM. Public benchmark data aggregated from Arena Elo, LiveBench, SWE-bench & OpenRouter.

Every score has a dated snapshot.

Theme:
Currency:
  1. Home
  2. Models
  3. GPT-4o
  4. vs all
Comparison Matrix Hub
99 pairwise matchups

GPT-4o vs All Models

Detailed head-to-head fact sheets comparing GPT-4o (OpenAI) against every indexable model in the benchmark catalog.

Elo Rating1,335
SWE-bench54.8%
Out $/1M$10
Context Window128k
Showing 99 of 99 comparisons
GPT-4ovsClaude Opus 5Anthropic
Compare

Anthropic current default flagship. Official API $5/$25 per 1M tokens and a 1M context window (Anthropic, Jul 24 2026).

Elo:Claude Opus 5+289SWE:Claude Opus 5+24.4%
GPT-4ovsClaude Fable 5Anthropic
Compare

Anthropic top-tier X-High reasoning model engineered for heavy multi-step tasks. Official API $10/$50 per 1M tokens (Claude Platform pricing, Aug 2026).

Elo:Claude Fable 5+281SWE:Claude Fable 5+25.2%
GPT-4ovsGPT-5.6 SolOpenAI
Compare

OpenAI 5.6 flagship tier. Official API $5/$30 per 1M tokens (OpenAI pricing, Jul 30 2026 update left Sol unchanged).

Elo:GPT-5.6 Sol+273SWE:GPT-5.6 Sol+22.8%
GPT-4ovsClaude Opus 4.8Anthropic
Compare

Prior Opus generation still billed at $5/$25. Kept as a compare baseline against Opus 5.

Elo:Claude Opus 4.8+263SWE:Claude Opus 4.8+23.6%
GPT-4ovsGrok 4.6xAI
Compare

xAI Aug 12 2026 post-training refresh of Grok 4.5. Same $2/$6 API price, 500k context, stronger agentic traces.

Elo:Grok 4.6+257SWE:Grok 4.6+14.3%
GPT-4ovsClaude Opus 4.6Anthropic
Compare

Follow-on Opus release. Slightly behind 4.5 on official SWE-bench bash-only in the last published sweep; stronger multi-step autonomous agent reasoning.

Elo:Claude Opus 4.6+239SWE:Claude Opus 4.6+21.1%
GPT-4ovsGemini 3.6 ProGoogle
Compare

Current Google Pro-class multimodal model. Long context, strong coding, billed like the 3.x Pro tier.

Elo:Gemini 3.6 Pro+235SWE:Gemini 3.6 Pro+19.8%
GPT-4ovsClaude Opus 4.5Anthropic
Compare

Anthropic frontier coding and computer-use model. SWE-bench leader on the official mini-SWE-agent harness in the Feb 2026 refresh.

Elo:Claude Opus 4.5+233SWE:Claude Opus 4.5+22%
GPT-4ovsOpenAI o3-miniOpenAI
Compare

OpenAI cost-efficient reasoning model with adjustable thinking effort and top coding benchmark scores.

Elo:OpenAI o3-mini+225SWE:OpenAI o3-mini+23.7%
GPT-4ovsGPT-5OpenAI
Compare

OpenAI flagship reasoning model for 2025–26. Strong general preference Elo and multimodal coverage.

Elo:GPT-5+223SWE:GPT-5+13.6%
GPT-4ovsGLM-5.3Zhipu
Compare

Z.ai Aug 14 2026 post-train of the GLM-5.2 744B base. Coding-plan live; open weights promised after a two-week safety review (z.ai/blog/glm-5.3).

Elo:GLM-5.3+223SWE:GLM-5.3+21.6%
GPT-4ovsClaude Sonnet 5Anthropic
Compare

Anthropic workhorse. Official $2/$10 per 1M tokens made permanent on Aug 10 2026.

Elo:Claude Sonnet 5+221SWE:Claude Sonnet 5+19%
GPT-4ovsGemini 3 ProGoogle
Compare

Google frontier multimodal model with a multi-million-token context window.

Elo:Gemini 3 Pro+217SWE:Gemini 3 Pro+17.6%
GPT-4ovsGPT-5.6 TerraOpenAI
Compare

OpenAI 5.6 mid tier. Official API $2/$12 per 1M after the Jul 30 2026 price cut.

Elo:GPT-5.6 Terra+213SWE:GPT-5.6 Terra+15.6%
GPT-4ovsGPT-4.5 OrionOpenAI
Compare

OpenAI largest dense non-reasoning model with expansive world knowledge and reduced hallucinations.

Elo:GPT-4.5 Orion+205SWE:GPT-4.5 Orion+16.2%
GPT-4ovsDeepSeek V4 ProDeepSeek
Compare

Open-weight-adjacent DeepSeek flagship. High reasoning density per dollar.

Elo:DeepSeek V4 Pro+201SWE:DeepSeek V4 Pro+16.8%
GPT-4ovsGemini 3.7 FlashGoogle
Compare

Google Aug 13 2026 workhorse. Official intro price $0.75/$3.75 per 1M through Dec 31 2026; 1,048,576-token context (Google blog).

Elo:Gemini 3.7 Flash+195SWE:Gemini 3.7 Flash+17.6%
GPT-4ovsKimi K3Moonshot
Compare

Moonshot AI frontier flagship reasoning and agent swarm model with 256k context and top-tier SWE-bench coding capability.

Elo:Kimi K3+193SWE:Kimi K3+19%
GPT-4ovsClaude Sonnet 4.5Anthropic
Compare

Workhorse Anthropic model: most of Opus coding quality at a mid-tier price.

Elo:Claude Sonnet 4.5+189SWE:Claude Sonnet 4.5+15.3%
GPT-4ovsQwen 3 MaxAlibaba
Compare

Alibaba flagship. Strong math and multilingual code.

Elo:Qwen 3 Max+183SWE:Qwen 3 Max+13%
GPT-4ovsKimi K2.5 MaxMoonshot
Compare

Moonshot flagship reasoning model with high-fidelity coding, deep thinking, and tool use across a 200k context.

Elo:Kimi K2.5 Max+180SWE:Kimi K2.5 Max+16.5%
GPT-4ovsOpenAI o1OpenAI
Compare

OpenAI pioneer reasoning foundation model designed for complex science, math, and multi-step reasoning.

Elo:OpenAI o1+177SWE:GPT-4o+5.9%
GPT-4ovsGemini 3.6 FlashGoogle
Compare

Google Jul 21 workhorse. Now shares the 3.7 Flash introductory $0.75/$3.75 rate through Dec 31 2026.

Elo:Gemini 3.6 Flash+171SWE:Gemini 3.6 Flash+16%
GPT-4ovsGemini 3 FlashGoogle
Compare

Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.

Elo:Gemini 3 Flash+160SWE:Gemini 3 Flash+21%
GPT-4ovsQwen QwQ 32BAlibaba
Compare

Alibaba specialized open reasoning model competing with frontier closed reasoning models.

Elo:Qwen QwQ 32B+160SWE:Qwen QwQ 32B+12.7%
GPT-4ovsGLM-5.2Zhipu
Compare

Zhipu flagship. Strong Chinese/English coding and agents.

Elo:GLM-5.2+157SWE:GLM-5.2+14.5%
GPT-4ovsGemini 2.0 Flash ThinkingGoogle
Compare

Google experimental reasoning model that visualizes thoughts in real-time.

Elo:Gemini 2.0 Flash Thinking+155SWE:Gemini 2.0 Flash Thinking+12%
GPT-4ovsDeepSeek V4 FlashDeepSeek
Compare

DeepSeek Jul 31 2026 price-performance SKU. Public listings put it near $0.14/$0.28 per 1M tokens.

Elo:DeepSeek V4 Flash+155SWE:DeepSeek V4 Flash+16.4%
GPT-4ovsClaude Opus 4Anthropic
Compare

First Claude 4 Opus generation. Baseline for opus 4 vs opus 5.

Elo:Claude Opus 4+155SWE:Claude Opus 4+17.7%
GPT-4ovsGrok 4xAI
Compare

Previous xAI flagship.

Elo:Grok 4+153SWE:Grok 4+3.8%
GPT-4ovsMiniMax M2.5MiniMax
Compare

MiniMax coding model. Tied near the top of official SWE-bench bash-only in Feb 2026.

Elo:MiniMax M2.5+143SWE:MiniMax M2.5+21%
GPT-4ovsYi-Lightning01.AI
Compare

01.AI ultra-fast reasoning model delivering top LiveBench efficiency.

Elo:Yi-Lightning+140SWE:Yi-Lightning+8.6%
GPT-4ovsGLM-5V TurboZhipu
Compare

Zhipu high-throughput multimodal vision model with sub-second latency and competitive coding.

Elo:GLM-5V Turbo+140SWE:GLM-5V Turbo+10.4%
GPT-4ovsSeed 2.1 TurboByteDance
Compare

ByteDance Seed 2.1 Turbo, listed on public model timelines as an Aug 10 2026 API drop.

Elo:Seed 2.1 Turbo+137SWE:Seed 2.1 Turbo+8.4%
GPT-4ovsDoubao Pro 1.5ByteDance
Compare

ByteDance flagship enterprise model with ultra-low token cost and 128k context.

Elo:Doubao Pro 1.5+135SWE:Doubao Pro 1.5+7.3%
GPT-4ovsLlama 4 MaverickMeta
Compare

Meta natively multimodal open-weight flagship.

Elo:Llama 4 Maverick+133SWE:Llama 4 Maverick+2.3%
GPT-4ovsGPT-5.6 LunaOpenAI
Compare

OpenAI 5.6 fast/cheap tier. Official API $0.20/$1.20 per 1M after the Jul 30 80% Luna cut.

Elo:GPT-5.6 Luna+131SWE:GPT-5.6 Luna+7%
GPT-4ovsKimi K2Moonshot
Compare

Moonshot foundation model with strong native bilingual reasoning and 65.8% SWE-bench Verified coding baseline.

Elo:Kimi K2+130SWE:Kimi K2+11%
GPT-4ovsMistral Large 3Mistral
Compare

Mistral European flagship with strong function calling.

Elo:Mistral Large 3+121SWE:Mistral Large 3+0.6%
GPT-4ovsClaude Sonnet 4Anthropic
Compare

First Sonnet 4 generation. Bridge between 3.5/3.7 and Sonnet 5.

Elo:Claude Sonnet 4+120SWE:Claude Sonnet 4+8%
GPT-4ovsErnie 4.5 TurboBaidu
Compare

Baidu current multimodal enterprise foundation model with broad Chinese knowledge.

Elo:Ernie 4.5 Turbo+115SWE:Ernie 4.5 Turbo+2.2%
GPT-4ovsQwen 2.5 PlusAlibaba
Compare

Alibaba balanced flagship API model with high-throughput general reasoning.

Elo:Qwen 2.5 Plus+110SWE:Qwen 2.5 Plus+4.4%
GPT-4ovsOpenAI o1-miniOpenAI
Compare

OpenAI high-speed, cost-effective reasoning model optimized for STEM, math, and code generation.

Elo:OpenAI o1-mini+110SWE:OpenAI o1-mini+1.6%
GPT-4ovsQwen3 235BAlibaba
Compare

Open-weight Qwen3 mixture-of-experts.

Elo:Qwen3 235B+105SWE:Qwen3 235B+4.6%
GPT-4ovsClaude Haiku 4.5Anthropic
Compare

Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).

Elo:Claude Haiku 4.5+103SWE:Claude Haiku 4.5+3.4%
GPT-4ovsYi-Large01.AI
Compare

01.AI full-scale dense model for complex instruction following.

Elo:Yi-Large+95SWE:GPT-4o+1%
GPT-4ovsQwen 2.5 Coder 32BAlibaba
Compare

Alibaba dedicated open-weight code generation model with near-frontier SWE-bench Verified coding capability.

Elo:Qwen 2.5 Coder 32B+90SWE:Qwen 2.5 Coder 32B+10.4%
GPT-4ovsKimi Chat 1.5Moonshot
Compare

Moonshot ultra-long context model supporting up to 2 million tokens per request.

Elo:Kimi Chat 1.5+85SWE:GPT-4o+3.8%
GPT-4ovsLlama 4 ScoutMeta
Compare

Meta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.

Elo:Llama 4 Scout+77SWE:GPT-4o+2.4%
GPT-4ovsGPT-5 miniOpenAI
Compare

Cost-efficient GPT-5 distill for high-volume agents.

Elo:GPT-5 mini+75SWE:GPT-4o+2.4%
GPT-4ovsGrok 3xAI
Compare

Previous xAI generation before Grok 4. Kept for grok 3 vs grok 4.

Elo:Grok 3+70SWE:GPT-4o+3.4%
GPT-4ovsQwen3.8 27BAlibaba
Compare

Alibaba open-weight 27B drop dated Aug 14 2026. Dense enough to self-host; not a frontier MoE.

Elo:Qwen3.8 27B+63SWE:Qwen3.8 27B+4%
GPT-4ovsLlama 3.1 405BMeta
Compare

Meta flagship open-weight 405B dense foundation model with 128k context window.

Elo:Llama 3.1 405B+35SWE:Llama 3.1 405B+3.6%
GPT-4ovsDeepSeek Coder V2DeepSeek
Compare

DeepSeek open-weight Mixture-of-Experts coding model supporting 338 programming languages and 128k context.

Elo:DeepSeek Coder V2+30SWE:DeepSeek Coder V2+5.7%
GPT-4ovsClaude 3.7 SonnetAnthropic
Compare

Hybrid-reasoning Sonnet from 2025. Kept for historical compare pages.

Elo:Claude 3.7 Sonnet+27SWE:Claude 3.7 Sonnet+15.5%
GPT-4ovsDoubao Lite 1.5ByteDance
Compare

ByteDance high-speed lightweight model priced at sub-cent levels.

Elo:Doubao Lite 1.5+25SWE:GPT-4o+8.8%
GPT-4ovsDeepSeek R1DeepSeek
Compare

Open-weights reasoning model trained with large-scale RL.

Elo:DeepSeek R1+23SWE:DeepSeek R1+10.4%
GPT-4ovsGemini 2.5 ProGoogle
Compare

Previous Google long-context flagship.

Elo:Gemini 2.5 Pro+15SWE:Gemini 2.5 Pro+9%
GPT-4ovsCommand ACohere
Compare

Cohere enterprise RAG and tool-use model.

Elo:Command A+9SWE:GPT-4o+12.2%
GPT-4ovsCodestral 25.01Mistral
Compare

Mistral code-specialist model.

Elo:GPT-4o+15SWE:GPT-4o+3%
GPT-4ovsDeepSeek V3DeepSeek
Compare

Prior DeepSeek flagship. Baseline for v3 vs v4.

Elo:GPT-4o+25SWE:GPT-4o+6.2%
GPT-4ovsGemini 2.5 FlashGoogle
Compare

Previous Google speed workhorse.

Elo:GPT-4o+40SWE:GPT-4o+6.8%
GPT-4ovsLlama 3.3 70BMeta
Compare

Previous Meta 70B open-weight workhorse.

Elo:GPT-4o+50SWE:GPT-4o+9.7%
GPT-4ovsClaude 3.5 SonnetAnthropic
Compare

2024 workhorse. Still a high-intent compare against GPT-4o.

Elo:GPT-4o+55SWE:GPT-4o+5.8%
GPT-4ovsGPT-4o miniOpenAI
Compare

Legacy small OpenAI model. Useful as a cheap baseline.

Elo:GPT-4o+63SWE:GPT-4o+13.6%
GPT-4ovsGemini 1.5 ProGoogle
Compare

First million-token Gemini Pro. Baseline for 1.5 vs 2.5 vs 3.x Pro.

Elo:GPT-4o+75SWE:GPT-4o+16.8%
GPT-4ovsGPT-4 TurboOpenAI
Compare

GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.

Elo:GPT-4o+80SWE:GPT-4o+21.6%
GPT-4ovsClaude 3 OpusAnthropic
Compare

Original Claude 3 flagship. Kept so opus 3 vs later Opus and vs GPT-4o still resolve.

Elo:GPT-4o+87SWE:GPT-4o+16.4%
GPT-4ovsLlama 3.1 70BMeta
Compare

Llama 3.1 70B instruct. Predecessor to 3.3 70B and Llama 4.

Elo:GPT-4o+95SWE:GPT-4o+14.6%
GPT-4ovsClaude 3.5 HaikuAnthropic
Compare

Previous cheap Claude. Haiku 4.5 is the current $1/$5 SKU.

Elo:GPT-4o+111SWE:GPT-4o+18.6%
GPT-4ovsGPT Image 2 (High)OpenAI
Compare

OpenAI flagship diffusion-transformer image synthesis model with supreme prompt adherence, realistic textures, and complex text composition.

GPT-4ovsGPT Image 2 (Low / Fast)OpenAI
Compare

Fast distilled tier of GPT Image 2 designed for high-throughput interactive creative workflows at 70% lower price.

GPT-4ovsGPT Image 1.5OpenAI
Compare

Previous OpenAI image generation flagship. High fidelity with proven enterprise reliability.

GPT-4ovsDALL-E 3OpenAI
Compare

Legacy OpenAI image model benchmark baseline. Retained for historical comparisons.

GPT-4ovsReve 2.1Reve
Compare

State-of-the-art cinematic image synthesis foundation model known for photorealistic lighting and aesthetic composition.

GPT-4ovsNano Banana Pro (Gemini 3 Pro Image)Google
Compare

Google DeepMind frontier multimodal image generation flagship with Deep Research and complex multi-object spatial reasoning.

GPT-4ovsNano Banana 2 (Gemini 3.1 Flash Image)Google
Compare

Google high-speed multimodal generative model delivering top Elo performance at half the latency and cost of Pro.

GPT-4ovsNano Banana 2 LiteGoogle
Compare

Sub-1.5 second ultra-low latency tier for real-time applications and mobile game asset pipelines.

GPT-4ovsFLUX.2 [max]Black Forest Labs
Compare

Black Forest Labs maximum-capacity flow-matching model with photoreal anatomy and leading typography fidelity.

GPT-4ovsFLUX.2 [flex]Black Forest Labs
Compare

Flexible step-distilled variant of FLUX.2 offering 99% of Max quality with 45% faster generation speeds.

GPT-4ovsFLUX.1.1 [pro]Black Forest Labs
Compare

First-generation professional API model from Black Forest Labs, renowned for 6x faster generation than original FLUX.1 Pro.

GPT-4ovsFLUX.1 [dev]Black Forest Labs
Compare

Open-weights non-commercial base model with 12B parameters, serving as the foundation for the open-source fine-tuning ecosystem.

GPT-4ovsFLUX.1 [schnell]Black Forest Labs
Compare

Apache 2.0 4-step distilled open weights model optimized for local inference and instant preview generation.

GPT-4ovsIdeogram 4.0 (Quality)Ideogram
Compare

Industry-leading typography, graphic design, and in-image text layout model with precise kerning and complex banner generation.

GPT-4ovsIdeogram 4.0 Open WeightsIdeogram
Compare

Open-weight release of Ideogram 4.0, bringing world-class text rendering to self-hosted enterprise infrastructure.

GPT-4ovsRecraft V4.1 Utility ProRecraft
Compare

Specialized generative model for vector art, icon sets, illustrations, and commercial design assets with native brand color matching.

GPT-4ovsRecraft V4.1 UtilityRecraft
Compare

High-speed utility tier of Recraft V4.1 tailored for rapid asset production at $0.035/image.

GPT-4ovsKrea 2 LargeKrea
Compare

High-resolution real-time generation model tuned for artistic composition and dynamic concept art.

GPT-4ovsKrea 2 Medium TurboKrea
Compare

Sub-2 second interactive generation engine delivering ultra-affordable $15/1k image generation.

GPT-4ovsQwen Image 2.0 ProAlibaba
Compare

Alibaba multimodal image synthesis foundation model with strong bilingual Chinese/English typography and cultural asset fidelity.

GPT-4ovsWan2.6 Text to ImageAlibaba
Compare

Alibaba high-efficiency open video/image unified transformer backbone.

GPT-4ovsSeedream 5.0 ProByteDance
Compare

ByteDance flagship image generation model with high photorealism and fine facial structure rendering.

GPT-4ovsSeedream 4.0ByteDance
Compare

High-value ByteDance image foundation model at $30/1k images.

GPT-4ovsMidjourney v7Midjourney
Compare

Midjourney v7 premier creative image generation model with unparalleled stylistic nuances, coherent hands/anatomy, and cinematic grading.

GPT-4ovsMidjourney v6.1Midjourney
Compare

Previous standard in aesthetic digital art generation, retained as a historical compare baseline.

GPT-4ovsMAI-Image-2.5Microsoft AI
Compare

Microsoft AI proprietary foundation image model for Copilot Studio and enterprise creative workflows.

GPT-4ovsMAI-Image-2.5-FlashMicrosoft AI
Compare

Cost-optimized Microsoft AI image model delivering sub-2 second responses at $20/1k images.

GPT-4ovsHiDream-O1-Image-1.5HiDream
Compare

HiDream high-definition visual generator optimized for photorealism and accurate complex lighting.

GPT-4ovsLuma UNI 1 MaxLuma Labs
Compare

Luma Labs universal 3D-aware image synthesis engine with spatial geometry consistency.