CompareLLM.ai
Live
Leaderboard
Models
Compare
Best of & Stacks
Research & News
…
CompareLLM.ai
Precision Benchmarks

Programmatic, dated AI model benchmarks, head-to-head comparisons, and Stack Engine presets.

Daily ingest · 06:00 UTC

Analytics & Benchmarks

  • AI Model Leaderboard
  • Head-to-Head Compare Hub
  • Models Directory
  • Stack Engine Presets
  • Frontier Models
  • Open Weights Catalog

Guides & Intent Lists

  • Best LLM Lists (2026)
  • Best Coding LLM
  • Best Cheap LLM
  • Fastest Low-Latency LLM
  • Claude vs GPT Benchmark
  • What is Elo?
  • Methodology Guides
  • News & Dispatches

Transparency & API

  • Evaluation Methodology
  • Benchmark Changelog
  • Public JSON API
  • llms.txt Specification
  • Privacy Policy
  • Sign In / Account

© 2026 CompareLLM. Public benchmark data aggregated from Arena Elo, LiveBench, SWE-bench & OpenRouter.

Every score has a dated snapshot.

Theme:
Currency:
  1. Home
  2. Models
  3. Claude Sonnet 4
  4. vs all
Comparison Matrix Hub
100 pairwise matchups

Claude Sonnet 4 vs All Models

Detailed head-to-head fact sheets comparing Claude Sonnet 4 (Anthropic) against every indexable model in the benchmark catalog.

Elo Rating1,455
SWE-bench62.8%
Out $/1M$15
Context Window1M
Showing 100 of 100 comparisons
Claude Sonnet 4vsClaude Opus 5Anthropic
Compare

Anthropic current default flagship. Official API $5/$25 per 1M tokens and a 1M context window (Anthropic, Jul 24 2026).

Elo:Claude Opus 5+169SWE:Claude Opus 5+16.4%
Claude Sonnet 4vsClaude Fable 5Anthropic
Compare

Anthropic top-tier X-High reasoning model engineered for heavy multi-step tasks. Official API $10/$50 per 1M tokens (Claude Platform pricing, Aug 2026).

Elo:Claude Fable 5+161SWE:Claude Fable 5+17.2%
Claude Sonnet 4vsGPT-5.6 SolOpenAI
Compare

OpenAI 5.6 flagship tier. Official API $5/$30 per 1M tokens (OpenAI pricing, Jul 30 2026 update left Sol unchanged).

Elo:GPT-5.6 Sol+153SWE:GPT-5.6 Sol+14.8%
Claude Sonnet 4vsClaude Opus 4.8Anthropic
Compare

Prior Opus generation still billed at $5/$25. Kept as a compare baseline against Opus 5.

Elo:Claude Opus 4.8+143SWE:Claude Opus 4.8+15.6%
Claude Sonnet 4vsGrok 4.6xAI
Compare

xAI Aug 12 2026 post-training refresh of Grok 4.5. Same $2/$6 API price, 500k context, stronger agentic traces.

Elo:Grok 4.6+137SWE:Grok 4.6+6.3%
Claude Sonnet 4vsClaude Opus 4.6Anthropic
Compare

Follow-on Opus release. Slightly behind 4.5 on official SWE-bench bash-only in the last published sweep; stronger multi-step autonomous agent reasoning.

Elo:Claude Opus 4.6+119SWE:Claude Opus 4.6+13.1%
Claude Sonnet 4vsGemini 3.6 ProGoogle
Compare

Current Google Pro-class multimodal model. Long context, strong coding, billed like the 3.x Pro tier.

Elo:Gemini 3.6 Pro+115SWE:Gemini 3.6 Pro+11.8%
Claude Sonnet 4vsClaude Opus 4.5Anthropic
Compare

Anthropic frontier coding and computer-use model. SWE-bench leader on the official mini-SWE-agent harness in the Feb 2026 refresh.

Elo:Claude Opus 4.5+113SWE:Claude Opus 4.5+14%
Claude Sonnet 4vsOpenAI: o3 MiniOpenAI
Compare

Auto-discovered from OpenRouter (openai/o3-mini). Preview until a second source matches.

Elo:OpenAI: o3 Mini+105SWE:OpenAI: o3 Mini+15.7%
Claude Sonnet 4vsGPT-5OpenAI
Compare

OpenAI flagship reasoning model for 2025–26. Strong general preference Elo and multimodal coverage.

Elo:GPT-5+103SWE:GPT-5+5.6%
Claude Sonnet 4vsGLM-5.3Zhipu
Compare

Z.ai Aug 14 2026 post-train of the GLM-5.2 744B base. Coding-plan live; open weights promised after a two-week safety review (z.ai/blog/glm-5.3).

Elo:GLM-5.3+103SWE:GLM-5.3+13.6%
Claude Sonnet 4vsClaude Sonnet 5Anthropic
Compare

Anthropic workhorse. Official $2/$10 per 1M tokens made permanent on Aug 10 2026.

Elo:Claude Sonnet 5+101SWE:Claude Sonnet 5+11%
Claude Sonnet 4vsGemini 3 ProGoogle
Compare

Google frontier multimodal model with a multi-million-token context window.

Elo:Gemini 3 Pro+97SWE:Gemini 3 Pro+9.6%
Claude Sonnet 4vsGPT-5.6 TerraOpenAI
Compare

OpenAI 5.6 mid tier. Official API $2/$12 per 1M after the Jul 30 2026 price cut.

Elo:GPT-5.6 Terra+93SWE:GPT-5.6 Terra+7.6%
Claude Sonnet 4vsGPT-4.5 OrionOpenAI
Compare

OpenAI largest dense non-reasoning model with expansive world knowledge and reduced hallucinations.

Elo:GPT-4.5 Orion+85SWE:GPT-4.5 Orion+8.2%
Claude Sonnet 4vsDeepSeek V4 ProDeepSeek
Compare

Open-weight-adjacent DeepSeek flagship. High reasoning density per dollar.

Elo:DeepSeek V4 Pro+81SWE:DeepSeek V4 Pro+8.8%
Claude Sonnet 4vsGemini 3.7 FlashGoogle
Compare

Google Aug 13 2026 workhorse. Official intro price $0.75/$3.75 per 1M through Dec 31 2026; 1,048,576-token context (Google blog).

Elo:Gemini 3.7 Flash+75SWE:Gemini 3.7 Flash+9.6%
Claude Sonnet 4vsKimi K3Moonshot
Compare

Moonshot AI frontier flagship reasoning and agent swarm model with 256k context and top-tier SWE-bench coding capability.

Elo:Kimi K3+73SWE:Kimi K3+11%
Claude Sonnet 4vsClaude Sonnet 4.5Anthropic
Compare

Workhorse Anthropic model: most of Opus coding quality at a mid-tier price.

Elo:Claude Sonnet 4.5+69SWE:Claude Sonnet 4.5+7.3%
Claude Sonnet 4vsQwen 3 MaxAlibaba
Compare

Alibaba flagship. Strong math and multilingual code.

Elo:Qwen 3 Max+63SWE:Qwen 3 Max+5%
Claude Sonnet 4vsMoonshotAI: Kimi K2.5Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2.5). Preview until a second source matches.

Elo:MoonshotAI: Kimi K2.5+60SWE:MoonshotAI: Kimi K2.5+8.5%
Claude Sonnet 4vsOpenAI: o1OpenAI
Compare

Auto-discovered from OpenRouter (openai/o1). Preview until a second source matches.

Elo:OpenAI: o1+57SWE:Claude Sonnet 4+13.9%
Claude Sonnet 4vsGemini 3.6 FlashGoogle
Compare

Google Jul 21 workhorse. Now shares the 3.7 Flash introductory $0.75/$3.75 rate through Dec 31 2026.

Elo:Gemini 3.6 Flash+51SWE:Gemini 3.6 Flash+8%
Claude Sonnet 4vsGemini 3 FlashGoogle
Compare

Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.

Elo:Gemini 3 Flash+40SWE:Gemini 3 Flash+13%
Claude Sonnet 4vsQwen QwQ 32BAlibaba
Compare

Alibaba specialized open reasoning model competing with frontier closed reasoning models.

Elo:Qwen QwQ 32B+40SWE:Qwen QwQ 32B+4.7%
Claude Sonnet 4vsGLM-5.2Zhipu
Compare

Zhipu flagship. Strong Chinese/English coding and agents.

Elo:GLM-5.2+37SWE:GLM-5.2+6.5%
Claude Sonnet 4vsGemini 2.0 Flash ThinkingGoogle
Compare

Google experimental reasoning model that visualizes thoughts in real-time.

Elo:Gemini 2.0 Flash Thinking+35SWE:Gemini 2.0 Flash Thinking+4%
Claude Sonnet 4vsDeepSeek V4 FlashDeepSeek
Compare

DeepSeek Jul 31 2026 price-performance SKU. Public listings put it near $0.14/$0.28 per 1M tokens.

Elo:DeepSeek V4 Flash+35SWE:DeepSeek V4 Flash+8.4%
Claude Sonnet 4vsClaude Opus 4Anthropic
Compare

First Claude 4 Opus generation. Baseline for opus 4 vs opus 5.

Elo:Claude Opus 4+35SWE:Claude Opus 4+9.7%
Claude Sonnet 4vsGrok 4xAI
Compare

Previous xAI flagship.

Elo:Grok 4+33SWE:Claude Sonnet 4+4.2%
Claude Sonnet 4vsMiniMax M2.5MiniMax
Compare

MiniMax coding model. Tied near the top of official SWE-bench bash-only in Feb 2026.

Elo:MiniMax M2.5+23SWE:MiniMax M2.5+13%
Claude Sonnet 4vsYi-Lightning01.AI
Compare

01.AI ultra-fast reasoning model delivering top LiveBench efficiency.

Elo:Yi-Lightning+20SWE:Yi-Lightning+0.6%
Claude Sonnet 4vsZ.ai: GLM 5V TurboZhipu
Compare

Auto-discovered from OpenRouter (z-ai/glm-5v-turbo). Preview until a second source matches.

Elo:Z.ai: GLM 5V Turbo+20SWE:Z.ai: GLM 5V Turbo+2.4%
Claude Sonnet 4vsSeed 2.1 TurboByteDance
Compare

ByteDance Seed 2.1 Turbo, listed on public model timelines as an Aug 10 2026 API drop.

Elo:Seed 2.1 Turbo+17SWE:Seed 2.1 Turbo+0.4%
Claude Sonnet 4vsDoubao Pro 1.5ByteDance
Compare

ByteDance flagship enterprise model with ultra-low token cost and 128k context.

Elo:Doubao Pro 1.5+15SWE:Claude Sonnet 4+0.7%
Claude Sonnet 4vsLlama 4 MaverickMeta
Compare

Meta natively multimodal open-weight flagship.

Elo:Llama 4 Maverick+13SWE:Claude Sonnet 4+5.7%
Claude Sonnet 4vsGPT-5.6 LunaOpenAI
Compare

OpenAI 5.6 fast/cheap tier. Official API $0.20/$1.20 per 1M after the Jul 30 80% Luna cut.

Elo:GPT-5.6 Luna+11SWE:Claude Sonnet 4+1%
Claude Sonnet 4vsMoonshotAI: Kimi K2 0711Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2). Preview until a second source matches.

Elo:MoonshotAI: Kimi K2 0711+10SWE:MoonshotAI: Kimi K2 0711+3%
Claude Sonnet 4vsMistral Large 3Mistral
Compare

Mistral European flagship with strong function calling.

Elo:Mistral Large 3+1SWE:Claude Sonnet 4+7.4%
Claude Sonnet 4vsErnie 4.5 TurboBaidu
Compare

Baidu current multimodal enterprise foundation model with broad Chinese knowledge.

Elo:Claude Sonnet 4+5SWE:Claude Sonnet 4+5.8%
Claude Sonnet 4vsQwen 2.5 PlusAlibaba
Compare

Alibaba balanced flagship API model with high-throughput general reasoning.

Elo:Claude Sonnet 4+10SWE:Claude Sonnet 4+3.6%
Claude Sonnet 4vsOpenAI o1-miniOpenAI
Compare

OpenAI high-speed, cost-effective reasoning model optimized for STEM, math, and code generation.

Elo:Claude Sonnet 4+10SWE:Claude Sonnet 4+6.4%
Claude Sonnet 4vsQwen3 235BAlibaba
Compare

Open-weight Qwen3 mixture-of-experts.

Elo:Claude Sonnet 4+15SWE:Claude Sonnet 4+3.4%
Claude Sonnet 4vsClaude Haiku 4.5Anthropic
Compare

Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).

Elo:Claude Sonnet 4+17SWE:Claude Sonnet 4+4.6%
Claude Sonnet 4vsYi-Large01.AI
Compare

01.AI full-scale dense model for complex instruction following.

Elo:Claude Sonnet 4+25SWE:Claude Sonnet 4+9%
Claude Sonnet 4vsQwen 2.5 Coder 32BAlibaba
Compare

Alibaba dedicated open-weight code generation model with near-frontier SWE-bench Verified coding capability.

Elo:Claude Sonnet 4+30SWE:Qwen 2.5 Coder 32B+2.4%
Claude Sonnet 4vsQwen2.5 Coder 32B InstructAlibaba
Compare

Auto-discovered from OpenRouter (qwen/qwen-2.5-coder-32b-instruct). Preview until a second source matches.

Elo:Claude Sonnet 4+30SWE:Qwen2.5 Coder 32B Instruct+2.4%
Claude Sonnet 4vsKimi Chat 1.5Moonshot
Compare

Moonshot ultra-long context model supporting up to 2 million tokens per request.

Elo:Claude Sonnet 4+35SWE:Claude Sonnet 4+11.8%
Claude Sonnet 4vsLlama 4 ScoutMeta
Compare

Meta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.

Elo:Claude Sonnet 4+43SWE:Claude Sonnet 4+10.4%
Claude Sonnet 4vsGPT-5 miniOpenAI
Compare

Cost-efficient GPT-5 distill for high-volume agents.

Elo:Claude Sonnet 4+45SWE:Claude Sonnet 4+10.4%
Claude Sonnet 4vsGrok 3xAI
Compare

Previous xAI generation before Grok 4. Kept for grok 3 vs grok 4.

Elo:Claude Sonnet 4+50SWE:Claude Sonnet 4+11.4%
Claude Sonnet 4vsQwen3.8 27BAlibaba
Compare

Alibaba open-weight 27B drop dated Aug 14 2026. Dense enough to self-host; not a frontier MoE.

Elo:Claude Sonnet 4+57SWE:Claude Sonnet 4+4%
Claude Sonnet 4vsLlama 3.1 405BMeta
Compare

Meta flagship open-weight 405B dense foundation model with 128k context window.

Elo:Claude Sonnet 4+85SWE:Claude Sonnet 4+4.4%
Claude Sonnet 4vsDeepSeek Coder V2DeepSeek
Compare

DeepSeek open-weight Mixture-of-Experts coding model supporting 338 programming languages and 128k context.

Elo:Claude Sonnet 4+90SWE:Claude Sonnet 4+2.3%
Claude Sonnet 4vsClaude 3.7 SonnetAnthropic
Compare

Hybrid-reasoning Sonnet from 2025. Kept for historical compare pages.

Elo:Claude Sonnet 4+93SWE:Claude 3.7 Sonnet+7.5%
Claude Sonnet 4vsDoubao Lite 1.5ByteDance
Compare

ByteDance high-speed lightweight model priced at sub-cent levels.

Elo:Claude Sonnet 4+95SWE:Claude Sonnet 4+16.8%
Claude Sonnet 4vsDeepSeek R1DeepSeek
Compare

Open-weights reasoning model trained with large-scale RL.

Elo:Claude Sonnet 4+97SWE:DeepSeek R1+2.4%
Claude Sonnet 4vsGemini 2.5 ProGoogle
Compare

Previous Google long-context flagship.

Elo:Claude Sonnet 4+105SWE:Gemini 2.5 Pro+1%
Claude Sonnet 4vsCommand ACohere
Compare

Cohere enterprise RAG and tool-use model.

Elo:Claude Sonnet 4+111SWE:Claude Sonnet 4+20.2%
Claude Sonnet 4vsGPT-4oOpenAI
Compare

Previous OpenAI flagship. Still a common compare baseline on legacy pages.

Elo:Claude Sonnet 4+120SWE:Claude Sonnet 4+8%
Claude Sonnet 4vsCodestral 25.01Mistral
Compare

Mistral code-specialist model.

Elo:Claude Sonnet 4+135SWE:Claude Sonnet 4+11%
Claude Sonnet 4vsDeepSeek V3DeepSeek
Compare

Prior DeepSeek flagship. Baseline for v3 vs v4.

Elo:Claude Sonnet 4+145SWE:Claude Sonnet 4+14.2%
Claude Sonnet 4vsGemini 2.5 FlashGoogle
Compare

Previous Google speed workhorse.

Elo:Claude Sonnet 4+160SWE:Claude Sonnet 4+14.8%
Claude Sonnet 4vsLlama 3.3 70BMeta
Compare

Previous Meta 70B open-weight workhorse.

Elo:Claude Sonnet 4+170SWE:Claude Sonnet 4+17.7%
Claude Sonnet 4vsClaude 3.5 SonnetAnthropic
Compare

2024 workhorse. Still a high-intent compare against GPT-4o.

Elo:Claude Sonnet 4+175SWE:Claude Sonnet 4+13.8%
Claude Sonnet 4vsGPT-4o miniOpenAI
Compare

Legacy small OpenAI model. Useful as a cheap baseline.

Elo:Claude Sonnet 4+183SWE:Claude Sonnet 4+21.6%
Claude Sonnet 4vsGemini 1.5 ProGoogle
Compare

First million-token Gemini Pro. Baseline for 1.5 vs 2.5 vs 3.x Pro.

Elo:Claude Sonnet 4+195SWE:Claude Sonnet 4+24.8%
Claude Sonnet 4vsGPT-4 TurboOpenAI
Compare

GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.

Elo:Claude Sonnet 4+200SWE:Claude Sonnet 4+29.6%
Claude Sonnet 4vsClaude 3 OpusAnthropic
Compare

Original Claude 3 flagship. Kept so opus 3 vs later Opus and vs GPT-4o still resolve.

Elo:Claude Sonnet 4+207SWE:Claude Sonnet 4+24.4%
Claude Sonnet 4vsLlama 3.1 70BMeta
Compare

Llama 3.1 70B instruct. Predecessor to 3.3 70B and Llama 4.

Elo:Claude Sonnet 4+215SWE:Claude Sonnet 4+22.6%
Claude Sonnet 4vsClaude 3.5 HaikuAnthropic
Compare

Previous cheap Claude. Haiku 4.5 is the current $1/$5 SKU.

Elo:Claude Sonnet 4+231SWE:Claude Sonnet 4+26.6%
Claude Sonnet 4vsGPT Image 2 (High)OpenAI
Compare

OpenAI flagship diffusion-transformer image synthesis model with supreme prompt adherence, realistic textures, and complex text composition.

Claude Sonnet 4vsGPT Image 2 (Low / Fast)OpenAI
Compare

Fast distilled tier of GPT Image 2 designed for high-throughput interactive creative workflows at 70% lower price.

Claude Sonnet 4vsGPT Image 1.5OpenAI
Compare

Previous OpenAI image generation flagship. High fidelity with proven enterprise reliability.

Claude Sonnet 4vsDALL-E 3OpenAI
Compare

Legacy OpenAI image model benchmark baseline. Retained for historical comparisons.

Claude Sonnet 4vsReve 2.1Reve
Compare

State-of-the-art cinematic image synthesis foundation model known for photorealistic lighting and aesthetic composition.

Claude Sonnet 4vsNano Banana Pro (Gemini 3 Pro Image)Google
Compare

Google DeepMind frontier multimodal image generation flagship with Deep Research and complex multi-object spatial reasoning.

Claude Sonnet 4vsNano Banana 2 (Gemini 3.1 Flash Image)Google
Compare

Google high-speed multimodal generative model delivering top Elo performance at half the latency and cost of Pro.

Claude Sonnet 4vsNano Banana 2 LiteGoogle
Compare

Sub-1.5 second ultra-low latency tier for real-time applications and mobile game asset pipelines.

Claude Sonnet 4vsFLUX.2 [max]Black Forest Labs
Compare

Black Forest Labs maximum-capacity flow-matching model with photoreal anatomy and leading typography fidelity.

Claude Sonnet 4vsFLUX.2 [flex]Black Forest Labs
Compare

Flexible step-distilled variant of FLUX.2 offering 99% of Max quality with 45% faster generation speeds.

Claude Sonnet 4vsFLUX.1.1 [pro]Black Forest Labs
Compare

First-generation professional API model from Black Forest Labs, renowned for 6x faster generation than original FLUX.1 Pro.

Claude Sonnet 4vsFLUX.1 [dev]Black Forest Labs
Compare

Open-weights non-commercial base model with 12B parameters, serving as the foundation for the open-source fine-tuning ecosystem.

Claude Sonnet 4vsFLUX.1 [schnell]Black Forest Labs
Compare

Apache 2.0 4-step distilled open weights model optimized for local inference and instant preview generation.

Claude Sonnet 4vsIdeogram 4.0 (Quality)Ideogram
Compare

Industry-leading typography, graphic design, and in-image text layout model with precise kerning and complex banner generation.

Claude Sonnet 4vsIdeogram 4.0 Open WeightsIdeogram
Compare

Open-weight release of Ideogram 4.0, bringing world-class text rendering to self-hosted enterprise infrastructure.

Claude Sonnet 4vsRecraft V4.1 Utility ProRecraft
Compare

Specialized generative model for vector art, icon sets, illustrations, and commercial design assets with native brand color matching.

Claude Sonnet 4vsRecraft V4.1 UtilityRecraft
Compare

High-speed utility tier of Recraft V4.1 tailored for rapid asset production at $0.035/image.

Claude Sonnet 4vsKrea 2 LargeKrea
Compare

High-resolution real-time generation model tuned for artistic composition and dynamic concept art.

Claude Sonnet 4vsKrea 2 Medium TurboKrea
Compare

Sub-2 second interactive generation engine delivering ultra-affordable $15/1k image generation.

Claude Sonnet 4vsQwen Image 2.0 ProAlibaba
Compare

Alibaba multimodal image synthesis foundation model with strong bilingual Chinese/English typography and cultural asset fidelity.

Claude Sonnet 4vsWan2.6 Text to ImageAlibaba
Compare

Alibaba high-efficiency open video/image unified transformer backbone.

Claude Sonnet 4vsSeedream 5.0 ProByteDance
Compare

ByteDance flagship image generation model with high photorealism and fine facial structure rendering.

Claude Sonnet 4vsSeedream 4.0ByteDance
Compare

High-value ByteDance image foundation model at $30/1k images.

Claude Sonnet 4vsMidjourney v7Midjourney
Compare

Midjourney v7 premier creative image generation model with unparalleled stylistic nuances, coherent hands/anatomy, and cinematic grading.

Claude Sonnet 4vsMidjourney v6.1Midjourney
Compare

Previous standard in aesthetic digital art generation, retained as a historical compare baseline.

Claude Sonnet 4vsMAI-Image-2.5Microsoft AI
Compare

Microsoft AI proprietary foundation image model for Copilot Studio and enterprise creative workflows.

Claude Sonnet 4vsMAI-Image-2.5-FlashMicrosoft AI
Compare

Cost-optimized Microsoft AI image model delivering sub-2 second responses at $20/1k images.

Claude Sonnet 4vsHiDream-O1-Image-1.5HiDream
Compare

HiDream high-definition visual generator optimized for photorealism and accurate complex lighting.

Claude Sonnet 4vsLuma UNI 1 MaxLuma Labs
Compare

Luma Labs universal 3D-aware image synthesis engine with spatial geometry consistency.