All Insights
By Roshan Desai
The model that writes the cleanest function isn't necessarily the best one for shipping features. Generating code from a description and fixing bugs in a real codebase are different skills, and the best model for each is not always the same. This guide focuses on the coding models in the Onyx Coding LLM Leaderboard, updated July 20, 2026. In that dataset, Claude Fable 5 leads on autonomous bug-fixing, GPT-5.5 leads on agentic terminal tasks, DeepSeek-V4-Pro and Kimi K2.6 are the strongest open-source options, and DeepSeek-V4-Flash or MiniMax M3 stand out when API cost matters.
How this guide is sourced: Coding benchmark, pricing, and license data comes from the Onyx Coding LLM Leaderboard. The recommendations in each review are editorial guidance based on that dataset.
TL;DR: For serious software engineering, Claude Fable 5 leads on autonomous bug-fixing with 95% SWE-bench Verified, the highest score in this dataset. For agentic coding and terminal tasks, GPT-5.5 leads with 82.7% Terminal-Bench 2.0 and 78.7% OSWorld-Verified, the strongest agentic profile among proprietary models here. GPT-5.6 Sol is OpenAI's newer release, but it has no published SWE-bench Verified score yet, so GPT-5.5 represents OpenAI in this ranking. If cost is the constraint, DeepSeek-V4-Flash matches frontier-level bug-fixing at $0.14/M, and MiniMax M3 offers a strong balance at $0.30/M. For open-source, DeepSeek-V4-Pro leads on both bug-fixing and competitive programming under an MIT license, while Kimi K2.6 is the strongest open-weight model for agentic terminal work.
Not all coding tasks are the same, and different models are optimized for different ones.
Writing a function from a description is easy for almost every modern LLM. Navigating an unfamiliar 50,000-line codebase, finding where a bug originates, and writing a fix that doesn't break three other things: that's much harder, and that's what separates the top models from the rest.
The four benchmarks in this guide each test something different:
A model that excels on HumanEval but has a low SWE-bench score is a good autocomplete tool. A model that leads on SWE-bench and Terminal-Bench 2.0 is what you want for serious engineering work.
Onyx is an open-source AI platform that connects LLMs to company knowledge, tools, and workflows. For coding teams, Onyx is useful when model evaluation needs to extend beyond code generation benchmarks into real engineering context: design docs, tickets, pull requests, Slack discussions, runbooks, and source repositories.
A coding model can write code. A workplace AI platform helps the model find the right context before it writes. Onyx supports that layer with connectors, permission-aware search, agents, deep research, and model flexibility across hosted and self-hosted LLMs.
| Model | Provider | SWE-bench | HumanEval | LiveCode | Terminal-Bench 2.0 | API Cost (per 1M in/out) | License |
|---|---|---|---|---|---|---|---|
| Claude Fable 5 | Anthropic | 95% | N/A | N/A | N/A | $10 / $50 | Proprietary |
| GPT-5.5 | OpenAI | 88.7% | 94.2% | 78% | 82.7% | $5 / $30 | Proprietary |
| Claude Opus 4.8 | Anthropic | 88.6% | N/A | N/A | N/A | $5 / $25 | Proprietary |
| Claude Sonnet 5 | Anthropic | 85.2% | N/A | N/A | N/A | $2 / $10 | Proprietary |
| DeepSeek-V4-Pro | DeepSeek | 80.6% | N/A | 93.5% | 67.9% | $0.435 / $0.87 | MIT |
| MiniMax M3 | MiniMax | 80.5% | N/A | N/A | N/A | $0.30 / $1.20 | MiniMax Community |
| Kimi K2.6 | Moonshot | 80.2% | N/A | 89.6% | 66.7% | $0.95 / $4 | Modified MIT |
| DeepSeek-V4-Flash | DeepSeek | 79% | N/A | 91.6% | 56.9% | $0.14 / $0.28 | MIT |
| Hunyuan Hy3 | Tencent | 78% | N/A | N/A | N/A | Not published | Apache 2.0 |
| Qwen3.6-27B | Qwen | 77.2% | N/A | 83.9% | 59.3% | $0.60 / $3.60 | Apache 2.0 |
† GPT-5.6 Sol, OpenAI's newer release, has no published SWE-bench Verified score, so GPT-5.5 represents OpenAI in this ranking.
Source: Onyx Coding LLM Leaderboard, last updated July 20, 2026.
Best at fixing real bugs: Claude Fable 5, GPT-5.5, Claude Opus 4.8, Claude Sonnet 5, MiniMax M3
Best code generation: GPT-5.5, DeepSeek-V4-Pro, DeepSeek-V4-Flash, Kimi K2.6
Best for competitive programming: DeepSeek-V4-Pro, DeepSeek-V4-Flash, Kimi K2.6, Qwen3.6-27B
Best for agentic coding: GPT-5.5, DeepSeek-V4-Pro, Kimi K2.6, Claude Sonnet 5, Claude Fable 5
Best reasoning for coding tasks: Claude Opus 4.8, GPT-5.5, Kimi K2.6, DeepSeek-V4-Pro, Hunyuan Hy3
Best open-source: DeepSeek-V4-Pro, Kimi K2.6, DeepSeek-V4-Flash, Hunyuan Hy3, Qwen3.6-27B
Best budget API: DeepSeek-V4-Flash at $0.14/M, MiniMax M3 at $0.30/M
Claude Fable 5 is Anthropic's new top tier and leads this entire dataset on SWE-bench Verified. Use it when maximum success rate on difficult, autonomous software-engineering tasks matters more than API cost.
Facts: Claude Fable 5 scores 95% on SWE-bench Verified, 85% on OSWorld-Verified, and holds a Chatbot Arena Elo of 1507, and costs $10 / $50 per 1M input/output tokens.
GPT-5.5 has the strongest agentic and code-generation profile among proprietary models in this dataset, leading on Terminal-Bench 2.0, HumanEval, and OSWorld-Verified. GPT-5.6 Sol is OpenAI's newer model, but it has no published SWE-bench Verified score, which is why GPT-5.5 represents OpenAI here. Choose GPT-5.5 when agentic coding, terminal task automation, or code generation from scratch are the primary use case.
Facts: GPT-5.5 scores 88.7% on SWE-bench Verified, 94.2% on HumanEval, 78% on LiveCodeBench, and 82.7% on Terminal-Bench 2.0, and costs $5 / $30 per 1M input/output tokens.
Claude Opus 4.8 sits just behind Claude Fable 5 on bug-fixing while costing half as much per token. It is the first model to evaluate when you want near-frontier SWE-bench performance at a lower price point than the very top of the market.
Facts: Claude Opus 4.8 scores 88.6% on SWE-bench Verified, 93.6% on GPQA Diamond, 83.4% on OSWorld-Verified, and 84.3% on BrowseComp, and costs $5 / $25 per 1M input/output tokens.
Claude Sonnet 5 delivers strong bug-fixing and agentic performance at a fraction of Opus and Fable pricing. Pick it when you want Anthropic compatibility and solid coding performance without stepping up to the flagship tiers.
Facts: Claude Sonnet 5 scores 85.2% on SWE-bench Verified, 81.2% on OSWorld-Verified, 84.7% on BrowseComp, and 43.2% on HLE, and costs $2 / $10 per 1M input/output tokens.
DeepSeek-V4-Pro leads every open-source model in this ranking on both bug-fixing and competitive programming, and is MIT-licensed. It is the first model to evaluate when you need frontier-level open-weight software-engineering performance.
Facts: DeepSeek-V4-Pro scores 80.6% on SWE-bench Verified, 93.5% on LiveCodeBench, 67.9% on Terminal-Bench 2.0, and 90.1% on GPQA Diamond, and is MIT-licensed, with API access at $0.435 / $0.87 per 1M input/output tokens.
MiniMax M3 matches near-frontier SWE-bench performance at a fraction of proprietary pricing. It is the model to evaluate first when software-engineering throughput per dollar is the priority.
Facts: MiniMax M3 scores 80.5% on SWE-bench Verified, 83.5% on BrowseComp, and holds a Chatbot Arena Elo of 1445, and costs $0.30 / $1.20 per 1M input/output tokens.
Kimi K2.6 combines strong bug-fixing with the best agentic terminal performance of any open-source model here. Choose Kimi K2.6 when autonomous terminal-agent workflows and open licensing both matter.
Facts: Kimi K2.6 scores 80.2% on SWE-bench Verified, 89.6% on LiveCodeBench, 66.7% on Terminal-Bench 2.0, and 90.5% on GPQA Diamond, and is Modified MIT licensed, with API access at $0.95 / $4 per 1M input/output tokens.
DeepSeek-V4-Flash is the cheapest model in this ranking that still clears 79% on SWE-bench Verified. Use it when price sensitivity is the top constraint and you still need frontier-adjacent bug-fixing quality.
Facts: DeepSeek-V4-Flash scores 79% on SWE-bench Verified, 91.6% on LiveCodeBench, 56.9% on Terminal-Bench 2.0, and 73.2% on BrowseComp, and is MIT-licensed, with API access at $0.14 / $0.28 per 1M input/output tokens.
Hunyuan Hy3 offers solid bug-fixing and reasoning under a permissive Apache 2.0 license, though pricing is not yet published for this snapshot. It is a reasonable open-weight pick when Apache licensing matters more than published API economics.
Facts: Hunyuan Hy3 scores 78% on SWE-bench Verified, 90.4% on GPQA Diamond, and 84.2% on BrowseComp, and is Apache 2.0 licensed (API pricing not published in this snapshot).
Qwen3.6-27B rounds out the top 10 with solid bug-fixing and competitive-programming scores at a small parameter count, making it practical to self-host. Qwen3.6-27B is the strongest option here when Apache licensing and a smaller footprint are the key requirements.
Facts: Qwen3.6-27B scores 77.2% on SWE-bench Verified, 83.9% on LiveCodeBench, 59.3% on Terminal-Bench 2.0, and 87.8% on GPQA Diamond, and is Apache 2.0 licensed, with API access at $0.60 / $3.60 per 1M input/output tokens.
At 10 million output tokens per month (a typical usage level for a 50-person engineering team using AI coding assistance):
| Model | Monthly API Cost | SWE-bench | Notes |
|---|---|---|---|
| Claude Fable 5 | ~$500,000 | 95% | Highest SWE-bench in this dataset |
| GPT-5.5 | ~$300,000 | 88.7% | Best Terminal-Bench 2.0 and HumanEval |
| Claude Opus 4.8 | ~$250,000 | 88.6% | Near-frontier bug-fixing at lower cost |
| Claude Sonnet 5 | ~$100,000 | 85.2% | Best Anthropic value |
| Kimi K2.6 | ~$40,000 | 80.2% | Best open-source agentic terminal performance |
| Qwen3.6-27B | ~$36,000 | 77.2% | Apache 2.0, small footprint |
| MiniMax M3 | ~$12,000 | 80.5% | Best value in the frontier tier |
| DeepSeek-V4-Pro | ~$9,000 | 80.6% | Best open-source bug-fixing, MIT licensed |
| DeepSeek-V4-Flash | ~$3,000 | 79% | Cheapest option with 79%+ SWE-bench |
| Hunyuan Hy3 | Not published | 78% | Apache 2.0, pricing not yet published |
| Your Situation | Best Choice |
|---|---|
| Highest SWE-bench, cost not a constraint | Claude Fable 5 (95% SWE-bench) |
| Best agentic coding and terminal tasks | GPT-5.5 (82.7% Terminal-Bench 2.0, 78.7% OSWorld) |
| Near-frontier bug-fixing at lower cost | Claude Opus 4.8 (88.6% SWE-bench, $5/M input) |
| Best frontier performance per dollar | MiniMax M3 ($0.30/M input, 80.5% SWE-bench) |
| Cheapest API with strong SWE-bench | DeepSeek-V4-Flash ($0.14/M, 79% SWE-bench) |
| Best open-source, MIT license | DeepSeek-V4-Pro (80.6% SWE-bench) or Kimi K2.6 (66.7% Terminal-Bench 2.0) |
| Apache 2.0, open weights | Qwen3.6-27B (83.9% LiveCode) or Hunyuan Hy3 (78% SWE-bench) |
| Anthropic ecosystem, cost-optimized | Claude Sonnet 5 (85.2% SWE-bench, $10/M out) |
| Engineering use case | Recommended setup | Why |
|---|---|---|
| Individual coding assistant | Claude, GPT, or a coding-focused open model in the IDE | Fastest feedback loop for code generation |
| Team knowledge search | Onyx connected to GitHub, Jira, Confluence, Slack, and runbooks | Helps models answer with project context |
| Autonomous engineering agents | Frontier coding model plus sandboxed terminal environment | Stronger fit for bug fixing and terminal tasks |
| Regulated engineering org | Self-hosted model + Onyx self-hosted + source permissions | Keeps code and internal docs inside controlled infrastructure |
Benchmarks tell you which models are strong. The production setup determines whether those models can safely use your team's actual engineering context.
In this leaderboard snapshot, Claude Fable 5 has the strongest autonomous bug-fixing performance at 95% SWE-bench Verified. GPT-5.5 leads on Terminal-Bench 2.0 (82.7%) and HumanEval (94.2%), making it the best pick for agentic and code-generation workflows. MiniMax M3 and DeepSeek-V4-Flash are notable for price-performance on SWE-bench. For open-source options, DeepSeek-V4-Pro and Kimi K2.6 are the leading choices in this dataset.
SWE-bench Verified is a benchmark where models are given real GitHub issues from popular Python projects and must autonomously write a code patch that makes the project's existing tests pass. Unlike HumanEval, which tests function-level code generation, SWE-bench tests the ability to understand entire codebases, locate relevant files, and write correct diffs. A score above 75% is considered frontier-level as of 2026.
On SWE-bench Verified, Claude Fable 5 (95%) leads among models with published scores, ahead of GPT-5.5 (88.7%). On Terminal-Bench 2.0 and HumanEval, GPT-5.5 (82.7% and 94.2%) leads the Claude lineup, making it the better choice for autonomous terminal agents and pure code generation. The right pick depends on whether you are optimizing for bug-fixing accuracy or agentic task completion.
In this leaderboard snapshot, DeepSeek-V4-Pro and Kimi K2.6 are the strongest open-source coding models. DeepSeek-V4-Pro leads on both bug-fixing and competitive programming, with 80.6% SWE-bench Verified and 93.5% LiveCodeBench under an MIT license. Kimi K2.6 is the better pick for agentic terminal work, with 66.7% Terminal-Bench 2.0, also under a Modified MIT license. Qwen3.6-27B and Hunyuan Hy3 are the top Apache 2.0 options if you need that specific license.
Related Insights
How Onyx's RAG Engine Cuts Token Usage at Enterprise Scale (2026)
Agents that read every source burn tokens on every task. Learn how Onyx's RAG engine indexes your sources once, condenses them into a vector DB, and serves enterprise context in one cheap retrieval call.
Best Enterprise RAG Platforms for 2026: A Buyer's Guide
Compare 11 enterprise RAG platforms across architecture, connectors, deployment, security, and pricing. Includes turnkey, cloud, and open-source options with current 2026 pricing and analyst data.
Best Open Source LLMs in 2026
Compare 10 open-source and open-weight language models in Onyx's July 20, 2026 leaderboard snapshot. Benchmark data, license types, and API availability for DeepSeek-V4-Pro, Kimi K2.6, GLM-5.2, MiniMax M3, Qwen3.6-27B, and more.