All Insights
By Roshan Desai
The model that writes the cleanest function isn't necessarily the best one for shipping features. Generating code from a description and fixing bugs in a real codebase are different skills, and the best model for each is not always the same. This guide focuses on the coding models in the Onyx Coding LLM Leaderboard, updated October 13, 2026. In that dataset, Claude Opus 5.5 leads on autonomous bug-fixing, GPT-6.1 Sol is OpenAI's best agentic coder, Muse Wonder Full is the strongest new entrant, DeepSeek-V4-Pro and Kimi K2.6 are the strongest open-source options, and DeepSeek-V4-Flash stands out when API cost matters.
How this guide is sourced: Coding benchmark, pricing, and license data comes from the Onyx Coding LLM Leaderboard. The recommendations in each review are editorial guidance based on that dataset.
TL;DR: For serious software engineering, Claude Opus 5.5 leads on autonomous bug-fixing with 89.9% SWE-bench Pro, the highest score in this dataset, plus 87.6% Terminal-Bench 2.1 and 81.8% OSWorld. GPT-6.1 Sol is OpenAI's best agentic coder, matching the larger GPT-6 Astra on coding at a fifth of the price. Claude Sonnet 5.5 delivers most of Opus 5.5's coding ability at half the cost. Muse Wonder Full, Meta's first frontier model, posts coding results that beat both Opus 5.5 and Astra on Meta's own evals, but is subscription-only. Grok 4.6 tops SWE-bench Verified at 95.6% with the lowest frontier pricing. For open-source, DeepSeek-V4-Pro leads on both bug-fixing and competitive programming under an MIT license, while Kimi K2.6 is the strongest open-weight model for agentic terminal work.
Not all coding tasks are the same, and different models are optimized for different ones.
Writing a function from a description is easy for almost every modern LLM. Navigating an unfamiliar 50,000-line codebase, finding where a bug originates, and writing a fix that doesn't break three other things: that's much harder, and that's what separates the top models from the rest.
The four benchmarks in this guide each test something different:
A model that excels on HumanEval but has a low SWE-bench score is a good autocomplete tool. A model that leads on SWE-bench and Terminal-Bench 2.0 is what you want for serious engineering work.
Onyx is an open-source AI platform that connects LLMs to company knowledge, tools, and workflows. For coding teams, Onyx is useful when model evaluation needs to extend beyond code generation benchmarks into real engineering context: design docs, tickets, pull requests, Slack discussions, runbooks, and source repositories.
A coding model can write code. A workplace AI platform helps the model find the right context before it writes. Onyx supports that layer with connectors, permission-aware search, agents, deep research, and model flexibility across hosted and self-hosted LLMs.
| Model | Provider | SWE-bench Verified | SWE-bench Pro | LiveCode | Terminal-Bench 2.1 | API Cost (per 1M in/out) | License |
|---|---|---|---|---|---|---|---|
| Claude Opus 5.5 | Anthropic | N/A | 89.9% | N/A | 87.6% | $4 / $20 | Proprietary |
| GPT-6.1 Sol | OpenAI | N/A | N/A | N/A | N/A | $2 / $10 | Proprietary |
| Claude Sonnet 5.5 | Anthropic | N/A | 81.3% | N/A | 83.2% | $2 / $10 | Proprietary |
| Muse Wonder Full | Meta | N/A | N/A | N/A | N/A | Subscription only | Proprietary |
| Grok 4.6 | xAI | 95.6% | N/A | 88.2% | 78.3% | $2 / $6 | Proprietary |
| Claude Fable 5 | Anthropic | 95% | 80% | N/A | 84.3% | $10 / $50 | Proprietary |
| GPT-6 Astra | OpenAI | N/A | N/A | N/A | 87.3% | $10 / $50 | Proprietary |
| DeepSeek-V4-Pro | DeepSeek | 80.6% | N/A | 93.5% | N/A | $0.435 / $0.87 | MIT |
| Kimi K2.6 | Moonshot | 80.2% | N/A | 89.6% | N/A | $0.95 / $4 | Modified MIT |
| DeepSeek-V4-Flash | DeepSeek | 79% | N/A | 91.6% | N/A | $0.14 / $0.28 | MIT |
† OpenAI and Meta no longer publish scores on these benchmark suites for their newest models. GPT-6.1 Sol and Muse Wonder Full rank on vendor-reported agentic coding evals (OpenAI's DeepSWE v1.1: GPT-6.1 Sol 75.2%, above GPT-6 Astra's 74.1%; Meta reports Muse Wonder Full at 79.0%, above Claude Opus 5.5's 74.2%). Treat vendor-reported numbers with appropriate caution.
Source: Onyx Coding LLM Leaderboard, last updated October 13, 2026.
Best at fixing real bugs: Claude Opus 5.5, Grok 4.6, Claude Fable 5, Claude Sonnet 5.5
Best agentic coding: Claude Opus 5.5, GPT-6.1 Sol, GPT-6 Astra, Claude Sonnet 5.5
Best for competitive programming: DeepSeek-V4-Pro, DeepSeek-V4-Flash, Kimi K2.6, Grok 4.6
Strongest new entrant: Muse Wonder Full (subscription only)
Best reasoning for coding tasks: GPT-6 Astra, Claude Opus 5.5, Claude Fable 5.1, Grok 4.6
Best open-source: DeepSeek-V4-Pro, Kimi K2.6, DeepSeek-V4-Flash, Hunyuan Hy3, Qwen3.6-27B
Best budget API: DeepSeek-V4-Flash at $0.14/M, Grok 4.6 at $2/M among frontier models
Claude Opus 5.5 is Anthropic's new flagship and the strongest software-engineering model in this dataset, leading SWE-bench Pro, Terminal-Bench 2.1, and OSWorld. It also costs less than the Fable tier it displaces at the top of this ranking. Use it when maximum success rate on difficult, autonomous engineering tasks is the priority.
Facts: Claude Opus 5.5 scores 89.9% on SWE-bench Pro, 87.6% on Terminal-Bench 2.1, 81.8% on OSWorld, 93.3% on ARC-AGI-2, and costs $4 / $20 per 1M input/output tokens.
GPT-6.1 Sol is OpenAI's best coding pick, built specifically for coding, computer use, and multi-step business workflows. On OpenAI's DeepSWE v1.1 eval it scores 75.2%, above the larger GPT-6 Astra's 74.1%, at a fifth of Astra's price. OpenAI no longer publishes the classic coding benchmarks, so its ranking here leans on vendor-reported agentic evals.
Facts: GPT-6.1 Sol scores 94.2% on ARC-AGI-2, 52.9% on Humanity's Last Exam, and costs $2 / $10 per 1M input/output tokens.
Claude Sonnet 5.5 delivers most of Claude Opus 5.5's coding ability at half the price, and on Anthropic's newest terminal eval it actually beats Opus. Pick it when you want frontier Anthropic coding without flagship pricing.
Facts: Claude Sonnet 5.5 scores 81.3% on SWE-bench Pro, 83.2% on Terminal-Bench 2.1, 80.1% on OSWorld, delivers 135.9 tokens per second, and costs $2 / $10 per 1M input/output tokens.
Muse Wonder Full is Meta's first frontier model and its coding results are the headline: Meta reports 79.0% on DeepSWE v1.1, above both Claude Opus 5.5 (74.2%) and GPT-6 Astra (74.1%). Independent verification is still thin, and it ships only through Muse Code subscriptions with no API, which limits it to interactive use rather than pipeline integration.
Facts: Muse Wonder Full scores 78.4% on OSWorld, 79.0% on DeepSWE v1.1, and 59.0 on the Artificial Analysis Index in Meta's published evaluation table. It is available through Muse Code subscriptions at $50 to $200 per month rather than per-token pricing.
Grok 4.6 posts the top SWE-bench Verified score in this dataset with the most aggressive frontier pricing. It trails the leaders on deep reasoning and agentic terminal work, so it fits high-volume code generation and bug-fixing better than long autonomous sessions.
Facts: Grok 4.6 scores 95.6% on SWE-bench Verified, 88.2% on LiveCodeBench, 78.3% on Terminal-Bench 2.1, 94.7% on GPQA Diamond, and costs $2 / $6 per 1M input/output tokens.
Claude Fable 5 remains the SWE-bench Verified leader among Anthropic models and a proven workhorse, but Claude Opus 5.5 now beats it on SWE-bench Pro and Terminal-Bench 2.1 at 40% of the cost, which pushes it down this list.
Facts: Claude Fable 5 scores 95% on SWE-bench Verified, 80% on SWE-bench Pro, 84.3% on Terminal-Bench 2.1, 85% on OSWorld, and costs $10 / $50 per 1M input/output tokens.
GPT-6 Astra is OpenAI's premium flagship. For coding specifically, GPT-6.1 Sol matches or beats it at a fifth of the price, so Astra makes sense when the same model also needs to handle hard scientific reasoning and web research.
Facts: GPT-6 Astra scores 87.3% on Terminal-Bench 2.1, 96.0% on GPQA Diamond, 95.0% on ARC-AGI-2, 91.5% on BrowseComp, and costs $10 / $50 per 1M input/output tokens.
DeepSeek-V4-Pro leads every open-source model in this ranking on both bug-fixing and competitive programming, and is MIT-licensed. It is the first model to evaluate when you need frontier-level open-weight software-engineering performance.
Facts: DeepSeek-V4-Pro scores 80.6% on SWE-bench Verified, 93.5% on LiveCodeBench, 67.9% on Terminal-Bench 2.0, and 90.1% on GPQA Diamond, and is MIT-licensed, with API access at $0.435 / $0.87 per 1M input/output tokens.
Kimi K2.6 combines strong bug-fixing with the best agentic terminal performance of any open-source model here. Choose Kimi K2.6 when autonomous terminal-agent workflows and open licensing both matter.
Facts: Kimi K2.6 scores 80.2% on SWE-bench Verified, 89.6% on LiveCodeBench, 66.7% on Terminal-Bench 2.0, and 90.5% on GPQA Diamond, and is Modified MIT licensed, with API access at $0.95 / $4 per 1M input/output tokens.
DeepSeek-V4-Flash is the cheapest model in this ranking that still clears 79% on SWE-bench Verified. Use it when price sensitivity is the top constraint and you still need frontier-adjacent bug-fixing quality.
Facts: DeepSeek-V4-Flash scores 79% on SWE-bench Verified, 91.6% on LiveCodeBench, 56.9% on Terminal-Bench 2.0, and 73.2% on BrowseComp, and is MIT-licensed, with API access at $0.14 / $0.28 per 1M input/output tokens.
At 10 million output tokens per month (a typical usage level for a 50-person engineering team using AI coding assistance):
| Model | Monthly API Cost | Headline coding score | Notes |
|---|---|---|---|
| Claude Fable 5 | ~$500,000 | 95% SWE-bench Verified | Premium tier, now beaten by Opus 5.5 on Pro |
| GPT-6 Astra | ~$500,000 | 87.3% Terminal-Bench 2.1 | Premium flagship, GPT-6.1 Sol matches on code |
| Claude Opus 5.5 | ~$200,000 | 89.9% SWE-bench Pro | Highest SWE-bench Pro in this dataset |
| GPT-6.1 Sol | ~$100,000 | 75.2% DeepSWE (vendor) | Best OpenAI coding value |
| Claude Sonnet 5.5 | ~$100,000 | 81.3% SWE-bench Pro | Best Anthropic value |
| Grok 4.6 | ~$60,000 | 95.6% SWE-bench Verified | Cheapest frontier API |
| Kimi K2.6 | ~$40,000 | 80.2% SWE-bench Verified | Best open-source agentic terminal performance |
| DeepSeek-V4-Pro | ~$9,000 | 80.6% SWE-bench Verified | Best open-source bug-fixing, MIT licensed |
| DeepSeek-V4-Flash | ~$3,000 | 79% SWE-bench Verified | Cheapest option with 79%+ SWE-bench |
| Muse Wonder Full | $50-$200 per user/mo | 79.0% DeepSWE (vendor) | Subscription only, no API |
| Your Situation | Best Choice |
|---|---|
| Strongest autonomous engineering overall | Claude Opus 5.5 (89.9% SWE-bench Pro, 87.6% Terminal-Bench 2.1) |
| Best agentic coding value | GPT-6.1 Sol ($2/M input) or Claude Sonnet 5.5 (81.3% SWE-bench Pro) |
| Highest SWE-bench Verified | Grok 4.6 (95.6%) or Claude Fable 5 (95%) |
| Best frontier performance per dollar | Grok 4.6 ($2 / $6, 95.6% SWE-bench Verified) |
| Cheapest API with strong SWE-bench | DeepSeek-V4-Flash ($0.14/M, 79% SWE-bench) |
| Best open-source, MIT license | DeepSeek-V4-Pro (80.6% SWE-bench) or Kimi K2.6 (89.6% LiveCode) |
| Interactive coding via subscription | Muse Wonder Full (Muse Code, $50-$200 per month) |
| Anthropic ecosystem, cost-optimized | Claude Sonnet 5.5 (83.2% Terminal-Bench 2.1, $10/M out) |
| Engineering use case | Recommended setup | Why |
|---|---|---|
| Individual coding assistant | Claude, GPT, or a coding-focused open model in the IDE | Fastest feedback loop for code generation |
| Team knowledge search | Onyx connected to GitHub, Jira, Confluence, Slack, and runbooks | Helps models answer with project context |
| Autonomous engineering agents | Frontier coding model plus sandboxed terminal environment | Stronger fit for bug fixing and terminal tasks |
| Regulated engineering org | Self-hosted model + Onyx self-hosted + source permissions | Keeps code and internal docs inside controlled infrastructure |
Benchmarks tell you which models are strong. The production setup determines whether those models can safely use your team's actual engineering context.
In this leaderboard snapshot, Claude Opus 5.5 has the strongest autonomous software-engineering profile, leading SWE-bench Pro at 89.9% and Terminal-Bench 2.1 at 87.6%. GPT-6.1 Sol is OpenAI's best agentic coding pick, and Grok 4.6 tops SWE-bench Verified at 95.6% with the cheapest frontier pricing. Muse Wonder Full is the strongest new entrant but is subscription-only. For open-source options, DeepSeek-V4-Pro and Kimi K2.6 are the leading choices in this dataset.
SWE-bench Verified is a benchmark where models are given real GitHub issues from popular Python projects and must autonomously write a code patch that makes the project's existing tests pass. Unlike HumanEval, which tests function-level code generation, SWE-bench tests the ability to understand entire codebases, locate relevant files, and write correct diffs. A score above 75% is considered frontier-level as of 2026.
On the benchmarks both companies still publish, Claude leads: Claude Opus 5.5 tops SWE-bench Pro (89.9% vs no published OpenAI score) and Terminal-Bench 2.1 (87.6% vs GPT-6 Astra's 87.3%). OpenAI's case rests on its own DeepSWE eval, where GPT-6.1 Sol (75.2%) edges out Claude Opus 5.5 (74.2%), and on price, where GPT-6.1 Sol costs half of Opus 5.5 per token. The right pick depends on whether you are optimizing for peak capability or cost per task.
In this leaderboard snapshot, DeepSeek-V4-Pro and Kimi K2.6 are the strongest open-source coding models. DeepSeek-V4-Pro leads on both bug-fixing and competitive programming, with 80.6% SWE-bench Verified and 93.5% LiveCodeBench under an MIT license. Kimi K2.6 is the better pick for agentic terminal work, with 66.7% Terminal-Bench 2.0, also under a Modified MIT license. Qwen3.6-27B and Hunyuan Hy3 are the top Apache 2.0 options if you need that specific license.
Related Insights
How Onyx's RAG Engine Cuts Token Usage at Enterprise Scale (2026)
Agents that read every source burn tokens on every task. Learn how Onyx's RAG engine indexes your sources once, condenses them into a vector DB, and serves enterprise context in one cheap retrieval call.
Best Enterprise RAG Platforms for 2026: A Buyer's Guide
Compare 11 enterprise RAG platforms across architecture, connectors, deployment, security, and pricing. Includes turnkey, cloud, and open-source options with current 2026 pricing and analyst data.
Best Open Source LLMs in 2026
Compare 10 open-source and open-weight language models in Onyx's October 13, 2026 leaderboard snapshot. Benchmark data, license types, and API availability for Kimi K3, DeepSeek-V4-Pro, Kimi K2.6, GLM-5.2, and more.