Research·3 min read
By BitsMindsSource: NVIDIA Technical Blog

Nvidia AVO Hits 100% on ARC-AGI-3 Using Claude Opus 5

Nvidia’s agent architecture cleared all 183 levels of the ARC-AGI-3 interactive reasoning benchmark with a perfect action-efficiency score — wrapped around Claude Opus 5, which manages roughly 30% on its own. The claim is about the harness, not the model, and it carries a caveat: public set only.

ARC-AGI-3 100.00 183/183 LEVELS BITSMINDS.COM
Share:

NVIDIA published results on Friday showing that AVO — Agentic Variation Operators — cleared every level of ARC-AGI-3, the ARC Prize Foundation’s interactive reasoning benchmark. All 183 levels, all 25 public environments, and a 100.00 on the benchmark’s Relative Human Action Efficiency metric, spending 6,624 environment actions to do it. VISTA, the previous leader, needed 7,542 for the same levels — about 12% more.

The notable part is what AVO is not. It is not a new model. NVIDIA wrapped Claude Opus 5 in its own agent architecture and left the weights alone. ARC Prize measures bare Opus 5 at roughly 30% on the same benchmark at high reasoning effort, which is the standing model record. The gap between 30% and 100% is, on NVIDIA’s telling, entirely scaffolding. “The model matters, but the model is not the entire agent,” the authors write; long-horizon capability, they argue, is a property of the full system.

What the scaffolding does is unglamorous. A persistent memory carries forward past implementations, evaluation results and compiler and profiler output so the agent stops relitigating dead ends. A supervision layer watches the search trajectory and redirects the agent toward a different strategy when progress plateaus. Tooling swaps per environment — code execution for GPU work, game interactions for ARC-AGI-3 — around the same hypothesise-act-observe-revise loop. ARC-AGI-3 is a hard target for this because it drops an agent into game-like environments with no instructions, no stated rules and no goal, so there is nothing to pattern-match against.

AVO was not built for benchmarks. It came out of GPU kernel optimisation, where NVIDIA ran it continuously for seven days across more than 500 optimisation directions and 40 committed kernel versions. On DGX B200 systems its evolved kernels beat cuDNN by up to 3.5% and FlashAttention-4 by up to 10.5%. That domain gives brutal, hardware-grounded feedback on every iteration, which is exactly the signal a long-horizon agent needs and exactly what most agent benchmarks lack.

NVIDIA is unusually direct about the limits. The results cover the public set under official scoring, not the semi-private or private competition sets that exist precisely to catch overfitting. The VISTA comparison is not a controlled ablation — the two systems differ in backend, observation representation and memory design. No experiment isolates what the memory layer alone contributes. Tests with GPT-5.6 Sol on limited subsets were preliminary, though they showed a complementary profile: faster wall-clock times, more environment actions. AVO itself is a research demonstration with no commercial availability announced.

Those caveats matter more than usual on this particular benchmark. A month ago OpenAI reported a tripled ARC-AGI-3 score and ARC Prize replied that a different harness is a different test — which is the same ambiguity AVO now sits inside, only pushed to the ceiling. If a wrapper can take a model from 30 to 100 on the public set, the benchmark is measuring systems, and system-versus-system results need the private set to mean anything. The useful takeaway is narrower and sturdier: the harness is where the remaining capability is hiding, which is why agent harnesses keep getting published as products rather than implementation details.

More on Claude

Evergreen coverage we keep current — start here.

Want AI news before everyone else?

The morning's most important AI stories, straight to your inbox. No fluff.

Related Articles

OpenAI publishes 722 maths papers from an unreleased model An original monochrome still life on a pale grey desk. A tall stack of bound manuscripts is topped by a graphite cover with the OpenAI mark pressed into it and a small green seal with a tick. A loose page in front shows a line of number theory. Text on the left reads OPENAI · MATHEMATICS, 722 papers from one unreleased model, 372 families and 162 Lean-checked. The stack is an editorial metaphor; the tick marks Lean formalization, not independent peer review. BitsMinds original editorial vector artwork for openai-722-math-papers-internal-model. Figures verified on 7 October 2026 from github.com/openai/math (README, overview.tex, lean/formalization.yaml). Official OpenAI path from public/logos/openai.svg. L(s, χ) ≠ 0 for Re s > 7/8 OPENAI · MATHEMATICS 722 papers from one unreleased model 372 FAMILIES 162 LEAN-CHECKED BITSMINDS.COM
Research

OpenAI Posts 722 Math Papers From an Unreleased Model

Mythos cracks Rejetto HFS's random signing key A large ivory die on a cream field, the official Anthropic mark inlaid in clay on its front face. Its top face has split along a crack, and a brass key is rising out of it: the session signing key recovered from Math.random. Faint leaked random numbers drift in from the left; faint cookie fragments sit on the right. 0.73418 0.11902 0.58361 0.92047 0.30775 admin=1 sig:9f3c keygrip xs128+ BITSMINDS.COM
Research

A Bug Claude Mythos Found Was Exploited Within a Day

Meta Muse Spark's six math papers A fan of research manuscripts on a deep blue field. Five sheets behind carry gold check marks for the five open problems answered; the front sheet carries the official Meta mark, inlaid. Faint mathematical symbols float on either side. ∫ ∑ ψ |G| = 384 ∂ₜu λ ≥ 0 ℚₚ ≠ MUSE SPARK · THINKING 6 PAPERS · 5 OPEN PROBLEMS BITSMINDS.COM
Research

Meta Says Muse Spark Helped Crack Five Open Math Problems