📄ArXiv AI•Apr 2, 2026Stalecollected in 17h

Independent GPT-OSS-20B Benchmark Reproduction

Post LinkedIn

📄Read original on ArXiv AI

#agent-tools #reverse-engineeringgpt-oss-20bopenai gpt-oss-20b harmonyagent

💡First independent repro of OpenAI gpt-oss-20b agent benchmarks + open harness

⚡ 30-Second TL;DR

What Changed

Reverse-engineered tools from gpt-oss-20b training distribution via prompts

Why It Matters

Validates OpenAI's gpt-oss-20b agent claims independently, boosting trust in published benchmarks. Provides open tools for community agent development and evaluation.

What To Do Next

Clone https://github.com/borislavmavrin/harmonyagent.git and test gpt-oss-20b on SWE-bench.

Who should care:Researchers & Academics

Key Points

•Reverse-engineered tools from gpt-oss-20b training distribution via prompts
•Built harmonyagent GitHub repo for native message encoding
•Reproduced OpenAI scores: SWE Verified HIGH 60.4% (pub. 60.7%), MEDIUM 53.3% (53.2%)
•Achieved 91.7% on AIME25 with tools (pub. 90.4%)

📄Read original article on ArXiv AI

📰

Weekly AI Recap

Read this week's curated digest of top AI events →

👉Related Updates

Same topic

Explore #agent-tools

Same product