Public leaderboard · Coding & software engineering
SWE-rebench
Tests AI coding tools on fresh real-world bug-fix tasks collected after models were trained, so they cannot have seen the answers.
Leaderboard
Top 3 right now
- 1stAnthropic Fable 5 [high]64.5
- 2ndGrok Grok 4.5 [high]63.8
- 3rdAnthropic Opus 5 [high]63.4
What it measures
Fresh real-world GitHub tasks collected in rolling time windows, scored by resolved rate and pass@5, with cost and tokens per problem.
How to read the numbers
Share of tasks resolved on the first attempt (%) — higher is better.
Results
17 rows · higher is better (Resolved Rate (%))CSV
Note: SWE-rebench v2, default time window 15/05/2026-01/07/2026 (111 problems). Entries without data in this window omitted. as_of is window end.
Source: SWE-rebench (Nebius) · swe-rebench.com · results as of 2026-07-01 · retrieved 2026-11-17
Markdown · More Coding & software engineering