Tests whether an AI can hold a realistic multi-turn conversation: remembering what you said earlier, following your instructions across turns, and reasoning over the whole chat.
Leaderboard
Top 3 right now
1stgpt 6.1 Sol81.95
2ndGemini 4 Argon78.70
3rdMuse Spark75.52
What it measures
Multi-turn conversations that test retaining instructions, using earlier context, handling edits and staying self-consistent, graded by an LLM judge with rubrics.
How to read the numbers
Share of multi-turn conversation test cases answered correctly (%), with a 95% confidence margin — higher is better.
Note: Rank is rank-by-upper-bound (ties possible). Scored by an LLM judge (Gemini 2.5 Pro since Feb 2026). Model names as published; terms of reuse not stated on page.
Source: Scale AI (Scale Labs) · labs.scale.com · results as of 2026-11 (entries tagged NEW; judge update Feb 3, 2026) · retrieved 2026-11-17