Find by task
Chat, answer & summarize
General smartness, following instructions, not making things up. Below: our own tests first, then public leaderboards with their current leaders.
Our tests
Measured by us, with caveats stated.
- Language models: classification, summaries, chat with toolsHow good are language models at everyday text jobs: sorting a text into a category, summarizing without losing facts, chatting while using tools?6 tables
- Language models: short answers, grading text, time and costShort answers, grading a written answer, and what each call costs and how long it takes.1 table
- Reasoning level (reasoning_effort): what models actually doMany models have a 'think harder' setting. Does it actually change anything, and what does it cost?3 tables
Public leaderboards
13 from labs and universities.
-
Humanity's Last Exam (HLE)
About 2,500 extremely hard questions written by experts in over 100 subjects, from classics to quantum physics, meant to sit at the edge of human knowledge. It is one of the hardest general-knowledge exams for AI.
Leader: GPT 6 Astra 54.8
-
ARC-AGI (ARC Prize)
Puzzles that most people find easy but that require spotting a brand-new pattern rather than recalling facts; the newest version (ARC-AGI-3) drops the AI into small interactive games it has never seen. It is a popular test of whether AI can genuinely learn new skills on the fly.
Leader: GPT-6 Astra - Provider Adapter (High) 99.9
-
SimpleBench
Trick questions about everyday situations, space, time and people that ordinary adults usually get right but that can trip up AI. It tests common sense rather than book knowledge.
Leader: Claude Fable 5.2 (unknown) 94.9
-
LiveBench
A set of regularly refreshed tests (agent tasks, reasoning, coding, research, design, etc.) designed so AI models cannot have seen the questions beforehand.
Leader: claude-fable-5.2 84.9
-
CritPt
Unpublished research-level physics problems written by working physicists, in areas like quantum physics and astrophysics. It tests whether AI can do the kind of reasoning needed in real scientific research.
Leader: Gemini 4 Carbon (High) 36.0
-
EQ-Bench
Tests how well AI models handle emotionally sensitive conversations with simulated people who have different personalities and needs.
Leader: claude-opus-5 1364.9
-
Context Arena (MRCR)
Hides several near-identical items in a very long conversation and asks the AI to retrieve a specific one, checking whether it can find the right detail in a huge pile of text.
Leader: openai/gpt-5.6-sol [max] 92.4
-
MultiChallenge
Tests whether an AI can hold a realistic multi-turn conversation: remembering what you said earlier, following your instructions across turns, and reasoning over the whole chat.
Leader: gpt 6.1 Sol 81.95
-
Vectara Hallucination Leaderboard
Asks AI models to summarize short documents and uses an automated checker to count how often the summary adds things that are not in the original text. It shows how likely a model is to make things up when it should just be faithful to a source.
Leader: antgroup/finix_s1_32b 1.8 %
-
AA-Omniscience
Tests how much factual knowledge an AI really has across 42 topics, and punishes it for confidently making things up instead of saying 'I don't know'. A score of 0 means as many wrong as right answers.
Leader: Claude Fable 5.2 (Max, Default Fallback) 67
-
Arena (formerly LMArena / Chatbot Arena)
Real people type a question, get two anonymous answers from different AI chatbots, and vote for the better one. Millions of these votes are turned into a ranking of which chatbots people prefer.
Leader: Gemini 4 Carbon (High) 1526
-
Design Arena
People ask several AI models to build the same thing, such as a website, game or slide deck, then vote on which result looks and works better. The votes become a ranking of which models are best at making designs and apps.
Leader: Claude Opus 5.5 (high) 1445
- Artificial Analysis Image & Video Arenas People are shown two AI-made pictures (or videos) for the same request without knowing which model made them, and pick the better one. The votes become a ranking of image and video generators.