Find by task
Polish & other languages
How models do outside English. Below: our own tests first, then public leaderboards with their current leaders.
Our tests
Measured by us, with caveats stated.
- ASR: Polish speech recognitionHow well do speech-to-text models write down spoken Polish — including Polish mixed with English, noisy rooms and live speech?8 tables
- Embeddings: retrieval accuracy in PolishEmbeddings power search: they turn text into numbers so similar texts can be found. Which models find the right Polish note?1 table
- OCR: handwritten notes, boards and textbook pagesWhich AI models can read handwritten notes, whiteboards and textbook pages from a photo — including Polish letters, formulas and small numbers?7 tables
Public leaderboards
4 from labs and universities.
-
EuroEval
Tests how well AI language models understand and write in more than 30 European languages, across many kinds of tasks. It matters because most AI tests are English-only.
Leader: gpt-6-astra (zero-shot, val) 1.17 ± 0.05
-
CPTU-Bench
Checks how well AI models really understand Polish: reading between the lines (sarcasm, hidden meaning, idioms) and answering tricky questions with logic traps, ambiguity or absurd premises. It shows whether a model grasps Polish beyond the literal words.
Leader: meta-models/Muse-Glimmer-30B reasoning (API, FP8) 4.42
-
Polish Linguistic and Cultural Competency (PLCC)
600 hand-written questions about Polish history, geography, culture and traditions, art and entertainment, grammar and vocabulary. It shows how well an AI model knows Poland and the Polish language, not just how fluent it sounds.
Leader: Gemini-4-Carbon 98.33
-
PL-MTEB (Polish MTEB)
Tests how well "embedding" models (the part of AI search that turns text into numbers so similar meanings can be found) work on Polish text, on tasks like finding similar sentences, sorting reviews and grouping documents.
Leader: codefuse-ai/F2LLM-v2-14B 75.13