Measurements of whether a given reasoning_effort value produces real reasoning tokens, and what it costs. "Reasons" = the response reports a non-zero number of reasoning tokens (reasoning_tokens or a separate field with the reasoning content). Samples are small: a few calls per model, on tasks of grading students' answers and giving hints for exam tasks. Caveats: overview.
1. The minimal value on different models (2026-09-03)
deepseek-ai/DeepSeek-V4-Pro (-0813) | DeepInfra | Y | Y | the only model in the test that actually reasoned on minimal |
|---|---|---|---|---|
deepseek-ai/DeepSeek-V4-Flash (-0731) | DeepInfra | Y | N | response longer than without the parameter, but 0 reasoning tokens; reasons only from low |
| gpt-5 | OpenAI | Y | N (0 reasoning tokens) | lowest level with real reasoning: low |
gpt-5.6 (variants terra, sol) | OpenAI | N (value rejected) | – | lowest accepted level: low |
| anthropic/claude-opus-5-5 | DeepInfra | per Anthropic documentation, N (lowest is low) | – | not measured live (on 2026-10-16 the account returned 402) |
2. Cost of reasoning
| deepseek-ai/DeepSeek-V4-Flash | hint for an exam task, with reasoning (low) vs without | 2026-09-03 | a few calls | with reasoning 7.3× more expensive than without |
|---|---|---|---|---|
| deepseek-ai/DeepSeek-V4-Pro | the same task, with reasoning, compared with DeepSeek-V4-Flash without reasoning | 2026-09-03 | a few calls | approx. 40× more expensive |
| deepseek-ai/DeepSeek-V4-Pro (model reconstructed from change history) | grading a short open answer worth 2 points, with reasoning | 2026-09-03 | 1 task | 1914 reasoning tokens, 3.38 gr (1 gr = 0.01 PLN), i.e. roughly the same as grading an essay worth 20 points |
Observation: the cost of reasoning hardly depends on the length of the task. A short answer worth 2 points used a similar number of reasoning tokens as a long essay.
3. Reasoning and the output token limit
| gpt-5.6-terra / gpt-5.6-sol | lowest accepted reasoning level, output limit of 2000 tokens, task with a photo | 2026-09-03 | empty response: reasoning used up the whole limit before the model wrote a single character; a limit of around 6000–8000 was needed |
|---|---|---|---|
| Qwen/Qwen3-VL-235B-A22B-Instruct | reasoning low, reading a page from a photo | 2026-09-13 | reasoning tokens count toward the same limit as the response, so the limit has to be raised (approx. +1500 tokens was adopted); this is an assumption based on the behavior of other models, an empty response from Qwen was not recorded |
Qualitative observation (2026-09-13, no numbers): Qwen3-VL-235B with low reasoning confused smudged boxes and crossed-out answers less often than without reasoning. This was not measured on a set with a reference.
4. Billing of reasoning tokens
With google/gemini-3.1-pro (DeepInfra → Google), reasoning tokens are billed but not included in completion_tokens. The cost calculated from the price list and completion_tokens came out approx. 13× too low compared with estimated_cost (2026-09-17, reading a page from a photo, 5 photos).