Observations about platforms (DeepInfra, OpenAI, Google), collected during model measurements (September–October 2026). This is the state on the stated dates; platforms change, and load affects latency. Caveats: overview.
DeepInfra
The Qwen/Qwen3-VL-235B-A22B-Thinking variant was served by the Instruct model: 0 reasoning tokens in the response, at a rate approx. 2× higher than for Qwen3-VL-235B-A22B-Instruct | 2026-09-03 | worth checking the model field and the number of reasoning tokens in the response |
|---|---|---|
With missing balance, every call (including partner models, e.g. Gemini, and a request for 1 token) ends with HTTP 402 You need positive balance to do inference. Please add balance manually or setup top-up | 2026-10-13 … 2026-10-16 | the state lasted at least 3 days; the balance ran out during a series of approx. 140 test calls (cause unconfirmed) |
A model name that does not exist gives HTTP 404 model_not_found even with zero balance, while an existing name gives 402; so the response code tells you whether the model exists | 2026-10-16 | 3 names checked |
/v1/openai/models returned 180 models; google/gemma-4-E4B-it was not on the list, but the name was recognized (402, not 404), and in September the model responded normally | 2026-10-16 | the list is not a complete inventory of callable models |
deepseek-ai/DeepSeek-V4-Flash (undated name): approx. every second request HTTP 429 engine_overloaded "Model busy, retry later", a retry after a second usually went through; deepseek-ai/DeepSeek-V4-Flash-0731 (dated) responded every time in 1.2–2.3 s | 2026-10-13 | 12 + 6 calls; details in LLM text, section 1 |
429 with engine_overloaded / "Model busy" in the body means overload of the model pool, not an account limit; 429 with a body about the request rate limit, and 402, are account limits | 2026-10-13 | distinguishable only by the error body |
Gemini (google/gemini-3.1-pro) bills reasoning tokens that are not in completion_tokens; the cost from the token price list came out approx. 13× too low compared with estimated_cost | 2026-09-17 | reading pages from photos, 5 photos |
Automatic prompt caching: with a repeated prompt of approx. 5.7 thousand tokens, DeepSeek-V4-Flash-0731 returned cached_tokens 5632 and an approx. 3.6× lower cost | 2026-10-13 | without any parameter in the request |
Gemini and Claude (anthropic/*) models are available through the same DeepInfra key (forwarded to Google / Anthropic) | 2026-09-13, 2026-10-16 | |
The anthropic/claude-opus-5-5 model page does not document support for temperature, reasoning_effort or response_format in the OpenAI-compatible API (the example contains only max_tokens) | 2026-10-16 | live behavior not checked (402) |
Prices from /v1/openai/models (2026-10-16)
USD per million tokens. "cache" = cache read, if given. Tags from the same list.
| anthropic/claude-fable-5 | 10.00 | 50.00 | – | chat, vlm, vision, reasoning_effort, reasoning |
|---|---|---|---|---|
| anthropic/claude-opus-5-5 | 4.00 | 20.00 | 0.20 | chat, vlm, vision, prompt_cache, reasoning_effort, reasoning; context 1000000 |
| anthropic/claude-sonnet-5-5 | 2.00 | 10.00 | – | chat, vlm, vision, reasoning_effort, reasoning |
| moonshotai/Kimi-K3 | 2.85 | 14.25 | 0.285 | chat, vlm, vision, prompt_cache, reasoning |
| google/gemini-3.1-pro | 2.00 | 12.00 | – | chat, vlm, vision, reasoning_effort, reasoning; context 1000000 |
| deepseek-ai/DeepSeek-V4-Pro-0813 | 1.30 | 2.60 | 0.10 | chat, prompt_cache |
| google/gemini-3.5-flash | 1.50 | 9.00 | – | context 1000000 (tags not read) |
| google/gemini-3.7-flash | 0.75 | 3.75 | – | chat, vlm, vision, reasoning_effort, reasoning |
| deepseek-ai/DeepSeek-V4-Flash-Vision-Exp | 0.44 | 1.32 | 0.014 | chat, vlm, vision, prompt_cache, reasoning |
| Qwen/Qwen3-VL-235B-A22B-Instruct | 0.20 | 0.88 | 0.11 | chat, vlm, vision, prompt_cache, reasoning_effort |
| google/gemma-4-31B-it | 0.20 | 0.40 | – | chat, vlm, vision, reasoning |
| Qwen/Qwen3.6-35B-A3B | 0.10 | 0.95 | 0.10 | chat, vlm, vision, prompt_cache, reasoning_effort, reasoning |
| google/gemma-4-26B-A4B-it | 0.07 | 0.34 | – | chat, vlm, vision, reasoning; context 262144 |
| deepseek-ai/DeepSeek-V4-Flash-0731 | 0.06 | 0.18 | 0.015 | chat, prompt_cache, reasoning |
Note: list prices do not cover reasoning tokens that are not visible in completion_tokens (see above), so the real cost can be higher.
OpenAI
gpt-5:reasoning_effort: "minimal"is accepted but gives 0 reasoning tokens (2026-09-03).gpt-5.6(terra,sol): theminimalvalue is rejected; the lowest accepted level islow(2026-09-03).gpt-5.6-terra/gpt-5.6-solwith an output limit of 2000 tokens and the lowest reasoning level returned empty content; a limit of approx. 6000–8000 was needed (2026-09-03).- See Reasoning, section 1.
Google Cloud Document AI (Enterprise Document OCR)
- No accuracy or timing measurements in the sources. Billing per processed page (documentation, not measured).
- Qualitative observation: the OCR returns all the text in the area, including the printed text of the exam sheet, so the reading of the area around a student's answer can be several times longer than the answer itself (see OCR, section 7).