Observations about the platforms (DeepInfra, Soniox, OpenAI), collected while measuring models (September–November 2026). This is the state as of the given dates; platforms change, and load affects latency. Metric definitions and caveats: overview.
DeepInfra
Queue/overload of Qwen3-ASR-1.7B: for approx. 25 min 429 Model busy responses, then for approx. half an hour a queue of 114–186 s | 2026-09-29 | a single episode |
|---|---|---|
| Whisper and other models: latency depends on load, e.g. whisper-large-v3 up to 23 s for a 48 s clip; Qwen3-ASR 4–22 s for 10 min of audio and 15–27 s for 46 min | 2026-09-22 | |
| Qwen3-ASR, 20 s chunk: 50–77 s under platform load (Nemotron 1.4–3.5 s) | 2026-11-05 | normal mode and priority gave similar times |
flex tier (lowest priority): on a short query, time to first response for DeepSeek-V4-Pro went from 1.3 s to 13–20 s, for DeepSeek-V4.1-Flash from 0.8–1.0 s to 3.6–4.8 s; according to a later assessment, flex latency was 8–40 s higher than in normal mode even without a queue | 2026-09-30 | speech models (Qwen3-ASR, Whisper, Nemotron) accepted this field with no effect |
Chat models under load: Kimi-K3 HTTP 429 engine_overloaded with 4 retries over approx. 30 s; GLM-5.3-Flash 75–206 s to first token and 180 s timeouts; Kimi-K2.6 once 115 s to first token; DeepSeek-V4.1-Flash one 180 s timeout in approx. 25 calls | 2026-09-22 | |
Retired models are silently redirected to a replacement (replaced_by), so "DeepSeek-OCR" and "olmOCR" responded as google/gemma-4-31B-it, small Qwen3.5 models (0.8B–4B) as Qwen3.5-9B, and Phi-4-multimodal as gemma-3-12b | 2026-10-06 | results require checking the model field in the response |
| The cost field in the native ASR interface has inconsistent units: cents for Whisper and Voxtral, dollars for Qwen and Nemotron | 2026-09-22 | |
Images: MIME image/jpg and image/heic – HTTP 422 with a misleading message; HEIC bytes labeled as jpeg – HTTP 400 on models hosted by DeepInfra, while Gemini and Seed accept them; the documented 20 MB limit is not enforced (a 21.8 MB PNG was accepted); ByteDance Seed-2.0-mini has its own limits of 10 MiB and 36 Mpx (reported as HTTP 500) | 2026-09-22 | |
Video: the video_url part passes only the image to the model (see video-audio); audio input has a limit of 600 s per part | 2026-09-23 | |
| Prompt caching: a repeated query with the same image and prompt is sometimes billed cheaper (automatic cache hits, varying between models) | 2026-09-22 | |
| Claude (Sonnet, Opus) via DeepInfra: no reported cache hits | 2026-11-06 | see LLM text, section 6 |
Gemini models are forwarded to Google (partner flag); gemma-4-31B-it-Ultra is also a partner model | 2026-09-23 |
Soniox (live and file speech recognition)
- Limit of 10 parallel streams per organization (default); with 12 streams, 2 received 429 (2026-11-06).
- With a congested uplink (12 streams + parallel file uploads), the first result took up to 7.7 s and streams were dropped (6 at once at second 46, including 3 with
408 Request timeoutand 3 without an error; one at second 63 without an error). Without other traffic, 30 of 30 streams ran to completion. The cause was not proven (the client-side link is the most likely). - The final result (
is_final) in continuous speech arrived approx. 5.7 s after the word; the partial results are the useful ones. - Latin is not supported (a language hint including Latin gives HTTP 400 for the whole request).
- Polish recordings, two model releases:
stt-rt-v3is an alias ofstt-rt-v5; the neweststt-rt-v6gave approx. 1 point lower WER, but the first result approx. 300 ms later (ASR, section 5).
OpenAI (transcription models)
gpt-live-transcribeandgpt-realtime-whisperin live mode send text deltas without an end-of-utterance marker or word timestamps, and reject server-side voice activity detection (2026-11-06).- The
gpt-4o-*models are being shut down by OpenAI on 2027-02-26. - GPT-6 (Responses API): the temperature parameter causes error 400; changing the reasoning level between queries invalidates the cache (2026-11-06).