1985 status

                api         latency       speed    1k tok   failed  source
coreweave ok    responses     269ms   201 tok/s    5244ms        -  bench
crusoe    ok    responses     324ms   311 tok/s    3540ms        -  bench
nebius    off
together  ok    responses     397ms   202 tok/s    5347ms        -  bench
fireworks ok    responses     873ms   119 tok/s    9277ms        -  bench
baseten   ok    responses     399ms   119 tok/s    8803ms        -  bench

latency: time to first token. speed: output tokens per second. 1k tok: predicted time for a 1000 token reply.
live: fitted to traffic of the last few minutes. bench: the last benchmark, 2026-10-21T20:44:15.866Z.