mistralai

Mistral-Small-4-119B-2603

Hugging Face

vLLM 0.32.0

NVIDIA B300 x1 · tp1 × pp1
ShareLinkedInX
Eco-friendlyFastest
Speed per user (c=1)
280.7tok/s
Time to first token
46ms
Peak throughput
9,558tok/s @ 256
Per GPU at peak
9,558tok/s
Cold start
406s
Context tested
8,192tokens

Measured 10 Nov 2026 · Throughput sweep

SGLang 0.5.22

NVIDIA B300 x1 · tp1 × pp1
ShareLinkedInX
Eco-friendlyProfitable
Speed per user (c=1)
269.6tok/s
Time to first token
81ms
Peak throughput
9,602tok/s @ 256
Per GPU at peak
9,602tok/s
Cold start
202s
Context tested
8,192tokens

Measured 10 Nov 2026 · Throughput sweep

ModelPerf Pro

What Mistral-Small-4-119B-2603 costs to run, per token and per watt

  • Cost per million tokens for every model, engine and GPU
  • Energy per million tokens, tokens per watt and GPU power draw
  • Full concurrency curves for all three workload scenarios
  • Unlimited ROI and break-even calculations with PDF export
  • CSV export of the full leaderboard, paid metrics included
  • New models and re-runs included as they are published
$39 / month, billed annually

or $49 month to month

Get ModelPerf ProSign in to buy · $10Compare plans