SGLang 0.5.22
NVIDIA B300 x1 · tp1 × pp1- Speed per user (c=1)
- 95.6tok/s
- Time to first token
- 63ms
- Peak throughput
- 4,052tok/s @ 128
- Per GPU at peak
- 4,052tok/s
- Cold start
- 158s
- Context tested
- 8,192tokens
Measured 9 Nov 2026 · Throughput sweep
Measured 9 Nov 2026 · Throughput sweep
Measured 9 Nov 2026 · Throughput sweep
ModelPerf Pro