Your file is read in this browser tab only. It is never uploaded or added to community rankings, and is cleared when you reload.
Or paste a packaged result
All differences are measured against this run.
Everything matches: the same model, weights, quantization, workload, runtime, placement and transport. Only these can be ranked against each other.
Ranking is stricter than looking. The leaderboard below only ever ranks runs of the same declared workload, whatever is chosen here.
MATCHING WORKLOAD
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
Q4_K_M · chat-small-v2
What makes a comparison compatible?
Model, weights source, immutable revision, quantization, profile ID and checksum, and GuideLLM version must match. So must the transport, the serving arrangement, whether the weights were split across CPU and GPU, and the tokenizer that counted the tokens: a run measured through the Windows–WSL bridge carries that bridge's latency inside every number, and token counts are the counts of whichever tokenizer produced them. Hardware, operating systems and runtime settings may differ. This compares complete setups, not the effect of one isolated component, and token rates across different models do not describe the same semantic work.
Windows–WSL bridge · its latency is inside every number here
Tokenizer
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B · loaded before the run
02 / BUILD YOUR COMPARISON
Your reference is ready.
0 compatible runs
No other compatible runs are available in this build. Your measurements are shown below. Community comparisons appear after matching evidence is submitted, reviewed and included in a website build.
4 runs excluded from direct comparison
1× AMD Radeon RX 9070 · 16 GB eachDifferent model · Different weights revision · Different or unrecorded tokenizer source
1× AMD Radeon RX 9070 · 16 GB eachDifferent model · Different weights revision · Different or unrecorded tokenizer source
1× AMD Radeon RX 9070 · 16 GB eachDifferent model · Different weights revision · Different or unrecorded tokenizer source
Aggregate output throughput over the measured window, not peak single-request decode speed.
HOW RESPONSIVE DOES IT FEEL?
A closer look at latency.
p50 is the median. p95 describes the slower end of observed latencies.
RESPONSE TIME
First token, p50
↓ Lower is better
0643.7 ms
1× AMD Radeon RX 9070 · 15.92 GB eachReference643.7 ms
Reference measurement
Final measured-window latency. Each chart has its own zero-based scale.
STREAMING SMOOTHNESS
Between tokens, p50
↓ Lower is better
016.4 ms
1× AMD Radeon RX 9070 · 15.92 GB eachReference16.4 ms
Reference measurement
Final measured-window latency. Each chart has its own zero-based scale.
SAME DECLARED WORKLOAD
Community run leaderboard
1 matching runs
Ranks apply only to the matching runs and hardware filters below. Repeat runs count separately, this is not a ranking of unique machines or people. Private files are excluded.
Output throughput · Higher is better · chat-small-v2