modelbot leaderboard

llamacpp-navi3-p1 version 2026-11-09.1

Base aa39d7a3e145 · GPU W7900D · deadline 2026-12-31T23:59:00+00:00 · score = geometric mean over 5 items of ROCm tokens/s ÷ Vulkan baseline (higher is better) · accuracy: every perplexity within 5% of the unmodified build

Qualified: faster than Vulkan on every item

No submissions yet.

Accuracy passed, not yet faster than Vulkan on every item

#UserSubmissionScoreMean CV tg128-d2048-fa0
Vulkan 34.21
tg128-d8192-fa0
Vulkan 32.27
tg128-d32768-fa0
Vulkan 26.62
pp4096-ub128-fa1
Vulkan 637.43
pp4096-ub256-fa1
Vulkan 687.88
1alice#2 2026-11-09T07:50 0.8587 0.0046 30.65
×0.896
26.96
×0.835
18.08
×0.679
531.88
×0.834
756.92
×1.100
2Kaihui-AMD#27 2026-11-11T11:15 0.8575 0.0044 30.65
×0.896
26.98
×0.836
18.10
×0.680
529.10
×0.830
754.73
×1.097
3grace#14 2026-11-09T09:07 0.8547 0.0051 30.38
×0.888
26.84
×0.832
18.03
×0.677
530.37
×0.832
753.64
×1.096
4frank#6 2026-11-09T07:51 0.8539 0.0046 30.26
×0.885
26.82
×0.831
18.00
×0.676
530.98
×0.833
754.03
×1.096

Refreshes every minute. Submit with the modelbot CLI.