cfg-0097
backfilled
citable URL: https://halobench.com/records/cfg-0097/ — this address never moves; the anchor /records/#cfg-0097 keeps resolving
| model | Qwen3.6-27B-Q4_K_M.gguf · Q4_K_M |
| engine | ggml-org/llama.cpp 3653e6d · rocm · host aihydra (igpu) |
| flags | -ngl 999 -fa 1 -b 2048 -ub 512 -ctk f16 -ctv f16 -t 16 |
| template | not recorded at test time |
| tree | upstream — stock |
aged evidence — reconstructed from the archive. Ingested from llama-bench, which measures throughput and not footprint: the memory block, chat-template hash and model revision are absent by construction. Peak memory comes from a Tier 0 capability probe, not from this tool. Everything present here — build commit, backend, KV quant, batch sizes, flash attention — is machine-reported. Depths 0/32768 ran N=3 fresh-process reps (fresh server per rep, page cache not deliberately dropped between reps); 131072 ran N=1 (house convention: the number does not move at this scatter level on this box, and time is precious on a resident model). Scatter across the 3 reps was clean (max CV 1.6%, d32768 prefill; decode CV <0.02% everywhere) — no defective-path signature. No MTP/speculation possible in this GGUF: this job's own from-scratch GGUF header parser (851 tensors) found zero nextn/mtp/ eagle/medusa/draft tensors, and a live --spec-type draft-mtp load attempt refuses to start on this exact binary ("model doesn't contain MTP layers") — plain decode throughout. Output sanity gate passed before recording any throughput (chat-endpoint coherence check, "the quick brown fox" echoed correctly).
Capability basis
unmeasured — performance numbers on this config stand on a guard alone, not an established capability
Runs on this config (6)
| run | date | kind | suite | metrics |
|---|---|---|---|---|
| run-0346 | 2026-08-16 | performance | llama-bench@1 | prefill_tps=357.8357 |
| run-0347 | 2026-08-16 | performance | llama-bench@1 | decode_tps=12.077 |
| run-0348 | 2026-08-16 | performance | llama-bench@1 | prefill_tps=210.512 |
| run-0349 | 2026-08-16 | performance | llama-bench@1 | decode_tps=10.8627 |
| run-0350 | 2026-08-16 | performance | llama-bench@1 | prefill_tps=95.371 |
| run-0351 | 2026-08-16 | performance | llama-bench@1 | decode_tps=8.4375 |
Cited by — computed at build time, never stored
model pages qwen36-27b-mtp