Home › Evidence › Records › cfg-0097
⚠ This notebook has stopped taking notes: newest record is 23 days old (eng-0280), against an expected cadence of 14 days.

cfg-0097

backfilled
citable URL: https://halobench.com/records/cfg-0097/ — this address never moves; the anchor /records/#cfg-0097 keeps resolving
modelQwen3.6-27B-Q4_K_M.gguf · Q4_K_M
engineggml-org/llama.cpp 3653e6d · rocm · host aihydra (igpu)
flags-ngl 999 -fa 1 -b 2048 -ub 512 -ctk f16 -ctv f16 -t 16
templatenot recorded at test time
treeupstream — stock
aged evidence — reconstructed from the archive. Ingested from llama-bench, which measures throughput and not footprint: the memory block, chat-template hash and model revision are absent by construction. Peak memory comes from a Tier 0 capability probe, not from this tool. Everything present here — build commit, backend, KV quant, batch sizes, flash attention — is machine-reported. Depths 0/32768 ran N=3 fresh-process reps (fresh server per rep, page cache not deliberately dropped between reps); 131072 ran N=1 (house convention: the number does not move at this scatter level on this box, and time is precious on a resident model). Scatter across the 3 reps was clean (max CV 1.6%, d32768 prefill; decode CV <0.02% everywhere) — no defective-path signature. No MTP/speculation possible in this GGUF: this job's own from-scratch GGUF header parser (851 tensors) found zero nextn/mtp/ eagle/medusa/draft tensors, and a live --spec-type draft-mtp load attempt refuses to start on this exact binary ("model doesn't contain MTP layers") — plain decode throughout. Output sanity gate passed before recording any throughput (chat-endpoint coherence check, "the quick brown fox" echoed correctly).

Capability basis

unmeasured — performance numbers on this config stand on a guard alone, not an established capability

Runs on this config (6)

rundatekindsuitemetrics
run-03462026-08-16performancellama-bench@1prefill_tps=357.8357
run-03472026-08-16performancellama-bench@1decode_tps=12.077
run-03482026-08-16performancellama-bench@1prefill_tps=210.512
run-03492026-08-16performancellama-bench@1decode_tps=10.8627
run-03502026-08-16performancellama-bench@1prefill_tps=95.371
run-03512026-08-16performancellama-bench@1decode_tps=8.4375

Cited by — computed at build time, never stored

model pages qwen36-27b-mtp