Home › Evidence › Records › cfg-0094

cfg-0094

backfilled
citable URL: https://halobench.com/records/cfg-0094/ — this address never moves; the anchor /records/#cfg-0094 keeps resolving
modelOrnith-1.0-35B-Q8_0.gguf · Q8_0
engineggml-org/llama.cpp 3653e6d · rocm · host aihydra (igpu)
flags-ngl 999 -fa 1 -b 2048 -ub 512 -ctk f16 -ctv f16 -t 16
templatenot recorded at test time
treeupstream — stock
aged evidence — reconstructed from the archive. Ingested from llama-bench, which measures throughput and not footprint: the memory block, chat-template hash and model revision are absent by construction. Peak memory comes from a Tier 0 capability probe, not from this tool. Everything present here — build commit, backend, KV quant, batch sizes, flash attention — is machine-reported. llama-bench's own -ctk/-ctv fields report f16 by default (no override passed on the command line; matches this candidate's 2026-08-16 screen, cfg-0093). Depths 0/32768 ran N=3 fresh-process reps (fresh server per rep, page cache not deliberately dropped between reps -- see queue.log); 131072 ran N=1 (deepseek-v4-flash/laguna-s21 convention: the number does not move at this scatter level on this box, and time is precious on a ~35-37GB resident model). Scatter across the 3 reps was clean at every depth (max CV 0.9%, d0 prefill) -- no defective-path signature. No MTP/speculation: this job's own from-scratch GGUF header parser (no numpy/gguf-py dependency available on-box) read all 733 tensor names directly and found zero nextn/mtp/eagle/medusa/draft tensors -- plain decode throughout. Output sanity gate passed before recording any throughput (chat-endpoint coherence check, 'the quick brown fox' echoed correctly).

Capability basis

unmeasured — performance numbers on this config stand on a guard alone, not an established capability

Runs on this config (6)

rundatekindsuitemetrics
run-03322026-08-16performancellama-bench@1prefill_tps=865.2773033333333
run-03332026-08-16performancellama-bench@1decode_tps=47.66080566666667
run-03342026-08-16performancellama-bench@1prefill_tps=525.1902023333333
run-03352026-08-16performancellama-bench@1decode_tps=39.74861766666667
run-03362026-08-16performancellama-bench@1prefill_tps=244.843425
run-03372026-08-16performancellama-bench@1decode_tps=27.484236

Cited by — computed at build time, never stored

model pages ornith-35b