The 55.8 percent energy saving is a model output
Trace-driven simulations in arXiv:2609.39131 report 36.1 to 87.0 percent completion-time reductions when HBF extends the HBM memory hierarchy for agentic LLM serving.

Completion time drops by 36.1 to 87.0 percent when High Bandwidth Flash enters the memory hierarchy alongside HBM, per the trace-driven simulations in arXiv:2609.39131. The paper, submitted 30 September 2026, pairs an HBM-HBF-host storage stack with a buffered cache-aware scheduler aimed at agentic workloads where KV state must persist across repeated interactions. Modeled energy savings reach 55.8 percent in the best configuration.
The SemiEngineering wire frames the result as "high-throughput LLM serving," a phrase that reads as if the memory tier simply works. The arXiv document says the opposite: access costs and limited write endurance complicate the use of HBF, and the same paper concedes that HBF raises energy consumption on some light workloads. The 55.8 percent figure is the number that decides the paper's own framing, but it is a model output, not a measurement.
Die Brief reads this as a scheduling study, not a hardware characterization. No HBF capacity figure, no bandwidth number, no P/E cycle count appears anywhere in the document. A buyer evaluating HBF-equipped accelerators cannot treat the 14.82-year write lifetime as a spec entry; it is an estimate under one evaluated configuration, and the 4.77-year baseline is equally conditional. The fab question the paper leaves open is whether the buffered scheduler holds under workloads heavier than the traces it ran.
What no page measured: specific HBF bandwidth, capacity in GB, endurance in P/E cycles, the LLM model names in the serving evaluation, or the accelerator hardware details. The 36.1 to 87.0 percent range spans an unnamed workload set, and the endpoints are not tied to a named model or a named chip.
This is a scheduling study, not a hardware characterization; no HBF capacity, bandwidth, or endurance figure appears in the document. The 14.82-year write lifetime is an estimate under one configuration, not a spec a buyer can put in a procurement sheet.
The paper models energy and lifetime under trace-driven workloads but does not measure HBF bandwidth, capacity, or P/E endurance. The buffered cache-aware scheduler extends write lifetime from 4.77 to 14.82 years in one configuration; whether it holds under heavier agentic traces is untested.
36.1-87.0% completion time reduction vs HBM-only · 55.8% modeled energy savings · HBF write lifetime: 4.77 to 14.82 years · HBM-HBF-host hierarchical storage
After arxiv.org. We did not report this. The pictures, if any, are theirs.


