SIMPLE law predicts quadratic prefill cost
DEV · 15.11.2026 · 06:00
"prefill energy grows quadratically with the hidden dimension, so larger LLMs suffer most from long inputs;" [1]. That closed‑form observation collapses years of ad‑hoc profiling into a…