← Back to Home
August 11, 2026
Prefill is compute-bound, decode is memory-bound, and MoEs make everything more interesting: modelling LLM inference speed from compute, memory, and communication.
Design and source code from Jon Barron's website