How agentic AI strains modern memory hierarchies
go.theregister.com
Feature: You can’t cheaply recompute without re-running the whole model – so KV cache starts piling up