TL;DR Only 4 out of 128 dimensions in the KV cache carry meaningful signal. The other 124 are noise. This holds across six models in four families. Removing error correction on those noise dimensions