> Bringing up the KV cache is a sign you don't understand what you are talking about here. The KV cache is a computational efficiency thing and has no impact on how these models actually work (and isn't needed at all). The vague analogy to human working memory also just takes the cake here.

You seem to really like to tell people that they don't know what they're talking about more than you seem to be parsing what they're actually saying.

I remember when I used to look for reasons to pounce on people for not knowing what they were talking about based on a superficial thing or two rather than try to understand what they were saying. I mostly got past it as a teenager, though.

Except you clearly don't understand anything you are talking about, and neither does GP. People like you have seriously degraded the value of HN because you pontificate ignorantly and incoherently about topics. That needs to be called out.