Remix.run Logo
▲ thehamkercat 9 hours ago

Other providers probably don't even know/care that this is happening

▲6thbit 8 hours ago | parent | next [-]

Last year it happened to me more than once that dictating something in chatgpt would become a completely different message after processing, not in a misheard type of way but just a separate conversation more easily explained by the same type of KV cache issue here.

▲kami23 8 hours ago | parent [-]

I think in the last year I've had it happen once where I seemingly got someone else's response, it was very odd. I rewound and got what I expected. It was correlated to Anthropic's roll out of new models at the time which always seems to cause instability in their apis.

▲Orygin 6 hours ago | parent | prev | next [-]

I wonder if the chatgpt shirtless guy is from the same kind of issue

▲kolanos 9 hours ago | parent | prev [-]

Other providers might have better isolated KV stores?

▲jmalicki 6 hours ago | parent [-]

I've had this happen with ChatGPT too.