Remix.run Logo
alex_young an hour ago

  Someone replied. It was the exact same text the AI had given me.
How would this happen? I thought most of these things used random seeds when returning responses. I understand similar, but exactly the same seems pretty odd if 2 people use the same prompt in 2 sessions.
eddieroger 29 minutes ago | parent | next [-]

Help desks and canned replies - if a user complains about X, respond with Y. We used to just have humans do it, but turns out machines can do that bit, too, especially if the question is relatively simple or asked a lot or has an answer not up for debate.

j_w an hour ago | parent | prev [-]

I assume if they copy pasted the same question it could have been cached? It would seem wasteful for <llm_provider> to not cache responses to exact same questions with exact same context windows (fresh session).

I'm just speculating though.