Remix.run Logo
jmathai 3 days ago

Never occurred to me that the response changes based on load. I’ve definitely noticed it seems smarter at times. Makes evaluating results nearly impossible.

kridsdale1 3 days ago | parent [-]

My human responses degrade when I’m heavily loaded and low on resources, too.

TeMPOraL 3 days ago | parent [-]

Unrelated. Inference doesn't run in sync with the wall clock; it takes whatever it takes. The issue is more like telling a room of support workers they are free to half-ass the work if there's too many calls, so they don't reject any until even half-assing doesn't lighten the load enough.