Remix.run Logo
jmathai 10 months ago

Never occurred to me that the response changes based on load. I’ve definitely noticed it seems smarter at times. Makes evaluating results nearly impossible.

kridsdale1 10 months ago | parent [-]

My human responses degrade when I’m heavily loaded and low on resources, too.

TeMPOraL 10 months ago | parent [-]

Unrelated. Inference doesn't run in sync with the wall clock; it takes whatever it takes. The issue is more like telling a room of support workers they are free to half-ass the work if there's too many calls, so they don't reject any until even half-assing doesn't lighten the load enough.