Remix.run Logo
▲ Grimblewald 3 hours ago

I dunno, I never sense nerfs for local models, but consistently a few months after launch for corpo hosted models, seems odd my internal model for the capacity of a model drifts for anthropic models but not local ones. I've been using LLMs heavily even before ada/babbage/davinci days, and trust my internal calibration over baseless handwavey explanations for why im imagining things, especially when I have data that shows capacity regression on frontier models for tasks, e.g. one shot success at loss, 0 success in 15 attempts once nerf is sensed. Others publish their quantified capability regressions which are also more trust worthy than this kind of handwaving.

▲eulgro 2 hours ago | parent [-]

Your comment makes no sense. How and why would a local model be nerfed anyway...?

▲r_lee 2 hours ago | parent [-]

he's saying that he notices a difference between local (not nerfable) and hosted ones, so that it's not as likely to be just placebo

▲jacquesm 28 minutes ago | parent [-]

That and 'loss' may have been intended to be 'launch'.