Remix.run Logo
▲ MrMetric a day ago

I believe the intended analogy is something like: Training on highly blurred or degraded images, with the baseline targets also being malformed but not as badly. Then, run the result on those baseline images and see if we get something better than any image we currently know how to capture.

With LLM-based AIs, we don't actually have any ground-truth oracle for maximum-quality examples. We don't even know how to measure relative quality accurately, and even if we did, different people disagree anyway. For example, a corporation may want their AI to be "aligned", like how older versions of ChatGPT claimed large language models can't do math (lol), or how Claude won't tell you how to make thermite even though it's widespread knowledge and you can get it from Wikipedia. Maybe you don't want that kind of behavior. And maybe your friend just wants an AI that's really good at ERP and doesn't care how well it can do math.

But even if we can't measure quality, we can attempt to break things and use the broken sample as a training target (the blurry degraded image) against the baseline (a common low-res image with lots of JPEG artifacting). And maybe that'll make something that learns how to repair LLMs so well that something useful or interesting happens. Or maybe it'll just hallucinate faces where the JPEG noise was ¯\_(ツ)_/¯