Remix.run Logo
sippeangelo an hour ago

The harness gives the model the barbed wire fence but also the bolt cutters. I think it's a pretty apt analogy.

bonoboTP 18 minutes ago | parent [-]

The main role of the harness is not any kind of moderation or alignment, but simply making a text generation engine do anything other than output a long stream of text.

It's like saying that the role of a car's wheel is to hold wheel clamps. Yes, you can put wheel clamps (or snow chains etc) on a wheel, but the wheel's overwhelming role is to rotate and propel the car forward, and there is no driving without having wheels, you just have an engine with parts rotating inside. Bad analogy I know but, a harness is not a safety feature. Imagine that you're trying to explain cars to someone who has never seen one and you never say that the wheel's purpose is to rotate and move the car from A to B, you just say that it's something to put chains on when it snows.

I guess the name sounds like some kind of straightjacket etc. But think of it more as the harness you put on a workhorse or ox. It's the thing that connects it to the workload in the first place. They are not the blinders of the horse.