Remix.run Logo
FeepingCreature 3 hours ago

This is all obvious and not news, but there's a lot of people doing fighting retreats against LLM intelligence where the degree of obviousness matters.

XenophileJKO 29 minutes ago | parent [-]

Anticipatory token selection was obvious when you used structured output on gpt 3.5.

The model would construct/hallucinate pre-conditions to satisfy some final output value that the model was predisposed to.