Remix.run Logo
▲ SwellJoe 2 hours ago

Given the current models from Anthropic and especially OpenAI have a hard time constructing coherent English sentences that a human can understand even while being better at code and math, I'd say they're reaching that limit; can't use a model that you can't communicate with. The Deepmind folks seem to have figured something out on that front with Neon, though, as it's both smart/capable and a clear communicator.

▲bscphil an hour ago | parent [-]

I think they're probably just RLVRed into oblivion to do well at coding, because that's what 98% of their revenue comes from. That's how you get the precise language which still feels awkward and stilted, because internally the model learns to align specific peculiar expressions to precise meanings, which are useful when you're trying to write code. There's no point in using a complete sentence when you're mostly talking to yourself; the result is intelligible, just terse to the point of absurdity. (And some models, including Google's, still have a strong tendency toward flattery thanks to RLHF. Ah well...)

Just to have a shared example of AI text, this is pretty instructive I think: https://statmodeling.stat.columbia.edu/2026/11/21/by-program...

Where a human would write "by the end of the program" the model (feels like Claude to me but idk) writes "by program end". Where a human would write "There are two scheduling considerations for program hosts." the models writes "Two timing windows worth flagging."

The latter text, "two timing windows worth flagging" is highly specific and precise if you're a model keeping track of something in the docs of a repository across contexts, but it's terrible human communication.