Remix.run Logo
bensyverson 2 days ago

> models don't have a good sense of their own capabilities.

It actually had some memorized knowledge about LLMs being bad at confidence intervals, then it did a cursory web search. But it didn't need to do any of that; I already knew they would be bad numbers.