Remix.run Logo
▲ bryanlarsen 5 hours ago

LLM's are better at software for several reasons:

- lots of high quality training data

- automatic verfication/scoring is straightforward

- AI companies are software companies so are better at tuning LLM's for software

- the goal is AGI, where AGI means the AI can improve itself autonomously. Which requires them to be good at software

While LLM's are uniquely good at software today, they'll get better at other fields slowly as attention goes towards training in those fields.

▲TranquilMarmot 4 hours ago | parent | next [-]

Isn't the point that there aren't many other fields that check these checkboxes? Software is very unique in that it is so easily verifiable and there is a glut of training data.

▲bryanlarsen 2 hours ago | parent [-]

No other fields check all of them, especially the last one.

The question is whether this uniqueness is going to be persistent. I think the uniqueness just makes software first. The alternate theory is that software will stay unique and that other fields won't get to the same level.

▲rokhayakebe 4 hours ago | parent | prev [-]

lots of high quality training data

This seems correct and in fields of knowledge people guard their secre, or it is not easy to extract/document knowledge, or it isn't publicly available.