As a casual ML non-practicioner, what was the long-solved ML problem they ran up against?

Both “Principle 1” and “Principle 2” in the article are essentially LLM-focused details of basic principles in ML that have been known since before I (and probably you, if you’re still working age) were born.