So where are the recent improvements in LLMs proportional to the billions invested?
Value for the money is not at issue in the paper!
I believe it is. They are saying that LLMs don't improve all that much from giving them more resources - and computing power (and input corpus size) is pretty proportional to money.
It's not about value it's about the stagnation while throwing compute at the problem.
Exactly.