| ▲ | bigfishrunning a day ago | |||||||||||||||||||||||||
Whose data did they use to train these models? did they compensate everyone for the data they used? Big AI has committed piracy on a massive scale, and they've gotten away with it. | ||||||||||||||||||||||||||
| ▲ | dash2 a day ago | parent | next [-] | |||||||||||||||||||||||||
I think the argument "they trained models on publicly available data, I think that's stealing, so therefore I am certain they are going to steal everything else, including training on customers' data when the customers have explicitly opted out of this, violating their contract and permanently destroying their own reputation if they get caught" is not a good one, and should probably stop being made. I don't even think the argument works if it starts "they committed genuine piracy which was commonly known to be illegal at the time". | ||||||||||||||||||||||||||
| ▲ | rcxdude 20 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||
Just to be clear, the difference between the older models and the newer models in terms of mathematics ability is not from having trained on even more papers, but by reinforcement learning on the act of proving theorems. Anthropic now spends about as much on this training phase as on the 'pretraining' with the masses of scraped or scanned data. This doesn't mean it's not still essential, but it's far from the entirety of the result either. | ||||||||||||||||||||||||||
| ▲ | WarmWash a day ago | parent | prev | next [-] | |||||||||||||||||||||||||
I feel like using the term "Piracy" to describe training on public data is a bit of a stretch. | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
| ▲ | suddenlybananas a day ago | parent | prev [-] | |||||||||||||||||||||||||
I agree but that's a separate issue. | ||||||||||||||||||||||||||