| ▲ | Ifkaluva 7 hours ago | |
The big labs spend a ton of effort on dataset curation. It goes further than just preventing poison—they do lots of testing on the dataset to find the incremental data that produces best improvements on model performance, and even train proxy models that predict whether data will improve performance or not. “Data Quality” is usually a huge division with a big budget. | ||