| ▲ | int_19h a day ago | |
Models have been trained on synthetic inputs for over a year now. Collapse only happens in very specific circumstances, it's not a limit in practice. | ||
| ▲ | johnsmith1840 11 hours ago | parent [-] | |
Yeah, that's why fully autonomous robots are so easy to train on novel tasks. Or why figure is strapping cameras to human workers for cleaning. Sythetic data works in a bounded box we have mapped you can't just make up novel data and it works. Model collapse is completely unsolved. | ||