| ▲ | mlmonkey 2 hours ago | |
I don't know how RSI aligns with DPI ("Data Processing Inequality", which states that, basically, unless you have an infinite supply of real data, you will suffer from model collapse). Models can't keep improving themselves infinitely. See, for example, https://arxiv.org/html/2601.05280v2 | ||