| ▲ | addaon 11 hours ago | |||||||
Suppose two models with similar parameters trained the same way on 1800-1875 and 1800-2025 data. Running both models, we get probability distributions across tokens, let's call the distributions 1875' and 2025'. We also get a probability distribution finite difference (2025' - 1875'). What would we get if we sampled from 1.1*(2025' - 1875') + 1875'? I don't think this would actually be a decent approximation of 2040', but it would be a fun experiment to see. (Interpolation rather than extrapolation seems just as unlikely to be useful and less likely to be amusing, but what do I know.) | ||||||||
| ▲ | pvab3 10 hours ago | parent [-] | |||||||
What if it's just genAlpha slang? | ||||||||
| ||||||||