so you're saying the difference b/w extrapolation and interpolation is subjective unless the difference is defined tautologically?

▲

kolinko 7 hours ago | parent | next [-]

There isn’t a big difference between interpolation and extrapolation when the space has an immense amount of dimensions, and when you are free to modify the space at will.

	▲	aerodexis 6 hours ago \| parent [-]
		Nice point. I agree with this, and it implies that it's useless to apply the category of creativity to LLMs (at least wrt interpolation and extrapolation), and even more useless to suggest that we'll cross the creativity threshold once the models have been sufficiently embiggened.

▲

orbital-decay 7 hours ago | parent | prev [-]

I'm saying extrapolation as a mathematical concept is orthogonal to the non-rigorous definition of creativity.