Manifold vs space - yes, I meant manifold, english is not my first language and I missed this word.

The argument stands.

Interpolation vs extrapolation? It's very simple distinction and fundamental. Look at ARC-AGI-3 for empirical evidence, if that's important to you. My point however is purely an a priori one.