> LLMs do just interpolate their training data

"interpolate" has a technical meaning - in this meaning, LLMs almost never interpolate. It also has a very vague everyday meaning - in this meaning, LLMs do interpolate, but so do humans.

An LLM in a harness with any tools (even a calculator) doesn't just interpolate because it can reach states out of its own distribution.