The text returned by the tool itself makes it not "next token prediction". Aside from having side effects, the reason it's helpful is that it's out of distribution for the model. So it changes the properties of the system.

This is true of the system as a whole, but the core neural network is still a next-token predictor.

Ah ok, understood what you meant.