AI wouldn't be intelligent though if it was deterministic. It would just be information retrieval

It already is "just" information retrieval, just with stochastic threads refining the geometry of the information.