You just need to prerender the 3d world. If its truly exportable as a 3D model, rerendering it real time based on input is trivial