While discussing Google Genie v3 and AndroidXR, Bilawal Sidhu said : "to create an even faster, lower latency pipeline to go from like 24 fps to like 100 fps. I could see that being more of an engineering problem than a research one at this point."

https://youtu.be/VslvofY16I0&t=886

Based on just about every Two Minute Papers video, the engineering/research attack the latency from both sides. The hardware grants steady improvements and an occasional paper is published with a new/improved approach that decimates the compute required.