While the LLM speed will increase, some stuff will be incompressible: running unit tests, tool use, UI interaction / mouse control. In my case, a significant amount of the is already spent on that, so much that I rarely ever select fast mode.