The more fundamental reason is Amdahl's law

https://en.wikipedia.org/wiki/Amdahl%27s_law

Even a tiny bit of serial instruction will limit the speed up