>Moore's law is dying, beefy single cores are no longer keeping up.

On the other hand, there are many other things that could be done to avoid wasting all the extra power gained over the years which don't even require any parallelism boost.

Maybe, but on a 64-core machine, a single-threaded task can't even use 2% of the computer. Even interpreted Python wastes only 97% of the computer.