Certain types of (numerical) problems are very parallel in nature. LLMs, for example. But obviously not every problem is. And sometimes a parallel solution isn't the most efficient.

https://en.wikipedia.org/wiki/Embarrassingly_parallel