But power hungry.

In that 5+ year timeline, the compute per watt could change by three orders of magnitude.

GPUs are to LLMs what CPUs are to gaming — not a good fit.