The big jump between 4 and 5 was the NVME SSD and hardware decompression IMO. Load times in a regular PS5 are non existent compared to a PS4, that's the big generational jump.

For graphics, I agree it looks like diminishing returns.