> One big issue I never understood is why do we need photorealism in games at all

Because WOW factor sells, specially if it's a new ip. You can see most trailers full of comments "this looks bad".