The Pi 4 encoder was in hardware but that doesn't imply it was ever actually particularly fast. I'd bet the Pi 5 CPU+RAM improvements are enough to beat the hardware encoder of the Pi 4 and still have enough CPU leftover to beat the Pi 4 CPU unloaded.