I’ve not tried with 10gbps or faster links, but since we’re talking home use my success with 2.5 gbps links on standard amd64 hardware would suggest you’re wrong.

Modern CPUs are quite capable. The problem isn’t performance, but power use.