SRE here, Containers are not causing any performance problem.
Maybe the perception comes from all the Mac and Windows devs having to run a Linux VM to use containers.