Self driving can be safer even if it's less competent because it can just be programed to be more risk adverse, always keep safe stopping distances and slow down when the conditions are adverse. A human driver _might_ be more skilled in driving through a snow storm but the self driving car just slows down and ends up safer.

Most drivers take absurd risks that negate any possible skill advantage.