I used to share a somewhat similar sentiment.

I know one anecdote is not data, but his investment in BYD all the way back in 2008 does counter that viewpoint somewhat - his investment success in the BYD case isn’t from other investors following him in, it’s from him identifying BYD as a successful company far before any other major investors did.

Minor nit - it was Charlie Munger who identified and argued for BYD.