You can fall ill or need working accommodations regardless of whether you are above or below average.

And you can more easily take care of those needs yourself if you aren't required to subsidize your below average colleagues.