It's separate from the welfare angle, but there absolutely is a trend of deteriorating workforce/education participation for men. Male labor force participation has fallen sharply over the long run, and the long-run decline is concentrated among men without four-year degrees.

How does something fall sharply over the long run?