> many people are so risk averse in general that they don't invest in the stock market

You have to be doing pretty well compared to the average person before investing in the stock market is even a consideration. Most people, if they had any surplus income, would use it to pay off debts or save against emergencies.