I was working 60 hours a week, plus raising small children, plus had zero construction experience, plus buying literal pieces of lumber and block paycheck to paycheck as money allowed. If you start at 18 and finish in 20 years, you are still ahead of age of median new home buyer by 2 years.

Some people have valid excuses, but most do not.