No, he's saying the government should get out of deciding what to build and make it legal to build so that people build more housing, of any type, period. "Just buy a house outside of an urban core" is only possible if such housing exists.

There are reasons to have some kind of building rules. Noice, smell and shade are valid reasons to limit certain types of buildings (or activities within those buildings).