Renting has to support the mortgage on that. The only difference between being able to afford a house and affording rent is having the capital for a down payment

That’s not really true. Renting is significantly more affordable than buying in NYC right now. I don’t know the exact reasons, but presumably most landlords bought a long time ago and refinanced when rates were low.