I am in a suburb that's closest to NYC without being a part of the city.

I grew up in a place like that (Port Washington, NY), and it was pretty ideal; I'm raising my own two kids in a suburb of Boston that feels very, very similar along almost every axis.