You can have the best of both worlds if you use structured/constrained generation.