Or even have a small model check the output of the larger one.

Doesn’t work with APIs, but then the person/entity integrating the API should have that responsibility.