I still feel there is no sure shot way to build an abstraction yet. Probably that is why Loveable decided to build on Gemini AI rather than giving options of choosing model. On the other hand I like Pydantic AI framework and got myself a decent working solution where my preference is to stick with cheaper models by default and only use expensive only in cases where failure rate is too high.

This is true. Based on my experience with real customers, they really don't know what is the difference between the different models.

What they want is to get things done. The model is simply means to an end. As long as the task is completed, everything else is secondary.