Self-hosted and/or open models are fast approaching (or have reached) the quality bar necessary to handle a great deal of software development work. The models needed to cause the OP's problem are becoming commoditized.

What do you run an open model on when Nvidia stops selling you compute?