Costs also have to include the amortized training costs.

But the API price is likely simply regular supply and demand, charging as much as the market will pay. Corporations are dropping insane amounts because it's still peanuts for many industries. Software has just been ridiculously cheap before AI. So high prices are still low for companies if it eases some bottlenecks.