I can't imagine there's a large variation in costs per token for inference and training costs between companies, and since they're all basically doing exactly the same thing, and competing on price... yeah.

I'd agree for OpenAI and Anthropic, but Google is a different story, because they're renting TPUs to both OpenAI and Anthropic, and presumably making reasonable margins on them given how supply constrained the entire industry is.