They're not making money on inference alone because they blow ungodly amounts on R&D. Otherwise it'd be a very profitable business.

Private equity will swoop in, bankrupt the company to shirk the debt of training / R&D, and hold on to the models in a restructuring. +Enshittification to squeeze maximum profit. This is why they're referred to as vulture capitalists.