It’s true, but hosting prices are still within spitting distance of rolling it yourself.

SOTA providers are expecting some level of margin. Companies everywhere have a tight eye on their AI bills right now.

The motivation is there if the models get good enough, even if it’s more painful.