Some are doing model inference.

https://wallaroo.ai/optimizing-ai-inference-and-governance-w...