How powerful is the device you wrote this comment from? On prem or self hosted affordable inference is inevitable.