<< Believing this feels incredibly unwise to me.

This. Just thinking that those with power would even allow that leveling seems on the verge of impossible. In a sense, you can already see it practice. Online models are carefully 'made safe' ( neutered is my preferred term ), while online inference is increasingly more expensive.

And that does not even account for whether, 'bozo' will be able to use the tool right.. because an expert with a tool will steal beat a non-expert.

It is a brain race. It may differ in details, but the shape remains very much the same.