Right, don't use "random.int() === random.int()" as the assertions then?

Say you have one test that checks if Y works properly. The point of the agent harnesses is that you can throw them at that problem, and they'll return once Y works properly according to that test. How the test is structured, or how the agent triggers it, or what the agent is willing to do to pass that test, is all up to you.

But if you manage to set things up like that, you're not longer relying on any "slot machine behaviour", at least as we commonly understand what that is.