As long as you have a sufficient test suite you could probably run a Ralph Wiggum loop and have it brute force it. Creating the test suite would be harder though.

The phrase "sufficient test suite" is doing a LOT of work here. You would need to know what the data from every sensor is supposed to be along with how every piece of the machine is supposed to perform. AI isn't going to be able to iterate into those parameters over night.

I've never been fond of the argument that there should be a professional software engineer certification, but hearing people like you being presented with the potential dangers and just going 'oh yeah just go with a better test suite and you can just wing it' makes me seriously reconsider.

Vibe code administrative systems for your local golf club to your hearts desire for all I care, god forbid somebody will have to stand around a bit longer before going for their 9 holes. But safety critical equipment is not the place to fuck around with the code prediction machines that have existed for 4 years, have been writing more-or-less acceptable code for 2, and will still regularly refer to themselves as MechaHitler or just make up shit. "Yes you're absolutely correct, I was wrong" doesn't help you one bit if you have just been chewed up by heavy machinery, and the fact that people like you exist who go 'oh just a few more more unit tests surely will fix it' is a terrifying thought.