> this would shift the job of a software engineer into a more formal engineering role

If only you knew how the civil engineering sausage was made.

The amount of yolo'ing stuff based on vibes goes up when testing is expensive/impractical. They just paper over it all with disclaimers of the sort that would get laughed at for being non-starters in the software industry.