Let's say you are driving on the highway, then there is the autopilot button and you switch it on.

Does that mean you don't need to look on the roads without your hands on the wheel? (It does not. You need all hands on the wheel and look on the roads at all times)

What happens when the system fails in the middle of the motorway and you don't know how to drive? (You would be completely stuck.)

Just like with the above analogy, you still need to look at the code if any entity (human or AI) made a mistake [0] and then judge that the fix is sound.

[0] https://sketch.dev/blog/our-first-outage-from-llm-written-co...

▲

blinkbat 5 hours ago | parent [-]

Is not the ultimate project of driverless cars to be, well, driverless?

Granted we are not there with LLMs quite yet, but are you insisting that this is not the endgame?

	▲	rvz 5 hours ago \| parent [-]
		> Is not the ultimate project of driverless cars to be, well, driverless? That has always been the desired end-game for decades. But as you can see, it is far more complicated than imagined. This is because of guidelines in the regulatory landscape, safety and what happens when these systems fail or get themselves hacked, which is why I gave that analogy. The future is likely to be in the middle.