If you had google maps and you knew the directions it gives are 80% gonna be correct, would you still need navigation skills?

You could also tweak it by going like "Lead me to the US" -> "Lead me to the state of New York" -> "Lead me to New York City" -> "Lead me to Manhattan" -> "Lead me to the museum of new arts" and it would give you 86% accurate directions, would you still need to be able to navigate?

How about when you go over roads that are very frequently used you push to 92% accuracy, would you still need to be able to navigate?

Yes of course because in 1/10 trips you'd get fucking lost.

My point is: unless you get to that 99% mark, you still need the underlying skill and the abstraction is only a helper and always has to be checked by someone who has that underlying skill.

I don't see LLMs as that 99% solution in the next years to come.