I completely agree. These are useful in fuzzy cases but we live in a fuzzy world. Most things are fuzzy and nothing is completely true or completely false.

If I as a human deploy code, it is not certain that it necessarily works - just like with LLMs. The extent is different however.

100% where we are having a lot of success is in processes that required somewhat repeatable fuzzy processing, which before could only be performed by people.

Cool thing is that, since LLMs are comparatively cheap, I can afford to run the same process a few times, to get a sense of confidence of the response.

In our latest project, the client expressed that our AI aided process was 11 times faster, and much more accurate than their previous process.