On top of that isn't it strange that if the LLM makes a mistake you're still charged for those tokens?

They're selling "intelligence", automation, etc but if the service doesn't work as expected the user has to pay for that.

You're paying for a service with known flaws. They do not guarantee correct answers.

Also, LLMs don't "make mistakes". They don't think or act. Every single thing they output is a hallucination. It just happens that the vast majority of things align with reality.

If I use electricity to do something stupid, I still have to pay for the electricity. Intelligence is just another utility.