The LLMs have indeed gotten better at representing numbers and performing arithmetic, but they can still do it wrong.

I don’t consider it a workaround for an LLM to delegate arithmetic to a calculator.