> Tell ChatGPT to multiply 129348723423 and 2987892342424 and it'll probably get it wrong because nowhere on Reddit is that exact question for it to copy. But what's interesting is it'll tend to get the first and large digits correct (more often than not) but the middle is just noise.

People have no idea how capable LLM's are and confidently write these kind of things.

This is a known problem and an active area of research [1][2][3][4].

[1]: https://arxiv.org/html/2505.15623v1

[2]: https://medium.com/@adnanmasood/why-large-language-models-st...

[3]: https://www.reachcapital.com/resources/thought-leadership/wh...

[4]: https://mathoverflow.net/questions/502120/examples-for-the-u...