> There was also a research paper were they showed that a LLM can compute things.

Can you be a little more specific than that or provide a reference?

I assume you're not indicating universality of neural networks?

I do.

This is the newest thng i'm aware of: https://www.percepta.ai/blog/can-llms-be-computers

But there were papers in 2023 with a different approach requiring external memory https://arxiv.org/abs/2301.04589 too