Remix.run Logo
vonneumannstan 5 days ago

LLMs basically can't do arithmetic directly, trying to get them to do so is a skill issue. Most models can and will happily write and execute code to do that work instead.

Havoc 5 days ago | parent | next [-]

What I described is a setup that DOES have pandas & python access and uses it heavily to figure out the excel files. Which is neat, but the output is still wrong

vonneumannstan a day ago | parent [-]

I'm sorry, what are you saying exactly? That a model like GPT 5 can't read an excel file and correctly sum rows based on filters? I find that incredibly hard to believe. GPT 4 from 2 years ago could do this with no issue.

giancarlostoro 5 days ago | parent | prev [-]

Which drives me a little crazy. Every LLM worth its salt should just... MCP or whatever the arithmetic of any question, I assume the good ones do.