Remix.run Logo
colonCapitalDee 3 hours ago

That's not surprising, LLMs are bad at pulling hyperspecific facts out of memory. LLMs aren't mapping applications, they're reasoners. Just a poor problem fit

kensey an hour ago | parent | next [-]

> LLMs aren't mapping applications, they're reasoners.

No they aren't. They're statistical token generators. They do not understand concepts such as "distance from a given location or coordinate point". If you're lucky you might ask it something likely to appear nearly verbatim in its training data, like "Chinese restaurants in Midtown Manhattan", and get back a reasonably accurate list, but it does not understand what a "Chinese restaurant" is, or what "Midtown Manhattan" is, or that one relates to the other in any way other than both appearing statistically associated with another set of tokens when they appear near each other.

sarchertech 3 hours ago | parent | prev [-]

I wasn’t asking it to pull it from its training data, I was asking it to search.

Also reasoners that can’t recall facts is not how people are using them. No one is asking “from first principles derive this equation”.