Remix.run Logo
wizzwizz4 4 days ago

I see no reason that an LLM should be better at guessing than a trie (unless the actual example was in its training data, in which case a web search would be more appropriate).

dmurray 4 days ago | parent [-]

I agree. I just like having the guessing done at compile time on principle. It allows you to change a guess, if you find that it's wrong, and convince yourself that you haven't broken any of the other cases where you were previously accidentally right.

wizzwizz4 3 days ago | parent [-]

My main objection is the temptation to mix real and fabricated data. Your entire dataset becomes much less useful if it's got nonsense mixed in with it, and if historical examples are anything to go by, it can be hundreds of years before someone identifies and untangles the nonsense from the fact. Any minor benefit is not worth this risk imo.