| ▲ | lordnacho 43 minutes ago | |
What I find is that the LLM is like a smart person who knows when to use a tool. And it is freaking good at finding tools to use. A bit like a person who is smart enough to figure out how an excavator works, or a drill, or sewing needle. It doesn't feel like it ever internalizes anything, it just knows there's a million tools available, and the extent to which it thinks is that is can do enough to plan some tool uses, look at the result, and continue until some goal is reached. When it comes to hypothesis testing, that seems to be what it does. It says "hmm, I'm going to open up my hypothesis testing kit (typically python) and drive this data through it". At least this is what I've seen when I put some statistics through it. In general, it seems like the intelligence is mainly a kind of glue. It knows enough about what "right" looks like in each domain, but as a sort of consumer. He doesn't bake the cake, he buys it in. | ||