| ▲ | gf000 2 hours ago | |
Not trying to question it at all, but I am quite confident that LLMs will always require abstractions, no matter what. Like math can be made arbitrarily more complex and no matter what we do, an LLM has at most n parameters it can use to "think" (in principle, a singularity that in this hypothetical scenario realize that it is not smart enough for properly encoding the problem and will rather create a better AI than itself to solve it could be possible). "Resetting" this hard limit at the one minus abstraction level is a must have. | ||