| ▲ | coldtea 3 hours ago | |
For allignment maybe. For the core functionality and the optimizations we don't really need to know how the emergent capabilities decide on particular answers. Which is why we could build LLMs before those features ...emerged for us to see, and why we can just code LLMs with the numerical NN algorithms we use, and do now have to go in and change individual weights. | ||