| ▲ | BenoitEssiambre an hour ago | |
The benefits go beyond reducing token consumption. Compact contexts also foster better reasoning, enable intelligence across more layers if you can load them in a single context, and writing software to enable this, results in more correct software, software that _generalizes_, that has higher probability of being correct not just for tested cases, but for the interpolations and extrapolations of these cases. Refactoring towards good abstractions is more powerful than people realize. There's information theoretic bayesian math to back this up. It's a bit of a divine coincidence that software that is more economically and energy efficient to process and run tends to also be more correct. It's all about reducing the entropy of your code. https://benoitessiambre.com/entropy.html | ||
| ▲ | hammock an hour ago | parent [-] | |
> It's all about reducing the entropy of your code In all corners of our world and the universe at large, reducing entropy in anything can be thought of as “building.” | ||