| ▲ | cyanydeez 21 hours ago | |
If you start working with local LLMs, you'll find they _do_ work at a speed you can comprehend and you can guide them to the thing you would understand more. I've been building projects mostly by forcing the llm to use a more modular approach, so when it does get stuck or break something, it's isolated. This happens to be a often promoted means to an end. Additionally, I've gotten into building and inspecting tests/ that allow it to break problems into functional blocks. but tl;dr: you're seeing AI psychosis because token gen is through the roof leading to sprawling code bases that no one's competent in being responsible for. But if you tweak how fast these things operate, you can manageably come along for the ride even if you still dont need to know everything. Think of it like a new form of boilerplate, but extended to a lot of banal ritual magic. | ||
| ▲ | aocallaghan17 20 hours ago | parent [-] | |
Yeah I mean this is closer to my use of LLMs, where I'm intentionally slowing things down enough to follow and course correct myself. This whole build the loop not the prompt idea seems to be advocating the opposite... I don't feel comfortable to not be the driver of the loop for a production system. | ||