| ▲ | xcskier56 2 hours ago | |
When your AI consumes documents that are out of date it introduce bugs and incorrect behavior into the system. Code is the only source of truth that actually matters. The only artifacts outside of code that I don't explicitly end-date are user-story style requirements documents that I periodically revisit with the AI to make sure they're up to date. One of the most annoying things I've seen AI do is accidentally pull in old requirements and start building off of them. | ||
| ▲ | sdesol 2 hours ago | parent [-] | |
> One of the most annoying things I've seen AI do is accidentally pull in old requirements and start building off of them. This is actually the reason for me wanting to create what I call "Brain checkpoints". After chatting with the agent and letting it do its thing for discovery, I needed an easy way to understand what it knows at any given point. What files it has read, what tool calls were made and so forth. Checkpoints work extremely well in Pi since you can create a branch, and have the agent generate a checkpoint based on what has changed since the last checkpoint and this information will not pollute the main conversation but you benefit from the token caching. | ||