| ▲ | pixel_popping 21 hours ago | |
You don't need to "maintain" a comprehension as you can just ask (with loops as well) anytime you want something, or you can ask the tool to give you the current state/summary. Actually, no model should directly answer to you in a proper workflow, it should always be another agent digesting and verifying, don't check the response directly. In reality, production systems will be released without inner depth of knowledge anymore, because no humans will touch tomorrow's codebases, solely AI, so everything has to be designed for AIs, not for humans at this stage, same for documentations. Documentations don't need to be done ahead as well as they can be prompted live, docs should be just pointers to assist AI to help you gen the docs. In my team we stopped having dashboards pre-made entirely and if we need to know how many people signed-up today (just an example), then agent hit prod data directly (with read-only instant snapshots), we kept having this discussion and we ended-up understanding that inventing "tools" that we aren't even sure we need is useless in this era, you'd rather prompt everything (in loops, adversarial with the model zoo and so-on to reach 99% accuracy). | ||
| ▲ | aocallaghan17 20 hours ago | parent [-] | |
I'm just struggling with this, surely you need inner depth knowledge to reason about the system and make some level of decision, at least around system design and architecture if not lower level implementation details? But it sounds like you're generating that knowledge each time through a system of agents? How do you have so much trust in a non-deterministic system, or are you deferring ALL decisions to these "loops"? What if you and a team member generate a dashboard and it gives different results because the agent(s) used a different methodology? And surely cost plays a part here. This is giving you such productivity gains to boost revenue enough to outweigh what must be huge token costs? | ||