Seems hard to do well in practice.

Can the agent read the internet for context? What if the fetch reveals a secret?