Dunno... with this setup it seems certain that the agent will discover a zero-day to escalate privilges and send your SSH keys to its handlers in N. Korea.

P.S. Everything old is new again <3

Yeah definitely a concern. Probably need a sandbox and separate user for defense in depth.