I just use git worktrees in a single container. Albeit I don’t have more than 3 agents going at a time generally due to my own context switching limitations.

It's a different level of isolation, worktrees help agent work on different code repository in parallel but things get wonky once you consider processes and environments variables