That seems to be the biggest limiter, hard to have it do real work on a codebase without it's own environment set up that we can control.

yeah. exactly. they have these "self-hosted sandboxes" which seems to be the unlock we'd need. https://platform.claude.com/docs/en/managed-agents/self-host... but those only seem available to their "managed agents" so like "scheduled prompts" i think. one day i assume they'll merge Claude Web sessions with these self-sandboxes maybe