Are we assuming the systems the AI is building are systems for humans?

Continuous learning systems aren't there yet, though we have the proto-learning systems with things like agents and skills. What does it look like when we have AI systems building systems for other AI systems?

good point although built for humans > built for AIs is likely true for a while