Exactly this! When I had my first two kids only a year apart and early in my career, I thought I'm giving something up because I could no longer invest as much time and effort into my projects and research ideas as before. But in retrospect, looking at how the field has evolved since etc., those ideas, which I had regretted I couldn't push harder, anyway had only a small chance for some grand success (beyond the low-medium success of the low-medium effort versions I managed to put together).