Counterpoint: my entire physics phd cohort is doing great now and it didn’t ruin our lives.

I think better advice is “do you want to work in this specific lab for 5 years?”, not “do you really want to do physics”? Talk to the lab members, learn what they do.