I felt that for much of my life. Time without stimulation was, if not scary, at least a bit panic inducing. Learning to sit without stimulation, without any distractions from my worries, led to being able to realize that "hey, I'm OK, I don't even need those worries." Which led to handling the underlying pressures and stresses MUCH better, without panic, without stress, with a full clear mind. I could apply my full intellect to things that before were hard to deal with. It felt like a super power when I first started practicing sitting.