I've got half a diopter (ish) of astigmatism in my right eye and it can be slightly annoying but interesting to know that using glasses would risk making it worse.

The weird thing is it seems to get noticeably worse or better depending on how much time I spend outside