No it's not just you. I/O on the Pi4 and below is awful, but for most applications it doesn't matter. Not sure on the Pi 5 as I jumped ship after the scalping and overall negativity around the foundation's activities in the last few years but I expect it's a fair bit better.