My "MP3 player" is a phone with Musicolet. If you really distrust phones, you can buy a cheap phone and use it only for that and nothing else. There are probably other offline MP3 players but this one seems pretty good. (It is hard to find a phone with an SD card slot and a headphone jack but that's a separate issue.)

The problem with cheap phones is how big they all are