> Of course then you've gotta setup a whole stack to store it

No you do not. Just use an external drive and an MP3 player like some kind of caveman. There are plenty of high quality models out there. Additionally smart phones will let you store music on them to listen to using the player app of your choice (VLC or something).