Is the data stored on the card, or on the player? My guess is that each card just holds an id?

It's just an id. But the audio is stored on the yoto itself for offline play.

And second the blank/customizable cards, that's what 80% of our cards are and my daughter loves helping track down and extract content. Biggest hits for her have been Roald Dahl and random science stuff.