Could you create a separate account for the tablet without that credit card? Just curious.

but then how do you pay for things if/when you want to buy the little one something?

you either add the card then remove it, get a separate card, or find a way to use credits somehow -- but in the case of the latter two, Junior could still slam a few buttons and eat up all available funds on that card -- just without the impact of your regular card.