Not quite what you suggested, but I did some experiments several months ago "enhancing" the samples in tracker music with some models, and they sounded terrible. There really is something about the sound of tracker files that's just right. But sure, you could generate lo-fi samples, there's a lot of computer generated samples in music, but putting them together into a pleasing combination is the hard bit.