If you use a machine with an ISA slot, you can get a card with a chip called CH375 or CH376, which deploys a USB flash drive like a normal hard disc with either a loadable driver or option BIOS ROM. You can just pull out the entire drive and mount it on a normal Windows or Linux box.

I think the below-mentioned Pocket 376 might have one soldered-on already.