Even new Kindles don't support EPUB, per-se. The Send-to-Kindle service started supporting EPUB, and converts them to AZW3 or KFX for actual delivery to your Kindle.

But you cannot just USB an EPUB onto your Kindle without any conversion process. (Calibre does make it very simple, though.)