I'm at about 150 watts at idle with 2x Intel E5-2640 with 8x drives. I've gone through the BIOS pretty thoroughly and optimized as much as possible.

Ah okay 150w is not _that_ bad - more than a rpi for sure but still :)

And another cpu+chipset is always going to eat som Watts just by existing.