It's because aluminium has a higher coefficient of thermal expansion. It expands and shrinks more as it heats, and as those cycles add up it tends to loosen electrical connections. Loose connections have higher resistance, heat up and can cause fires.

That said, there is no reason we can't design better connectors that can withstand the expansion and shrinkage cycles, like spring loaded or spring cage connectors.