There are special brackets for mounting HDDs, where there are rubber rings interposed between the mounting screws and the bracket, in order to prevent the transmission of the HDD vibrations to the chassis, which usually greatly amplifies the HDD noise.

With such brackets the noise is usually reduced a lot. There are some computer cases that are advertised as silent cases and which include such brackets by default (e.g. from Fractal Design).