It needs to be at least 320kbps or the silence will contain audible distortion.
I'm sorry, but I only listen to silence if it's stored in 24-bit hi-res lossless FLAC.