That might just be your card idling at a hot temperature; my 3070 Ti is idling with 0% fan according to nvtop and LACT both.

Install GWE or Lact and you should be able to tweak the fan curves manually from Linux.