moandcompany 2 days ago | parent | next [-]

You can use nvidia-smi to set a target maximum power draw and performance mode to bring idle power levels down. Also make sure your computer is using the server/headless mode driver to keep idle power consumption down.

supertrope 2 days ago | parent | prev | next [-]

If one can afford a GPU with a MSRP of $1999 and was scalped for $2999 during the initial craze, you are probably not struggling to pay your electric bill.

▲

jeffbee 2 days ago | parent | prev [-]

I suggest not putting a ridiculous GPU in your backup server.

▲

overfeed 2 days ago | parent [-]

Not everyone's "home server" is a backup server - some are for AI experiments.

▲

silon42 2 days ago | parent [-]

That one should be Wake-On-LAN

	▲	overfeed 2 days ago \| parent [-]
		I wouldn't want to fiddle with WoL just to get my self-hosted LLM-assisted code-completion working when I pickup my old and underpowered laptop on the couch for some quick hacking. Wake-on-any-network-activity would be perfect, and has superior UX.