„Built on Windows”. That’s like anti-ad these days. Maybe, maybe worth looking at if you can run other OS than Windows on it, but that will probably take some time.

▲

EagnaIonat 2 hours ago | parent | next [-]

The emphasis on the fans kicking off also had a bit of a turn-off.

▲

sandworm101 an hour ago | parent | prev [-]

Ya, i dont know of anyone wanting to run very large AI models in a windows environment. Or, frankly, on a laptop. Why not just VPN into a dedicated server?

▲

satvikpendem an hour ago | parent | next [-]

I do. I can take my laptop anywhere I want, for example to a coffee shop and run a coding model while eating a croissant without worrying about an internet connection, as the term local model implies.

	▲	taffydavid 38 minutes ago \| parent [-]
		And you can warm up the croissant by just placing it on the trackpad while you wait for the LLM to finish

▲

whywhywhywhy an hour ago | parent | prev [-]

How much does a dedicated server with 128GB vram cost a month.

	▲	forthefuture 32 minutes ago \| parent \| next [-]
		You can get an H200 (141GB) here for $2,700/mo: https://deploybase.ai/articles/h200-price I could be wrong but my understanding is that 24/7 dedicated servers are wildly economically unviable. The reason cloud tends to cost less than local today (other than the subsidization) is because you aren't running models 24/7. So like 6 hours of cloud per weekday might beat the yearly cost of building local machines, but it's not in the same universe if you're running 24/7, as evidenced by two months of H200 rental costing more than the DGX Spark this Laptop is built out of.
	▲	sandworm101 an hour ago \| parent \| prev [-]
		Less than this laptop.