Not “local” and not interactive coding but sharing since it might be helpful. I have 2x RTX Pro 6000 Blackwell running DeepSeek V4 Flash. I get 160 tok/s raw but it’s a reasoning model. For my use case, I have it auto-write code and another system auto-review the code.

I occasionally use it with pi to write some code and it’s blazing fast but it’s mostly habit that keeps me with CC and Codex.

▲

akersten 4 hours ago | parent | next [-]

> I have 2x RTX Pro 6000 Blackwell

Where did you find/order these? All the sites I can find are either out of stock, only sell to businesses, or are otherwise sketchy...

	▲	arjie an hour ago \| parent [-]
		I run a small business (https://technologybrother.com) that runs a few small SaaS so I ordered the GPUs through corporate sales. If the barrier is getting an LLC, those are relatively cheap. The nice thing is that if you've got a legitimate business with use for GPUs you can get into the Nvidia Inception Program which has a pretty solid discount.

▲

leptons 6 hours ago | parent | prev [-]

Have you measured your electricity consumption for this rig? I have to wonder how much it would cost you per month.

	▲	ux266478 5 hours ago \| parent \| next [-]
		Not nearly as much as you might think. 1.2kw where I live translates to about $0.12/hr, and that's when running full clip. If you have a decent solar hookup, it's small fraction on a sunny day. The expensive part is the upfront hardware cost and the electrical system upgrade you'll need to give your house.
	▲	mtone an hour ago \| parent \| prev [-]
		[dead]