The $1500 Intel B70 with 32GB of VRAM can run this model at max context with good performance, btw. If you don't want to drop $5-10k for running DeepSeek this is your best budget option for local refactor/small scale dev help

▲

aappleby 13 minutes ago | parent | next [-]

I have a B70, what llama options are you using and what performance are you seeing?

▲

LeBit 34 minutes ago | parent | prev | next [-]

I understand the B70 is a bargain vs AMD and especially nVidia offerings, but to me it feels like I would be buying something that would feel too limited in less than a year. 48G would be much more confortable.

And I know the 96G nVidia cards are selling for over 10k$.

The future can’t arrive fast enough!

▲

segmondy 30 minutes ago | parent | prev | next [-]

You don't need $10k to run DeepSeek, I run it on a $1000 system.

▲

bogzz an hour ago | parent | prev [-]

Oh, can it work with the /v1/completions/ auto-complete endpoint?

▲

Almondsetat an hour ago | parent [-]

Sorry, I wrote autocompletion by force of habit. I simply meant it can complete code you have already created a structure for, which personally is very nice

	▲	bogzz an hour ago \| parent [-]
		I thought so, but thanks for the clarification. I am a little bit disappointed that local autocompletion models have been left by the wayside in favor of models post-trained for agentic coding. Both Codestral and Qwen-2.5-coder are more than a year old at this point, but local auto-complete seems to me to be such a great usecase.