Remix.run Logo
Philpax an hour ago

What do you need the extra 2 for? Tensor parallelism?

arjie an hour ago | parent [-]

Longer context and more cache. The problem is that native format with DSpark enabled you have very little room on the VRAM.

Philpax 28 minutes ago | parent [-]

I was under the impression that you could fit the full 1M context within the 192GB VRAM as a result of DeepSeek's various architectural advancements, but I'll grant that DSpark + a larger pool for concurrency may necessitate more VRAM, yes.