| ▲ | arjie an hour ago | |
Longer context and more cache. The problem is that native format with DSpark enabled you have very little room on the VRAM. | ||
| ▲ | Philpax 26 minutes ago | parent [-] | |
I was under the impression that you could fit the full 1M context within the 192GB VRAM as a result of DeepSeek's various architectural advancements, but I'll grant that DSpark + a larger pool for concurrency may necessitate more VRAM, yes. | ||