Remix.run Logo
kmike84 3 hours ago

DeepSeek needs more RAM for weights, Qwen requires more compute.

Also, DeepSeek's KV cache requires less RAM than Qwen's. In concurrent situations (on servers) you load model weights once, but you have different context in each parallel session. So, it can also need less RAM than Qwen to serve, even if it's a larger model.