Remix.run Logo
ycui7 5 hours ago

K3 is natively trained to mxfp4, if they cannot get a hold of Blackwell chip, it is meaningless. Hopper does not do native 4-bit floating math.

Either they have Blackwell with native 4-bit floating math, or they use have Chinese domestic NPU that support mxfp4 natively.

The article’s statement does not make sense.

throwa356262 4 hours ago | parent | next [-]

Huawei A910 is supposed to have native support for MXFP4. The problem is that huawei doesn't have the capacity to build more GPUs right now. Those yield numbers must be really terrible.

Personally, I think 20K nvidias is a stop gap solution because they really don't have the capacity to serve their models to earn any money right now.

Tempest1981 4 hours ago | parent | prev | next [-]

> Either they have Blackwell

From the article:

A person familiar with Moonshot’s procurement strategy confirmed that the company does indeed have a channel for accessing Blackwell processors via Southeast Asia. They didn’t specify whether this was a rental channel...

orliesaurus 5 hours ago | parent | prev [-]

What do you mean by "it's meaningless" can you expand?

sho 4 hours ago | parent [-]

They mean that K3's native floating point is MXFP4, a newer standard that's not supported in Hopper, an older nvidia chipset, so it's impossible the GPUs in question were Hopper (the article specifically mentions H200s), which is correct.

Probably either the author or the people they interviewed got the specific GPU details mixed up or wrong. Maybe it was B200s.

orliesaurus 4 hours ago | parent [-]

Oh, okay, thank you for the explanation. I was under the impression that we, the United States, were banning exports of such GPUs.