it IS cheap (once the weights are released) and it will only become CHEAPER. For around $3700 a month (via loan purchased hardware + energy cost) you can run around 32 concurrent instances of kimi k3 which can generate nearly a 6.9 billion tokens a day.

This is napkin math since I'm mostly just extrapolating from glm 5.2 by assuming it's twice as heavy to serve in every single measurement, but I believe you can easily achieve 2500tok/s aggregate compared to 4500tok/s and up to 8000tok/s for glm5.2.

with nvidia r100 you are likely going to be able to push that number even higher while the cost of hardware appears to be relatively the same, so far I am seeing 21% premium from supermicro which is twice as fast and has nearly twice the vram.