Remix.run Logo
▲ jesdo a day ago

Overall, a fair assessment. I do want to place a footnote here that we did fix vLLM in the sense that its correct behavior for Kimi required code changes: it was impossible to fix it in the configuration. Later, the vLLM team fixed this problem upstream. Now, with the latest version of vLLM, the problem we describe can be addressed by setting the `--tool-strict-level` flag to `parameter`.

▲wredcoll 17 hours ago | parent [-]

If you work for ubicloud, I have a question: do you sell api access to kimi/etc, and if so, where is that listed??

▲jesdo 7 hours ago | parent [-]

We currently focus on serving DeepSeek models on dedicated clusters for large customers. We do not offer this as a publicly available service at the moment, but we may consider doing so in the future.