Remix.run Logo
CuriouslyC 8 hours ago

Be careful about unofficial providers, a lot of them misconfigure models or stealth quantize them. For a while the difference between Kimi on the official API and most third party providers was 20-40%.

thehamkercat 6 hours ago | parent | next [-]

Kimi K2 had a vendor verifier: https://github.com/MoonshotAI/K2-Vendor-Verifier

(there's a table which shows comparison between vendors)

Also, it seems there's a general one as well (for all kimi models?): https://github.com/MoonshotAI/Kimi-Vendor-Verifier

cedws 8 hours ago | parent | prev | next [-]

OpenRouter should be penalising or banning for this.

kilroy123 7 hours ago | parent | next [-]

This is my biggest complaint about OpenRouter and I'm a fan. Might be pretty tough at scale?

orbital-decay 5 hours ago | parent | prev | next [-]

They have an "exacto" category with providers they supposedly verified

ComputerGuru 4 hours ago | parent [-]

That’s only for tool use.

alecco 6 hours ago | parent | prev [-]

Would that align with their VC-backed incentives?

unrvl22 8 hours ago | parent | prev [-]

the 2 I mentioned both have a fairly large following, who run benchmarks and absolutely will spot issues.