| ▲ | yieldcrv 6 hours ago | ||||||||||||||||
What’s everyone favorite GLM provider? z.ai doesnt always have the most reliable AI but I don’t mind the party seeing my trade secrets and thoughts compared to an American corporation + the party seeing my trade secrets and thoughts. So thats not a functional difference to me, and the Chinese one won’t reply to subpoenas so thats a value add tbh So I’ll consider all, fastest tokens/sec wins | |||||||||||||||||
| ▲ | reissbaker 2 hours ago | parent | next [-] | ||||||||||||||||
I'm biased because I run an inference company, https://synthetic.new. That being said I think we're pretty good at serving at GLM-5.2 — and other models, like Kimi K2.7! — and our privacy policy is quite good: zero data retention for prompts and completions on API requests. Our average streaming TPS for GLM-5.2 (aka, tokens after factoring out time-to-first-token, which varies based on geography) is 97tps over the last 24hrs, although it's slightly lower at peak traffic in the mornings PST where it's 50-70 tps. We're also subscription-based which is nicer for coding than e.g. Fireworks which is per-token billing. | |||||||||||||||||
| |||||||||||||||||
| ▲ | eli 6 hours ago | parent | prev | next [-] | ||||||||||||||||
Fireworks.ai is solid. And if you care more about speed than cost they have a "fast" variant that I think just throws more hardware at the model for about 2x the cost. | |||||||||||||||||
| |||||||||||||||||
| ▲ | pbgcp2026 40 minutes ago | parent | prev | next [-] | ||||||||||||||||
Run it on Amazon Bedrock or GCP vertex. No problems at all. | |||||||||||||||||
| ▲ | Onavo 3 hours ago | parent | prev [-] | ||||||||||||||||
> the Chinese one won’t reply to subpoenas so thats a value add tbh That's not something that's definite. They are not quite like the Russians. A lot of the governments in Asia are overly pragmatic and will happily strong arm their companies to throw users under the bus for the sake of a trade deal. There's a reason why Snowden ran to the Russians and not China. Also, if they have any subsidiaries in the US, they may not have a choice in the matter. | |||||||||||||||||