Speed and price. You should try the 4.1 Flash on one of the fast providers. It's pretty crazy how fast this model works, and it's great for iterative software development because you can steer it fast to where you want to go.

https://www.lithosai.com/

https://www.coralbricks.ai/

▲

swiftcoder 2 hours ago | parent | next [-]

How are these high-speed providers close to matching the API rates from deepseek?

	▲	pimeys 2 hours ago \| parent [-]
		Seems that V4.1 Flash is quite cheap to serve. Especially how it implements the cache, meaning the cache pricing can be very low depending on how you implement it in your inference engine. Depends on your use case. But if you do software development with a harness such as oh-my-pi, your cache rates are probably somewhere above 98%. Coralbricks has free cache reads, meaning it's much cheaper than the Deepseek API rates. Lithosai is more expensive especially in the ultra tier. It's if you want extremely snappy and fast responses, which is important e.g. for a personal assistant where every second counts. If you generate a lot of output, you're better off with the Deepseek API rates.

▲

andrepd 2 hours ago | parent | prev [-]

Where does one even get decent ZDR provider? I'm wary of sending sensitive data but not at a scale where I would build my own machine.

	▲	ytxm an hour ago \| parent [-]
		Scaleway have DS4. I don't think they call it ZDR, but their framework is very strong https://www.scaleway.com/en/docs/generative-apis/reference-c...