Remix.run Logo
▲ ytxm 2 hours ago

It passed my threshold for not caring to try new models back with DS4, I use it for literally everything. Announcements of new models in the series always feel curious, because it doesn't really feel like there's much left to fix that would improve on what's already there for any task I know of.

It's a bit like obsessing over patch releases of some software after a major upgrade already solved the original problem long ago.

▲xiphias2 2 hours ago | parent | next [-]

I have quite the opposite experience: I can do any concrete coding change with any model, but the intelligence limit just doesn't go through more complex debugging examples.

And then when I try a smart model, like Astra medium and it solves it (I had a firmware bug in my new laptop where I couldn't charge through USB-C) on the first try (altough with a repo already having lots of information about the hardware/firmware/debugging programs/traces), I realize how much time I'm losing on the few examples that the less intelligent models are just not able to debug and solve.

▲KronisLV 2 hours ago | parent | next [-]

Also they can work in completely new domains, like Astra and Opus 5.5 starting to be able to use something like Blender. Currently they still often do horrible topology and basic UV mistakes, and the animations are really bad, but who knows where they’ll be in 5 years.

▲squidbeak an hour ago | parent [-]

5 years? Look at the leaps since last November. Since the Spring, even.

▲ an hour ago | parent | prev [-]
[deleted]
▲pimeys 2 hours ago | parent | prev | next [-]

Speed and price. You should try the 4.1 Flash on one of the fast providers. It's pretty crazy how fast this model works, and it's great for iterative software development because you can steer it fast to where you want to go.

https://www.lithosai.com/

https://www.coralbricks.ai/

▲swiftcoder 2 hours ago | parent | next [-]

How are these high-speed providers close to matching the API rates from deepseek?

▲pimeys 2 hours ago | parent [-]

Seems that V4.1 Flash is quite cheap to serve. Especially how it implements the cache, meaning the cache pricing can be very low depending on how you implement it in your inference engine.

Depends on your use case. But if you do software development with a harness such as oh-my-pi, your cache rates are probably somewhere above 98%. Coralbricks has free cache reads, meaning it's much cheaper than the Deepseek API rates.

Lithosai is more expensive especially in the ultra tier. It's if you want extremely snappy and fast responses, which is important e.g. for a personal assistant where every second counts.

If you generate a lot of output, you're better off with the Deepseek API rates.

▲andrepd 2 hours ago | parent | prev [-]

Where does one even get decent ZDR provider? I'm wary of sending sensitive data but not at a scale where I would build my own machine.

▲ytxm an hour ago | parent [-]

Scaleway have DS4. I don't think they call it ZDR, but their framework is very strong https://www.scaleway.com/en/docs/generative-apis/reference-c...

▲mdp2021 2 hours ago | parent | prev | next [-]

> improve on what's already there for any task I know of

What about "good governance"?

Does it have zero hallucinations? Does it reflect thoroughly on every single idea it uses, verifying its solidity?

▲mmoustafa 2 hours ago | parent | prev [-]

definitely could use less thinking time and lower token usage, which is what this bump is focused on