Remix.run Logo
hagen8 5 hours ago

Just switch the model, its not that much effort tbh. And u can also get a cheaper model than 2.5 lite for the same intelligence

tacoooooooo 4 hours ago | parent | next [-]

its not always that simple. dropping in a new model is trivial, but highly specific workflows may rely on specific _invisible_ aspects of a model. when that model gets deprecated, the workflow needs to be rebuilt/re-tuned to work with a different model.

google's inability or unwillingness to provide stable timelines for model deprecation makes it risky to build complex workflows using their models

aitchnyu 2 hours ago | parent | next [-]

Load-bearing (whoops) quirks were noticeable months back, but haven't most flagship models become predictable and reliable?

written-beyond 4 hours ago | parent | prev [-]

100% agreed in the same boat right now. Feeling really screwed over by Google rn

ActivePattern 3 hours ago | parent | prev | next [-]

You would be surprised how much of a difference the model makes for certain niche tasks.

For my use case, `gemini-3.1-flash-lite` is ~20% higher accuracy than the next best model of comparable cost (considering both proprietary and open-weight alternatives)

wasfgwp 2 hours ago | parent [-]

Well it is a bit surprising that 3.1 flash-lite could be better than deepseek-v4-pro (cheaper output and way cheaper cache so might cost less for quite a few use cases).

They are not anywhere close according to pretty much every benchmark (even v4-flash is considerably ahead and its way cheaper than flash-lite). Maybe tuning prompts/tools/etc. might be useful?

swe_dima an hour ago | parent [-]

Gemini flash lite family of models currently has the best ratio for price/speed/intelligence for understanding images, no real alternative AFAIK

deaux 2 hours ago | parent | prev [-]

"Intelligence" being what, math? Coding? Unfortunately there's a billion use cases for LLMs whose performance is not at all captured by the popular benchmarks they're all trying to maxx.

whimsicalism 2 hours ago | parent [-]

if you are relying on a model for a business process, it should be simple enough to benchmark on that process