Doesn't mean jack without access to it.

I used to defend Google's models months ago, but switched to Luna for less intelligent models.

But with this bs of not making it even public, pushing off release of newer models late, I lost faith in Google.

ActionHank 3 hours ago | parent | next [-]

yeah, IMO AA should be excluding unreleased models from their benches or risk becoming an irrelevant marketing platform that no one uses anymore.

▲

sigmoid10 3 hours ago | parent | next [-]

It has already become irrelevant to anyone paying attention. Raw scores at published benchmarks mean next to nothing in modern use. They are either gamed to hell or unsolved to the point where differences can be explained by randomness. Speed, cost per token, tokens per task and hallucination levels are the useful axes you can compare along these days if you're not doing scientific frontier level research.

▲

yorwba 3 hours ago | parent | prev [-]

They probably prefer being used by the deep-pocketed organizations that have access to Gemini 4 Carbon even if it means losing the entire rest of the market.

	▲	ActionHank 3 hours ago \| parent [-]
		They've only recently emerged as something people reference and now they're already dying.

▲

freediver 2 hours ago | parent | prev | next [-]

Curious what was the source of faith you previously had?

▲

eknkc 4 hours ago | parent | prev [-]

Yeah. It is vaporware at this stage.

Also, their tooling still is complete shit. I'll not be forced to use Antigravity thing even if it is available and clearly better than Opus or Astra. Their subscription is useless. API can be used with anything you got but that's gonna cost.

▲

yipinwong 3 hours ago | parent | next [-]

Not to mention blocking API usage with subs.

I never use any google models for any agent work any more, in case they block me.

Started migrating gdrive, and gmail to other providers at this point after horror stories in HN, that they lost access to their gmails, etc.

▲

Jtarii 3 hours ago | parent | prev [-]

How the fuck can something that was announced less than a day ago be "vaporware".

▲

ActionHank 3 hours ago | parent [-]

I have a car that is better than Elon's, it actually does 2 backflips, my friend saw it happen. Will be released soon.

Prove me wrong.

▲

okdood64 3 hours ago | parent [-]

If you're talking about track record, Argon had the same sort of announcement and was released.

▲

ActionHank 2 hours ago | parent [-]

It's announced with trust me bro benches, no you can't verify it yourself, this might not even be the model you get.

It's been provided to AA under clandestine circumstances, no you can't verify it yourself, this might not even be the model you get.

People on HN for some reason "wow this thing that I can't use is so great, really excited about all these ads I just looked at"

▲

threatofrain 2 hours ago | parent [-]

You should be running your own benchmarks often given the nature of these products. Releasing these models whenever with whatever corresponding benchmarks provides you no assurance that things will stay the same.

Having a great time with an ice cream brand at a store is no assurance against hollowing out the brand tomorrow.

	▲	ActionHank 2 hours ago \| parent [-]
		True facts, I look forward to you sharing the link where I can use this new model with my own benches.