Remix.run Logo
syntaxing 4 days ago

I swear, Qwen 3.8 27B @ Q8 is smarter than Sonnet 5 most of the time. Why wouldn’t corporate America self host at this point, especially with better options like Deepseek Flash and GLM 5.3 flash that’s a middle ground between Sonnet and Opus

majorchord 4 days ago | parent | next [-]

Agreed. And conversely, American models can also just as easily be secretly influenced for bad things, or be more tightly controlled by the government, to corporate America's own detriment.

epistasis 4 days ago | parent | next [-]

Post-IPO I'd trust the American models far far less than the Chinese models.

The most insidious advertising in the world is about to be surfaced as people use LLMs to look for product recommendations.

WarmWash 4 days ago | parent [-]

It's wild that people are so lost in the sauce of social media that they have no qualms handing over all their data to an authoritarian ethno state with a single ruler who appointed themselves for life with unrestricted unilateral control over every aspect of the state. And here we are calling for collapse because mom might get recommended Gain instead of Tide.

epistasis 4 days ago | parent | next [-]

Sorry, how does running a local model hand over my data?

You are very confused about the security and what can happen here.

WarmWash 4 days ago | parent [-]

The context here of comparing trust between American models (which are mostly centrally hosted) to Chinese models (rather than "local" models) implies trust levels in who is hosting.

American local models don't hand over data either, which would nullify the point of the comment.

g8oz 3 days ago | parent | prev | next [-]

For most people around the world America is more of a threat than China. Heck for most Americans the American government is more of a threat than the Chinese government.

8note 2 days ago | parent | prev | next [-]

trump has named himself dictator for life now? when did that happen?

majorchord 4 days ago | parent | prev [-]

What's even more wild to me is that basically ALL modern electronics and all modern batteries are made from raw materials sourced by forced and child labor (and sometimes both)... yet the vast majority of the entire world just turns a blind eye to it.

https://gcdnb.pbrd.co/images/gKMYRcEIeE9j.png

epistasis 4 days ago | parent [-]

This is very confused, first the world does not turn a blind eye, and by having US purchasers of these products the US is actually forcing a big change in the standards for the better due to purchasing power. In particular the US has avoided huge amounts of potential purchase in solar, largely under the justification of avoiding forced Chinese labor.

Second, the "ALL" qualification is extremely wrong, as only small fractions of these products in the US could ever be sourced to the human rights violations cited here.

Kuyawa 4 days ago | parent | prev [-]

America's own demise will be made in America, stamped by American laws

cousinbryce 4 days ago | parent | next [-]

From whence shall we expect the approach of danger? Shall some trans-Atlantic military giant step the earth and crush us at a blow? Never. All the armies of Europe and Asia...could not by force take a drink from the Ohio River or make a track on the Blue Ridge in the trial of a thousand years. No, if destruction be our lot we must ourselves be its author and finisher. As a nation of free men we will live forever or die by suicide. ― Abraham Lincoln

majorchord 4 days ago | parent | prev [-]

https://www.youtube.com/watch?v=bX3EZCVj2XA&t=289s

SamInTheShell 4 days ago | parent | prev | next [-]

@q4 is definitely smarter than sonnet from what I’ve seen so far. It’s even caught problems in code made by fable, when using it as a code reviewer.

Henchman21 4 days ago | parent | prev | next [-]

> Why wouldn’t corporate America self host at this point

Because they've been trained to think "cloud-first" for a decade?

phoghed 4 days ago | parent [-]

Still a ton of non tech companies doing a digital / tech transformation out there too lol. Maybe some so far behind they still have the real estate and rack space to get ahead on this one

r_lee 4 days ago | parent | prev | next [-]

is this actually the case? I haven't kept up with the small models

but if there's roughly Sonnet 4.6 level capable open small models, then I'd be impressed

syntaxing 4 days ago | parent | next [-]

Qwen 3.8 27B is the real deal BUT remember to use froggeric template and/or medium reasoning.

https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates

jhonof 4 days ago | parent | prev | next [-]

Qwen 3.8 27B is better than Sonnet 4.6

Zambyte 4 days ago | parent | prev [-]

Qwen 3.8 27b has the juice. Try it.

skybrian 4 days ago | parent | prev | next [-]

Why not Luna?

spopejoy 3 days ago | parent | prev [-]

I mean, why self-host? Deepseek v4 flash is dirt-cheap on openrouter. Inference is a race to the bottom at this point.