Remix.run Logo
▲ dewwi 2 days ago

I hope this won't change NVIDIA's refusal to block inference for unsigned and registered open-models in the firmware of modern GPUs. Anthropic and others are pushing hard on this. First the hardware export ban, eventually the software one via hardware-enforced execution controls like IETF hinted at

▲hintymad a day ago | parent | next [-]

> block inference for unsigned and registered open-models in the firmware of modern GPUs. Anthropic and others are pushing hard on this

For real? Anthropic sounds more evil that my wildest imagination. If true, I hope this kind of evil company gets destroyed sooner than later.

▲nrmitchi a day ago | parent [-]

There are two (very disjoint) opinions that both land in the same place (banning/restricting open-weight models).

1. "We want to own it and be the only megacorp that exists in the future", and

2. "Proliferation of open-weight models is like giving everyone a nuclear reactor in their home: it is extremely dangerous to the world"

Anthropic has previously stated (or, at best, implied) that they believe/have-reason-to-believe the second.

Some other organizations, well the public has every reason to believe they believe the first.

The end result of "hardware shouldn't be capable of running non-validated models" is the same between the two.

I can't comment on which of the two Anthropic is (because I have literally never in my life talked to anyone in an influential leadership position there). Just keep in mind that even people who are diametrically opposed can have matching recommendations (again, for polar opposite reasons).

▲hintymad 21 hours ago | parent | next [-]

Framing open-weight AI as "a nuclear reactor in every home" is the exact same paternalistic logic that drove Robespierre’s Republic of Virtue.

The underlying premise from Dario is pretty much that they are the enlightened vanguard who can be trusted with power, while the public is too foolish to have autonomy.

But people will never converge on a single definition of virtue in the standard of Robespierre's ideals. Because people naturally hold conflicting values, Robespierre had to resort to the guillotine to force ideological conformity and erase dissent. You cannot enforce a "Republic of Virtue" without becoming an authoritarian gatekeeper. When Dario demands only certain AI models that we can use, his so-called "safety" stops being a precaution and becomes a tool to impose his values on everyone else. And that, makes him dangerous and disgusting.

▲mrheosuper a day ago | parent | prev | next [-]

Or Nvidia could pull what they did with mining GPU: We want more GPU for gamer, so we release special version that can't run LLM.

Remember their "LHR" GPU

▲LtdJorge a day ago | parent | next [-]

That's almost imposible, the calculations are not different enough.

Edit: well, maybe massively decreasing memory bandwidth?

▲nextaccountic a day ago | parent | prev [-]

The issue is that while crypto mining is irrelevant to gamers, running ML models is not

▲mrheosuper 20 hours ago | parent [-]

Well, then you would buy their "llm" gpu, same gpu die, 3x the price.

▲xvector a day ago | parent | prev [-]

They definitely believe #2 and have been consistent about this since their founding (when they were a no name company nobody used). But HN tends to choose the most cartoonishly evil and conspiratorial takes on these matters because #2 is just boring

▲nrmitchi a day ago | parent | next [-]

fwiw I personally very much agree with you

▲wiseowise 19 hours ago | parent | prev | next [-]

I’m sorry, in which world is #2 NOT cartoonishly evil?

▲globular-toast a day ago | parent | prev | next [-]

Even if they do believe that, they obviously want #1 too because that's how people work. You'd think when talking about a company called "Anthropic" that would be obvious.

The problem with #2 is why should we trust them? If they truly believe #2 then they shouldn't exist either.

▲slowin a day ago | parent | prev [-]

I’m going to go out on a limb and say that Epstein people are in fact, cartoonishly evil.

▲bigbaguette 2 days ago | parent | prev | next [-]

It's obviously the biggest concern.

Either through technical means, or simpler: by law for American providers. It's hard to believe the administration was not aware of Jensen's affiliations all this time. And time is pressing for Anthropic and OpenAI.

Only conjectures for now, time will tell

▲sigbottle 2 days ago | parent | prev | next [-]

Is there a source for this? I googled it and this was claimed to be satire

▲dewwi 2 days ago | parent [-]

Not really tbf, it's an extrapolation. As far as I am concerned, there is growing concern, with Anthropic coordinated lobbying against open weights. The point I am making is we need strong Hardware actors consistently standing for hardware neutrality and integrity. Historically, NVIDIA has been very pro open weights. But at the same time, in-silicon guardrails seem to become the new thing: https://news.ycombinator.com/item?id=49879883

Makes you wonder what would happen if the US ever wanted to enforce "certified US AI" on its chips

▲vrmiguel 2 days ago | parent | next [-]

I'm curious how effective something like that would really be.

Nvidia can certainly put up some guardrails that will sound impressive to the dinosaurs in Congress, but can it really stop China from using those GPUs anyway?

This is a simplification, but is this not in some way similar to how the Switch 1 has hacked due to a design flaw on Nvidia's Tegra chip?

In the same way, even if their GPUs get this protection, wouldn't a state actor figure out how to get around it?

▲aseipp a day ago | parent | prev [-]

The entire article that thread references never mentions any hardware, at all, only their software platform. The "Watchdog" referred to in the (editorialized?) title is literally never mentioned, and it is not really a piece of "hardware", it is a piece of _software_ called "Sentry" that (clarified in the Nvidia blog) they run on Bluefield-4 hardware (the "chip") which is their network card. It only exists in $10mil+ clusters. Just an awful and misleading article and headline, and an awful thread filled with people who know nothing about how hardware works arguing over nothing.

Most of the hardware functionality from a GPU that models need is generic and used every time you use a GPU for any compute. You can implement language models in a GLSL shader; modern GPUs have been programmable for 20 years, that's the point of their existence. The best thing they could do is just literally nerf the consumer hardware substantially to make tokens unusable or stop selling consumer hardware. They don't need spyware to do that. It would also make their products dogshit.

More broadly, "Compute" is basically a resource that our economy relies on to a large degree, it has been that way for decades. And it turns out it's very bad when you just destroy the thing your economy relies on. And doing so doesn't solve problems like "Current computers exist today" or "Other people make computers". So who gives a shit about Jensen? Comments here talking about "taking him out"? What's actually more likely is just that really powerful people today are often corrupt and also really fucking stupid. He played a stupid game and lost.

None of this stuff is putting the current open weights genie back in the bottle IMO. Amodei using RoboStormtrooperGruppen9000 bots and going door to door to take peoples GPUs at gunpoint is a more plausible method of doing so.

▲msdz a day ago | parent [-]

Yeah, even setting aside the impact and implication on the AI-tech-driven stock market of such a mandate, I don't think it's technically doable to implement either. What if you modified/wrote your own inference engine which uses a somehow slightly modified version of model weights, how would you want to detect (at a firmware level) that compute to be an "unsigned" model over, I don't know, a video game?

Open-weight models, at an absolute minimum the ones that already exist, are here to stay, and will continue ([0]) to get drastically cheaper to run.

[0] I shall continue to reference one my favorite articles in recent months: https://jyn.dev/tokens-too-cheap-to-meter/

▲rescbr 2 days ago | parent | prev | next [-]

Yeah, this is the biggest concern that I have regarding this whole story.

▲nullbio 2 days ago | parent | prev | next [-]

Of course it will. That's the entire point of this. It has nothing to do with an affair.

▲wavemode 2 days ago | parent | prev | next [-]

> I hope this won't change NVIDIA's refusal to block inference..

lol had to read this several times due to all the negatives

finally got it - "I hope NVIDIA continue to allow inference..."

▲therealfigtree 2 days ago | parent [-]

Wow. Finally found a human in the comments

▲midtake a day ago | parent [-]

Refusal to block implies a bit more: some entity is requesting that they block

▲ a day ago | parent [-]
[deleted]
▲xiphias2 a day ago | parent | prev | next [-]

Of course it's about building an oligopoly of frontier companies controlled by the deep state.

It's sad that people talk here about some personal affairs when it's clearly about governmental control, but it's not the first time a scandal is used as a weapon.

▲greatvaluebrand a day ago | parent [-]

I don’t know if it’s true, but I did read speculation that the affair has been known within high levels of the government for some time. I wonder if the person Trump claims to have threatened an AI leader with jail time is related to this.

▲wernam 2 days ago | parent | prev | next [-]

Definitely, expect future GPUs to run only signed LLM models with mandatory online attestation and reporting.

▲caned a day ago | parent | prev | next [-]

By the such a restriction goes into effect, we'll be buying less expensive Chinese GPUs without such execution controls.

▲bradley13 a day ago | parent | prev | next [-]

Say what?! That would be like CPUs refusing to run specific programs. Truly dystopian.

▲deadbabe 11 hours ago | parent [-]

It’s coming. No general purpose computing will be allowed in 10 years, anywhere.

▲willmadden 12 hours ago | parent | prev [-]

Of course it will. That's what this was all about. You can also expect huggingface to be moderated like a far-left subreddit. They won't shut it down, because that would create to much space for Alibaba's version to become popular, or for torrenting to take off.

This was a hit job coordinated by captured media and the people behind the NVDA board to work towards a tech oligopoly in AI. It's glaringly obvious, at least to me.

I mean, none of this "spy" stuff is proven, and the various alphabet agencies are backtracking the claim. That means it's fair game to compare Jensen's "scandal" to the "scandals" involving OpenAI and Anthropic's CEOs. Jensen is the patron saint of morality and virtue comparatively.