Remix.run Logo
rgbrenner 3 hours ago

Im not worried about this at all. The OpenAI, Anthropic and the US government can play this game all they want... They're just accelerating the development of open source models; and helping destroy the lead the US has built in AI, and their profit margins along with it.

This is like the battle between PostgreSQL and Oracle all over. Move up market, isolate yourself to enterprises, and watch while everyone else builds on PostgreSQL and erodes any technical advantage you had, until people just stop talking about you altogether.

utilize1808 2 hours ago | parent | next [-]

The government will just claim that unsanctioned models have the potential to deliberately introduce security vulnerabilities when working on IT projects (e.g. be trained to strongly yet covertly favoring introducing compromised dependencies when you are not looking).

Then laws will be made to forbid organizations who use models other than those from the sanctioned labs to participate in critical projects on national security concerns.

All of a sudden, no business would risk using open source models anymore.

pixelpoet an hour ago | parent | next [-]

Then all they do is drive the usage of open models underground (copyright infringement is illegal too, and still common), stifle US companies operating legally, and accelerate the rest of the world decoupling from the US.

I hope they do it! It will have a positive long-term effect just like the Iran war footgun accelerates renewable energy transition.

utilize1808 an hour ago | parent [-]

Have you seen legitimate corporates use cracked software? If you do, then your competitors will report you; your employees will blackmail you. The risk is too great.

0x3f 38 minutes ago | parent | next [-]

This assumes the same reward ratio also continues, but that's not the case. A cutting edge LLM is something much more valuable than a cracked copy of Word. Just like the LLM providers themselves decided violating copyright was an acceptable risk, it entirely depends on how people see the tradeoffs, rather than being a categorical decision.

utilize1808 19 minutes ago | parent [-]

While that might be true, it is unlikely that open source models' capability will ever surpass frontier models --- if you have the best model (by some margin), then people will want to access it, even if it means going through compliance.

jauco 11 minutes ago | parent | prev | next [-]

He said copyright infringement. The company tfa is about literally trained its models using massive copyright infringement.

Daishiman 25 minutes ago | parent | prev [-]

Then they'll outsource dev work to agencies that have no frills with it and move along.

utilize1808 23 minutes ago | parent [-]

As a company it is your responsibility to ensure your contractors are compliant. So won't work.

jesse_dot_id 3 minutes ago | parent | prev [-]

Streisand effect

varispeed 3 hours ago | parent | prev | next [-]

That until it becomes illegal to have or use open source models without approval and licence from government. With more talks about on device scanning, this could be easily plumbed in. If OS detects there is open source model, it could brick your device or alert authorities. Then next step will be limiting what operating system you can install. Likely only those where you cannot remove client side scanning.

kgeist 2 hours ago | parent | next [-]

I wonder how you can reliably detect an open source model though. It can be stored in any binary format, and the weights can be modified slightly so that the float values are completely different while the network works the same. The binary that runs it can be obfuscated as well. Maybe the hardware could detect common LLM inference patterns at runtime? That would probably produce many false positives.

Larrikin an hour ago | parent | next [-]

It's been illegal forever to run a pirated copy of Windows or Photoshop. Even 30 years ago people weren't worried that their pirated copies would tattle on them, businesses did not use pirated copies because vendors would report them/not work on their systems, legal discovery could find them, etc and then they would get ridiculous fines.

It's one thing to get a copy of "illegal" software and use it yourself. The stakes are basically zero and you almost certainly will not get caught

It's a completely different thing to run a business on it with dozens of employees and requiring the employees to break the law to do their job.

notatoad an hour ago | parent | prev | next [-]

You don’t need to detect it, you just need to incentivize employees and competitors to snitch on companies using unapproved models.

codedokode 41 minutes ago | parent | prev | next [-]

Antivirus companies have large expertise in this.

grim_io 2 hours ago | parent | prev [-]

You don't need a blacklist.

Maintaining a blessed whitelist is the way to go.

2 hours ago | parent | prev | next [-]
[deleted]
asadotzler 2 hours ago | parent | prev | next [-]

It can't easily be plumbed in, though. I can spin up my own Linux build with none of that plumbing and do what I want with it. I can grab China's best models and use them or distilled versions on my own terms because OSS allows for that. Until hardware comes fully locked down and the models cannot be run on old hardware, both a long ways off, OSS is a way out.

utilize1808 2 hours ago | parent [-]

In the not so distant future, all your coding edits (for work anyway) will be through centralized gateways. Think remote desktop environment where pasting from the client is disabled.

blueblisters 2 hours ago | parent | prev | next [-]

Eh probably easier ways to do this. Just sanction all entities that release open weight models for "illegal distillation". Enough to cross the risk threshold for most businesses in the west, and reduce future monetization opportunities.

Daishiman 2 hours ago | parent | prev [-]

Not gonna happen; the incentives for bypassing this are too high.

dboreham 2 hours ago | parent | prev | next [-]

The battle was between Oracle and MySQL (and PostgreSQL won).

LastTrain 2 hours ago | parent | prev [-]

> and their profit margins along with It

lol that’s a good one.