Remix.run Logo
▲ pier25 2 hours ago

I've suspected for years that AI companies have been using commercial software to train their models including games, audio plugings, DAWs, etc. It would not surprise me one bit if we find out they used torrented pirated apps like they did with books and music.

There's certainly eg open source audio dev material out there but not nearly as much as web dev. How else do you explain all the avalanche of vibe coded audio plugins and DAWs appearing this year?

▲dachris 11 minutes ago | parent | next [-]

And (from a training material point of view) it makes perfect sense.

I would assume that to a LLM, a binary executable is not much worse than actual source code. And it's much denser, just missing the semantics of human-written identifiers. It's the code's pure logic, condensed into machine language.

And there's tons of it, many vendors supply it "freely" (you don't need license keys to train on a binary) It's often battle-tested code that you wouldn't get hold of otherwise, and compared to ingested source code its unlikely that Codex regurgitates a recognizable part of a Windows 2000 DLL into your C++ source code.

▲xnx 2 hours ago | parent | prev | next [-]

My hunch is that one of the handicaps Google is dealing with (vs. OpenAI and Anthropics) is that Google is not training on pirated media. They are using YouTube, Google book project scans, and purchased copies of media.

▲walthamstow 11 minutes ago | parent [-]

Perhaps they are not actively collecting it like Ant/OAI but YouTube and Google Books are full of user-uploaded pirated media.

▲mixtureoftakes 2 hours ago | parent | prev | next [-]

There is zero chance models are not trained on pirated media and games, especially most popular ones.

Makes complete sense to study things people actually want to use and consume

▲basilgohar 2 hours ago | parent | next [-]

I agree 100% with sentiment. It is inconceivable to me that models were not trained, either directly, or indirectly through other aggregates, on code and binaries and, of course, media, fetched from torrent or other filesharing sites.

▲Keyframe 2 hours ago | parent | prev [-]

wouldn't that information leak out or somehow found out? too many people already involved. With some, like Seedance it's obvious of course.

▲docshock 29 minutes ago | parent [-]

I thought the fact they fed copyrighted material into the models has been established.

▲singpolyma3 an hour ago | parent | prev | next [-]

Not saying you're wrong, but LLMs can work in areas they've never been exposed to in languages they've never been exposed to. Training is not needed for something to be possible

▲WarmWash an hour ago | parent | next [-]

They also use synthetic generated data to train on too

If it works and it's verified in nine different ways, throw it in the training pile, and then automate the process.

▲devmor an hour ago | parent | prev [-]

There is absolutely no way to prove that this claim is true because no model advanced enough to do so at a useful level has any fine grained report of its training data that could be used to verify this.

▲djleni 13 minutes ago | parent | next [-]

This is trivially true. Why can they work with a tool or API I’ve written or something internal to a company? They definitely have not trained on my local machine from 2020.

▲docshock 27 minutes ago | parent | prev [-]

I'm pretty sure companies are not throwing away their training data each time they build a model.

▲petu 2 hours ago | parent | prev | next [-]

> How else do you explain all the avalanche of vibe coded audio plugins and DAWs

By them being nothing special?

> appearing this year?

Vibe coding in general became viable last year, Opus 4.5 is Nov 24, 2025.

▲SyneRyder an hour ago | parent | next [-]

Also the 1 Million token context window helped make it more viable.

I've made a bunch of unreleased vibe-coded VST plugins to replace the hundreds that I've bought over the years - and many of the barriers to development weren't the model. Just having belief that the model was capable of the work, a bit like the 4-minute mile. Also knowing to persevere and iterate with the model, not giving up because the first UI is inevitably so amateurish.

There's also a flywheel happening. If you make permanent notes on the process, your rules for UI design, a library of re-usable components and algorithms, tools so the model can judge its own work... the whole process for the next VST just gets much faster & much easier. Same goes for any software you make with AI too.

▲whateveracct an hour ago | parent | prev [-]

so weird how AI boosters act like it hasn't been less than a year, isn't it?

▲bitwize 21 minutes ago | parent [-]

It hasn't been. Since Opus 4.5 "letting Dario take the wheel" became useful for the vast majority of programmers.

As of this fall, you are being professionally irresponsible and SHOULD NOT be working in the field if AI is not integral to your SDLC. At a minimum it should be checking your code for bugs and vulnerabilities.

▲saagarjha 17 minutes ago | parent | prev | next [-]

AIs are quite good at using existing binary analysis tools; they usually do not just operate on binaries in “prompt space” like this

▲rhdunn 2 hours ago | parent | prev | next [-]

It should be theoretically possible to use C/etc. source code, assembly output, and compiled output in the training set with equivalence mapping between them. That would make it possible for the LLM to learn disassembly and decompiling to some degree.

You don't need software for that aside from the compiler/linker tools (which are free for C/C++ compilers, rust, etc.). You can then permutate/generate the source code using tools/techniques like fuzzing.

There's also things like Intel's instruction set documentation.

▲cedws an hour ago | parent [-]

An LLM trained on decompilation would be a game changer, but there's no way they'd allow us to use it.

▲ 16 minutes ago | parent | next [-]
[deleted]
▲ape4 an hour ago | parent | prev | next [-]

Maybe you could use a regular decompiler. It makes bad variable and function names. Then get an existing LLM to correct the names.

▲dreamcompiler 15 minutes ago | parent | prev [-]

It's been a thing for a couple of years now e.g.

https://arxiv.org/html/2403.05286v2

▲riggsdk 2 hours ago | parent | prev [-]

In that case it would be movie-plot worthy when the LLM was trained on all those embedded viruses and malware. "Believing" it is intentional and then start embedding it into all software it creates for us.