Remix.run Logo
unknownfuture 2 hours ago

That's absolutely not true. Differently languages have greater or lesser representation in the training sets. You see a similar bias toward specific libraries within a given ecosystem, so much so that I worry about AI created technical monocultures as AI generated code converges to specific languages, packages, etc.

The LLM companies have truly astounding power to now steer the direction of the entire industry. It should worry all of us.

guardiangod 25 minutes ago | parent [-]

Rust does not have a bigger training set than say Python/JS/TypeScript/C++ .

monsieurbanana 13 minutes ago | parent [-]

Meta for example is spending a lot of effort and money into creating new curated programming training sets.

That means at least from their POV what's already available is not enough or not good enough, and if they're correct then the companies making the models can "artificially" inflate a language's representation.