Remix.run Logo
Aachen 17 hours ago

I'm a member of Codeberg and was allowed to vote on these amendments. There was the annual assembly meeting before the ballots were sent by email. Each proposal had a short presentation and a few minutes of Q&A.

It wasn't a discussion (the text was final at this point), it was just to ask for clarifications. In the meeting I asked about the server load that they mentioned in their presentation, but misphrased it and got some answer about (AI?)bots scraping Codeberg and not if auto-generated code being shared on Codeberg is actually an issue.

It seemed pretty useless compared to commenting on the ticket where one could have a structured discussion. I also don't know how many of the >1000 members were in the meeting in the first place and how many just got the email "Wanna ban AI? Vote now!"

Once the results were announced, the rest of the users came into the ticket and started asking questions https://codeberg.org/Codeberg/org/pulls/1253#issuecomment-19... This was then shut down and if you have questions you should join the chat room on Matrix

Tepix 16 hours ago | parent | next [-]

There was also a discussion on the codeberg forum. Anyway, I hope this new rule will be overturned in the future. I think it invites arbitrariness and besides, whether or not a project was vibecoded (and how much) doesn't really decide how useful or even how well-written it is.

klardotsh 16 hours ago | parent [-]

[flagged]

Aachen 16 hours ago | parent | prev | next [-]

So I voted against, partly because I feel that the text doesn't to justice to such a multifaceted topic.

If all projects on Codeberg were human-written, that would be a big seal of quality! There are a lot of projects coming out now where someone feels like they've made a cool thing but it breaks on the first edge case and is entirely unmaintainable. Many are built on wrong principles because the prompt authors aren't savvy and don't know better. Some authors (I've encountered this in the OpenStreetMap community) even have the gall to pretend that their code is a gift that we now have to host and maintain. Aside from these quality and community issues, build and test pipelines also take a lot of compute resources, and with large growth in projects, that will increase as well. That the author of the proposal wants to avoid this makes a ton of sense to me.

But it also drives a lot of projects away because maybe you later want to use LLM assistance (imagine LLMs got twice as good as they are today), or maybe the auto-generated tests might become >50% of the code. You'd have to migrate your repository and community away from Codeberg. Why take that risk? It's just not a worry I feel that developers need. They're looking to get away from Microsoft (GitHub) for their open source project and that's the point where Codeberg should be a no-brainer

We're an open source community and so the mass stealing of all our work to feed LLM training which heats the world and causes (at least temporarily) giant price hikes in consumer hardware... there's a lot to say for more ethical training and use of LLMs, but does it matter at all if Codeberg bans LLM output? Won't we just make ourselves obsolete? Idk. It's multifaceted and this proposal seems too vague and blunt for me. That's not an option that's set in stone btw, just my current understanding of the different aspects

microtonal an hour ago | parent | next [-]

You'd have to migrate your repository and community away from Codeberg. Why take that risk? It's just not a worry I feel that developers need.

I feel like we are already there. I am not vibecoding a lot, but I certainly use LLM-assisted coding now for most of my work. Once you go beyond vibe coding, an LLM feels a lot like a compiler from your well-specified ideas to code. So, to some extend, these restrictions feel like disallowing a higher-level programming language in a time when everyone was still writing machine code.

I understand where this decision is coming from (especially because they have been under attack by LLM bots) and it is well within their right, but the vague language adds a lot of uncertainty:

You must not share projects that mostly consist of code written by "generative AI"-tools

It's clear that this excludes vibe coding. But what about LLM-assisted coding, where the developer writes very clear instructions of what to do and carefully reviews every line? In such cases a project 'mostly consist of code written by "generative AI"-tools', but the quality is probably not worse than fully hand-written code, especially because an LLM is often more able to 'think' of all kinds of corner cases.

I have some projects on Codeberg and donate monthly, but I have to reconsider both, since with this change Codeberg does not really align with how I work anymore. The projects that I have on Codeberg are largely human-written, but certainly use LLM-assistance for new code.

At any rate, I guess I'm back to GitHub until I have found a better alternative.

p2detar 25 minutes ago | parent [-]

> It's clear that this excludes vibe coding. But what about LLM-assisted coding, where the developer writes very clear instructions of what to do and carefully reviews every line?

My impression is that they don‘t care, it’s still ”slop” for them and for most of coderbergers for that matter.

But I do exactly this. It‘s a code base that I have written prior manually, before LLMs, so now this helps a lot with boilerplate and add features. LLM-assisted is not vibe-coding, but FWIW I don‘t care what others think.

therealpygon 15 hours ago | parent | prev | next [-]

A big seal of quality because it is human written? Maybe in narrow spaces but in general, I’d put money on the average developer being significantly worse at writing code with bugs than an AI. It’s codebergs infra so their choice, but it seems like an overly simplistic solution to a complicated advancing technology, in that it is a threadbare line between “vibe-coded” and “complex agent harness with human oversight and review”.

Also, I’m actually quite happy with some of the vibe-coded apps I use. Handy is an example, which started as a vibecoded app, and is fantastic for STT/dictation. It seems like a literal baby with the bath water approach.

lelanthran 3 hours ago | parent | next [-]

> I’d put money on the average developer being significantly worse at writing code with bugs than an AI.

I'd put money on the average AI-coded project being of a worse quality, simply because the number of vibe-coders with no experience now outnumbers actual coders using AI-assist around 10 to 1.

I'm literally seeing companies being pitched with B2B products written by people who had never written a program before, even as a hobby!

AI on average might write better code, but there's no way AI prompted by a shoe salesman is going to be better than code written by a person with even 2x years of experience.

therealpygon 2 hours ago | parent [-]

If that were the comparison I made — that a non-developer vibe-coding is better than a developer — sure, I’d see your point.

lelanthran 6 minutes ago | parent [-]

I think, perhaps, my point is that at this rate, pretty soon there won't be any non-vibed projects.

Even those devs that are currently overseeing are gradually atrophying their critical thinking skills in this space.

onion2k 3 hours ago | parent | prev | next [-]

I’d put money on the average developer being significantly worse at writing code with bugs than an AI.

I'd take that bet if it was measured in "bugs per day" instead of "bugs per LOC". LLMs generate far fewer bugs in absolute terms, but they also generate far more code, so it probably balances out if everything is equal. I think LLMs will actually lead to more bugs just because they're usually working with poorly defined requirements (prompts) and they guess to fill in the gaps based on the averages of their training data. A lot of those guesses are wrong.

Where LLMs win though is the severity. An LLM will write buggy code in the sense that it doesn't do what you wanted it, but not so much in the sense of security or data loss bugs. They get that right more than humans because they're trained to care about that stuff. There's far more "how to write good code" content in the training data than "how to not care about security and go fast" content (because writing that would be weird!)

therealpygon 2 hours ago | parent [-]

You’d take the bet if you could completely choose a different set of parameters? At no point did I say every line of a vibe-coded project in its entirety is better than every line of every repository created by humans, or anything of the sort.

You also go on to admit that the direct quality of the code is likely to better when written by AI — exactly the basis of what I argued — but wish to disagree with what I argued? An interesting position that I don’t quite follow.

The point was that using “human” as an indicator of “code quality” is nonsense. I get CB reasoning for disallowing “vibe-coded” apps when talking about the junk that people are constantly updating/building/deploying for an audience of none, wasting resources. Totally sensible from that perspective, but it takes a baby with the bath water approach that all vibe-coding is bad. I’m simply saying the point of view “if AI then bad, if human then good” isn’t grounded in reality and that your average developer is not producing high quality, well structured, well organized, well documented code. On average, it could be even odds as to whether that developer primarily works on Wordpress.

Aachen 15 hours ago | parent | prev | next [-]

I'm not saying you can't be happy with autogenerated software, especially for something like a dictation app where the main functionality amounts to a language selector (or calling into a detector) and calling TTSlibary.render(String text).play(). You could also just use an existing TTS app, but whatever works for you

For more complex software, so far it has been my experience that you get more predictable behavior (fewer edge-cases), performance, and relevant (but, to be fair, less comprehensive) documentation when someone thought about and built it

therealpygon 14 hours ago | parent [-]

For software that became popular, sure. Have you spent a lot of time looking at horribly written unpopular software that far outpaces the popular ones in quantity, not quality?

I fully agree that a well-written human application can be far better organized and documented. But I’m not talking about the top 10% that most people interact with and focus on, but rather the bottom 90% that get far fewer eyes and are way more poorly written, regardless of perceived complexity.

Aachen 14 hours ago | parent [-]

Hah, that's a unique argument. I haven't before been quizzed on how much time I spend with unpopular software. Do you have a minute? xD I think I use more unpopular software than 99% of the world population. Besides that it's part of my job to security test what are usually internal applications (every ~two weeks a new one), I also use basically only software from F-Droid and the Debian repositories, pulling only the apps from the Play Store from (semi) governments where it's unpractical to get by without them. Besides that, a lot of what I use is self-written, with number of users at most a few hundred, biasing heavily towards one. Yes, I'm familiar with hobby coding projects thank you very much :D

> I’m not talking about the top 10% that most people interact with and focus on

Im glad we're on the same page then :)

therealpygon 14 hours ago | parent [-]

I have all the time in the world for interesting topics of debate. I’ve equally reviewed quite a lot of poorly written tools, libraries, and APIs in the search for far less mainstream solutions to complex problems; guess our conclusions on what quality we found differ, which is the human experience.

Like I said, I’m not claiming AI outperforms in quality in all cases; it can be just as bad as human code can be. I just disagree with the idea that “human written” is a proxy for “quality code” in my experience.

shumaila12 3 hours ago | parent | prev | next [-]

[dead]

shumaila12 3 hours ago | parent | prev [-]

[dead]

mcv 15 hours ago | parent | prev [-]

> imagine LLMs got twice as good as they are today)

I have no idea how you'd quantify that, but they're pretty good already. At least in the hands of someone who knows what they're doing.

I share everybody's concern about many aspects of LLMs; copyright, data collection, energy use, component prices, not to mention what it does to us: outsourcing our thinking, dependency, slop. And I don't entirely disagree wanting to limit that.

And yet, I have just written a library that I was planning to put on Codeberg, but I've used a lot of LLM assistance for it, because it's simply too big otherwise. I put a lot of effort on code quality and architecture, and I don't think this counts as slop, but I do think it violates Codeberg's new rule, so I guess I'll have to look for another place.

No idea where yet; I don't want to go to Github, and I believe there were similar concerns about Gitlab, so I don't know where to go yet.

Aachen 14 hours ago | parent [-]

If you could have built it yourself but it was just too much work for the available time, then I trust that indeed the architecture will be sound and it sounds to me like it should be fine to build this way and host on Codeberg... until this amendment :/. I feel sorry that I'm part of this organisation that just shut the door on you

How's your appetite for self hosting? I've only ever hosted the predecessor of Forgejo, Gitea, and that was a breeze. Sadly I'm not aware of other open source hosting platforms, like, if you search "forgejo is confirmed" (with quotes) you find a lot of instances, but the point of Codeberg was the (presumed) longevity

mcv 13 hours ago | parent [-]

I was hoping my library is useful enough to enough people that a community would form around it. Self hosting doesn't sound like a good way to do that.

I'll have a look at Gitea. Otherwise it's probably going to be Github. Or I'll self host until I find something better.

vintagedave 17 hours ago | parent | prev | next [-]

Troubling, though I see it's a typical internet half-off-topic discussion. What kind of conversation has been present in the chat room?

embedding-shape 16 hours ago | parent | next [-]

> What kind of conversation has been present in the chat room?

The original reply that closes the issue is this:

> This is not a place to continue or start a new discussion about AI or not AI and its copyright status in the world, it will not change the results or how its going to be interpreted. I'm closing this issue, you're more than welcome to continue this at https://matrix.to/#/#codeberg-offtopic:matrix.org

Make of the room topic what you will.

Aachen 17 hours ago | parent | prev [-]

I didn't join the chat so I don't know that. It's final now anyway, nobody can change the text (next year you can propose another vote). No idea what the point would be of ephemeral conversations about it

boramalper 17 hours ago | parent | prev | next [-]

> I also don't know how many members were in the meeting in the first place and how many just got the email "Wanna ban AI? Vote now!"

Was that actually the subject of the email? If so that's nuts.

Aachen 17 hours ago | parent [-]

Sorry, I didn't mean to give the impression that was literal. I just assume that's how most people read the proposal. Looking it up, the email was:

> Subject: New poll on polls.codeberg.org

> A new poll has been created on polls.codeberg.org:

> Poll Question:

> Disallow vibe-coded projects (Terms of Use amendment) Do you agree to the changes from the Pull Request https://codeberg.org/Codeberg/org/pulls/1253/files being accepted?

> Plese vote with token [my_vote_token] here: https://...

> This vote is completely anonymous, voting slips are not stored, only a counter is incremented, your token is not associated with you or your IP address in any way and neither this mail nor your token when voting will be written to any log file.

> [some more info about how to use your token]

The voting URL is disabled now (or at least it currently shows me a blank page) but I remember it quoting the proposed amendment text and you could click agree, disagree, or abstain

boramalper 17 hours ago | parent [-]

Ah okay, and no problem!

nozzlegear 15 hours ago | parent | prev [-]

Extremely tangential, but:

> As highlighted by [...], status quo for now due to being sent for voting, minor edits can be made by the board/presidium if the text generally passes.

It's fascinating to me how relatively unknown projects like these have very fancy governance terms like board and presidium for what amounts to a handful of people in a private Discord DM discussing a text document. It's kinda like bureaucracy larping.

throwaway89201 14 hours ago | parent | next [-]

Nobody is LARPing an Eingetragener Verein, they're just being one, and the law requires them to have a board and presidium.

As they got hundreds of votes on the issue, that means tens of thousands of euros in membership contributions. It doesn't seem unreasonable to want to create a legal entity for that, and an e.V. is easier to set up in the beginning (although it can lead to a lot of drama later).

nozzlegear 13 hours ago | parent [-]

I believe you, but it still gives the outside impression of nerds taking themselves quite seriously. Leave it to the Germans to be tediously bureaucratic, I suppose?

pseudalopex 11 hours ago | parent | next [-]

You are American? American non profit associations must have officers and a board of directors.

nozzlegear 9 hours ago | parent [-]

I am, and I'm sure there are rules for non-profits in the US that are just as tedious! Like I said in a different comment, I didn't realize Codeberg had a whole German non-profit thing behind it.

Valodim 21 minutes ago | parent [-]

This tends to be necessary as soon as you move any non trivial amount of money around. You can't get a bank account without some bureaucratic overhead

kps 11 hours ago | parent | prev [-]

I have German background, so that was a genuine concern for me when I started using Codeberg 3 years ago. It's not a great surprise that they end up being more interested in rulemaking around FOSS hosting than in FOSS hosting itself.

Aachen 15 hours ago | parent | prev | next [-]

Sort of yeah! I got used to it by now. At the local hackerspace we have a voorzitter, penningmeester, and secretaris -> president, treasurer, and secretary I think would be the English terms. All sounding fancy and together they're the board. But they don't dress up or anything, it's just terms that are commonplace for small organisations here, in Germany (like with Codeberg) as in the Netherlands (like our hackerspace). In practice people just do as they see fit, the titles are often just a formality and not taken seriously unless you can use it to teasingly redirect work onto another person :)

mcv 13 hours ago | parent [-]

That's normal for any "vereniging", "Verein", union or association. My VVE (HOA) has that too. So did both of the student unions I've been a member of. There are organisations for playing games that have the same structure. As soon as you've got any kind of money or responsibility involved, you need some governance structure, or you're just giving your money to some guy.

tosti 13 hours ago | parent [-]

And the complexity of the governance structure is related to the amount of money involved.

The weirdest thing is when the money of a non-profit NGO exceeds roughly 10e6, the decisions made by upper management tend to make an inversionally proportionate amount of sense. Reason being, it's not their money to spend.

Took me a while to figure this out but now it's everywhere.

CodesInChaos 14 hours ago | parent | prev [-]

I think German non profit organizations are required by law to have a certain level of governance structure.

nozzlegear 14 hours ago | parent [-]

Ah, interesting! I didn't realize they were German, and didn't realize it's a non-profit as well. I thought it was just an open source project and that was that. That would explain the bureaucracy.