It also creates a perfect set of training data for future LLMs

It does and it's unfortunate. Perhaps Codeberg might try to block AI crawlers access to the entire website. I know it's all jazz nowadays, but I'm not in favor of using other's people work to train AI without explicit consent.