| ▲ | davidw 3 hours ago | ||||||||||||||||
> LLM as the main weapon LLM's - to date - seem to require massive capital expenditures to have the highest quality ones, which is a monumental shift in power towards mega corporations and away from the world of open source where you could do innovative work on your own computer running Linux or FreeBSD or some other open OS. I don't think that's an exciting idea for the Free Software Foundation. Perhaps with time we'll be able to run local ones that are 'good enough', but we're not there yet. There's also an ethical/moral question that these things have been trained on millions of hours of people's volunteer work and the benefits of that are going to accrue to the mega corporations. Edit: I guess the conclusion I come to is that LLM's are good for 'getting things done', but the context in which they are operating is one where the balance of power is heavily tilted towards capital, and open source is perhaps less interesting to participate in if the machines are just going to slurp it up and people don't have to respect the license or even acknowledge your work. | |||||||||||||||||
| ▲ | ordu 2 hours ago | parent | next [-] | ||||||||||||||||
> LLM's - to date - seem to require massive capital expenditures to have the highest quality ones, which is a monumental shift in power towards mega corporations and away from the world of open source Yeah, a bit of a conundrum. But I don't think that fighting for copyright now can bring any benefits for FOSS. GNU should bring Stallman back and see whether he can come with any new ideas and a new strategy. Alternatively they could try without Stallman. But the point is: they should stop and think again. Maybe they will find a way forward, maybe they won't but it means that either they could continue their fight for a freedom meaningfully, or they could just stop fighting and find some other things to do. Both options are better then fighting for copyright. > There's also an ethical/moral question that these things have been trained on millions of hours of people's volunteer work and the benefits of that are going to accrue to the mega corporations. I want a clarify this statement a bit. The thing with LLM relying on work of others are not against GPU philosophy as I understand it: algorithms have to be free. Nothing wrong with training LLMs on them or on programs implementing them. Nothing wrong with using these LLMs to write new (free) programs. What is wrong are corporations reaping all the benefits now and locking down new algorithms later. I think it is important, because copyright is deemed to be an ethical thing by many (I think for most people it is just a deduction: abiding the law is ethical, therefore copyright is ethical), but not for GNU. | |||||||||||||||||
| |||||||||||||||||
| ▲ | zozbot234 2 hours ago | parent | prev | next [-] | ||||||||||||||||
> LLM's - to date - seem to require massive capital expenditures to have the highest quality ones There are near-SOTA LLM's available under permissive licenses. Even running them doesn't require prohibitive expenses on hardware unless you insist on realtime use. | |||||||||||||||||
| ▲ | thenewnewguy 2 hours ago | parent | prev | next [-] | ||||||||||||||||
Is massive capital expenditure not also required to enforce the GPL? If some company steals your GPLed code and doesn't follow the license, you will have to sue them and somebody will have to pay the lawyers. | |||||||||||||||||
| |||||||||||||||||
| ▲ | jacquesm 2 hours ago | parent | prev [-] | ||||||||||||||||
> There's also an ethical/moral question that these things have been trained on millions of hours of people's volunteer work and the benefits of that are going to accrue to the mega corporations. This was already the case and it just got worse, not better. | |||||||||||||||||
| |||||||||||||||||