Hey HN,

I'm sick and tired of the big labs controlling most of the generative AI landscape. We are launching Llama Fund as a means of democratizing large scale AI model training through crowd funding.

Our platform will allow researchers to propose a training pipeline, from data curation to the number of GPUs required. Ideally they will already have a toy model working. From there users can crowdfund the effort based on milestones. Researchers can offer incentives, such as providing commercial licenses to contributors.

We hope this will open up a whole new avenue for large scale model work, powering the open source future of AI.

Would love to hear thoughts from the community!

▲

pama 3 days ago | parent | next [-]

Who is “we” (in the “We are launching”) and what is the mechanism you can convince people/investors that you or the proposer of the project know how to train large scale models and can make accurate practical estimates?

	▲	mountainriver 3 days ago \| parent [-]
		I have post-trained LLMs a lot, but ultimately it's not me proving it, it's the researchers who would pitch their work. They can pitch it however it makes sense for their work, giving milestones similar to any other crowd funding platform.

▲

CuriouslyC 3 days ago | parent | prev | next [-]

I think this is cool, it's not too hard to get a 500m model doing some sort of interesting stuff as a home researcher but scaling it into the low billions to see if it remains competitive out of my own pocket is a non starter.

	▲	mountainriver 3 days ago \| parent [-]
		Exactly! Even if we could get to training 8b models that would be amazing

▲

echelon 3 days ago | parent | prev | next [-]

Don't use the name "Llama". Llama is not open source.

▲

doctorpangloss 3 days ago | parent | prev [-]

What happened to Open Model Initiative?