There is no posttraining data commons

mindwok 5 minutes ago | parent | next [-]

A posttraining data commons and the infrastructure surrounding it is the next great open source project IMO, akin to Postgres or Linux.

The Marin project from Stanford (and I believe now ran by Openathena, the authors of this blog post) is really promising and cool: https://marin.community/

▲

impossiblefork 2 hours ago | parent | prev [-]

I think a post-training common would have to be somewhat protected, since these things would be created with great effort and would potentially impact people's ability to earn money in their jobs.

I could also imagining them happening as state projects for the sake of competitiveness.

▲

dannyw 31 minutes ago | parent [-]

They're already kinda protected, open weight releases rarely come with datasets, especially post-training datasets. NVIDIA is probably the exception.

I also wonder when the NSA starts sharing their wiretaps/etc with labs for 'national security'. Probably already happening, to be honest.

	▲	Retro_Dev 2 minutes ago \| parent [-]
		> I also wonder when the NSA starts sharing their wiretaps/etc with labs for 'national security'. What would this benefit the NSA? If they share wiretap records with labs such as Anthropic, then suddenly anyone who can jailbreak a model gets access to this data. You don't need to train a model on data to understand or interpret it, as far as I know - providing others (esp. AI labs) with sensitive data is a breach of security, or I am not understanding.