I refuse to believe this is not some sort of marketing piece for author's company.

This is such a short-sighted take and author seems unaware of what damage can be done with powerful open weights models (intentional or not).

Jail-broken Fable level LLMs can mean constant hacking leading to public desertification of the web (best case). Now imagine state sponsored bio lab leaking strange viruses on yearly basis. We've seen enough evidence already, it is difficult for me to imagine an engineer living at the centre of the change is writing this piece.

It's a different question if you ask me if I trust a single company to police the technology. But with the current state of things, I unwillingly admit that no state entity can do a better job at the moment.

▲

Marha01 20 hours ago | parent | next [-]

> Jail-broken Fable level LLMs can mean constant hacking leading to public desertification of the web (best case).

A jailbroken model that can hack a website can also easily fix the vulnerability that allowed it to hack it. There is a limited number of such vulnerabilities. Over time, all vulnerabilities that are discoverable by the model would be patched and status quo would be restored (until a more powerful model is released: rinse and repeat).

	▲	ascorbic 7 hours ago \| parent \| next [-]
		And in the meantime, every site in the world gets hacked. It takes far longer to fix every vulnerability than it does to find one unpatched one. Mythos has led to huge numbers of reported vulnerabilities on every kind of software. If those were all dropped as zero days (which is effectively what an open weight model would do), attackers can choose an unpatched on at their leisure while defenders race to fix them all and update everything.
	▲	notcodingtoday 20 hours ago \| parent \| prev [-]
		Hence, the best case. Yet, the damage is permanent. Your favourite trail walking app patching things after the attack does not undo your location getting leaked. In your scenario, during the disruptive phase, I can imagine apps advertising 'we have Mythos backed security company defending our data'. Reminiscent of showing how much your gun is bigger than your neighbour or gangs on the street, it's truly distopian.

▲

nijave 18 hours ago | parent | prev [-]

State sponsored maybe but it looks to take at least 6Ti of VRAM to run which is quite costly...