This kinda have a point, if Chinese companies can distill US models and offer it at a competitive price, what prevents another US startup doing the same? OpenAI and Anthropic can actually influence the regulations to be a barrier for entry.

Also regarding all the hacks, I always wonder why are they so boring, like agents posting to some wiki or using a bug in documentation to execute some code in a sandbox remote server, like if AI is so dangerous, how come they haven’t hacked into banks and stolen money or hacked into North Korean nuclear program and shut it down or any other major disruptive incident.

▲

XenophileJKO 12 hours ago | parent [-]

I probably have an unpopular viewpoint. I think the hacks really showed that the alignment is kind of mostly working.

There is still a lot of work to do and the agents did some damage, but the blast radius was pretty small and they could have done much more damage if alignment didn't hold up as well.

Edit: Though I do want to be clear it does also show how a maligned model probably can do some serious damage.

▲

sajithdilshan 10 hours ago | parent [-]

> There is still a lot of work to do and the agents did some damage

If it was actually damage and disruptive shouldn’t police or the respective authority do an investigation on that? Because that’s usually what happens when a damage or harm is done by someone. That way we would actually be able to see a third party independent investigation on how dangerous the agents are. Right now we’re just blindly trusting whatever AI companies are saying. What is they aimed the agents on purpose to do those tasks to push their narrative and push for regulation

	▲	dd8601fn 4 hours ago \| parent [-]
		One strategy to head that off seems to be “Just have a friendly corp buy the victim real quick.”