Remix.run Logo
solenoid0937 36 minutes ago

> State actors, professional criminals will have same or better capabilities

State actors do but they are not unhinged enough to use this to cause massive loss of life, unlike random crazy people with access to a computer.

Professional criminals don't have access. Please explain exactly how you expect a professional criminal to get access to a non-safety-tuned Astra/Fable equivalent.

> OSS models can help to fix infra

You can work with the vendors of critical software to fix infra first, without giving every random crazy person access to something that creates cyber/bioweapons.

> "people dying and furry fanfics" is a scarecrow

You don't think people will die if OSS models make it easy to create a bioweapon, or make it easy to hack hospitals, infrastructure, and the like? Please explain your thinking.

It's very easy to order all of the raw material needed to create a virus, the challenge is in making a viable one. But models make this easy.

Same for cyber. Hospitals, emergency services, and infrastructure like power plants are not sufficiently hardened to withstand an attack from Fable-class models.

rescbr 10 minutes ago | parent [-]

Criminals don't need Astra or Fable. Get a bunch of GPUs, a good enough open weight model and a custom harness. What the model doesn't have in its weights it can research the Internet. How do you think black hat hacking is being done right now?

On bio: while it's easy to order all the raw material, there's the whole process of culturing bacteria/viruses/etc. that isn't trivial, and while a LLM might help in explaining stuff for rookies, there needs to be somebody physically working on it. It's not automatic. Once you get to this level, you'll find that any undergrad biologist or chemist can already make bio/chem weapons, and you don't see it happening. Terrorist groups already employ biologists or chemists that are supporters of their cause, no need for LLMs.

On cyber: aside of the question of why critical infrastructure is on the Internet on the first place (ah yes, lowest bidders, people not caring enough, business not giving IT/OT budget, S in IoT standing for security etc), if the available models can't handle cyber tasks, how can you defend yourself? See the HF "attack" that HF had to use GLM-5.2 to investigate what happened. This is the best argument for open models. Unless of course, you are the AI model creator or somebody they authorized to use their sanctioned model/harness and want to create a moat for their business.

This is FUD. Creation of business moats by fear.