|
| ▲ | dd8601fn a day ago | parent | next [-] |
| I wouldn’t read too far into that. Claude has busted me down to Haiku multiple times for asking middle school level genetics and biology questions. It’s silly fast about deciding you might be al qaeda. I’m a thoroughly average guy. I’m not capable of asking competent supervillain questions. And Anthropic said they couldn’t say if any of the “bioweapon” safeguards went off on nefarious efforts. I’m probably in those numbers. So read it as marketing more than something to lose sleep over. They’re mostly gating stuff a sufficiently motivated person would find with a library card. |
| |
| ▲ | esseph a day ago | parent [-] | | It is apparently a big deal. https://openai.com/index/building-an-early-warning-system-fo... https://www.rand.org/pubs/research_reports/RRA2977-1.html --- "Prompting Moremi Bio Agent without the safety guardrails to specifically design novel toxic substances, our study generated 1020 novel toxic proteins and 5,000 toxic small molecules. In-depth computational toxicity assessments revealed that all the proteins scored high in toxicity, with several closely matching known toxins such as ricin, diphtheria toxin, and disintegrin-based snake venom proteins." "The findings from this toxicity assessment challenge claims that large language models (LLMs) are incapable of designing bioweapons. This reinforces concerns about the potential misuse of LLMs in biodesign, posing a significant threat to research and development (R&D). The accessibility of such technology to individuals with limited technical expertise raises serious biosecurity risks. Our findings underscore the critical need for robust governance and technical safeguards to balance rapid biotechnological innovation with biosecurity imperatives." https://arxiv.org/abs/2505.17154 |
|
|
| ▲ | tacomagick a day ago | parent | prev | next [-] |
| Non-zero chance if LLMs have access to the data required to make a bioweapon a regular person can do so too. Non-zero chance every second a meteor could hit you. |
|
| ▲ | __rito__ a day ago | parent | prev | next [-] |
| How about developing counters to said bioweapons? That capability should be commoditized too, IMO. |
| |
| ▲ | ascorbic a day ago | parent [-] | | This isn't cybersecurity. You can't use an LLM to create and administer vaccines for all potential bioweapons. | | |
|
|
| ▲ | rolymath a day ago | parent | prev | next [-] |
| Same can be said for books. Are you against books? |
| |
| ▲ | iamnothere a day ago | parent [-] | | I have seen some people in these discussions arguing against making certain knowledge available in other forms, based on hypothetical dangers. Unfortunately, not everybody is supportive of freedom of knowledge/information. |
|
|
| ▲ | 63stack a day ago | parent | prev | next [-] |
| Coming straight from the Anthropic marketing department |
|
| ▲ | Jemm a day ago | parent | prev [-] |
| You could say the same thing about libraries and education. |
