Remix.run Logo
Sol- 10 hours ago

Wonder if the whole cyber paranoia leads to their models ultimately generating less secure code. After all, if it has the ability to generate safe code, it would imply that it knows something about cybersecurity, which could surely be used to hack all the banks in the world.

pennomi 9 hours ago | parent | next [-]

Trying to censor nudity in image generation models caused all kinds of problems with anatomy in image models. I’m sure these models will have similar issues with security.

raincole 5 hours ago | parent | next [-]

Censorship on image generation models works on another level. The models can generate NSFW, but there are extra computer vision models checking if the images can be shown to the users. It's especially obvious for Grok and ChatGPT.

BoorishBears 4 hours ago | parent [-]

There are image models with censorship at every stage from pretraining to posttraining.

Most recently Ideogram released an open weight model that will denoise into a grey image with the text "Blocked by safety filter" notice for certain prompts

Of course, because it's open weights people have found defeats

NonHyloMorph 6 hours ago | parent | prev [-]

Interesting, you find that in medieval painting, due to the authority of the catholic church.

5 hours ago | parent | prev | next [-]
[deleted]
deaux 9 hours ago | parent | prev [-]

> Wonder if the whole cyber paranoia leads to their models ultimately generating less secure code.

This may be the goal.