▲ | Imnimo 5 days ago | ||||||||||||||||||||||||||||||||||
The short answer is that they are applying the same defense to audio as to images, and so we should expect that the same attacks will work as well. More specifically, there are a few moving parts here - the GenAI model they're trying to defeat, the defense applied to data items, and the data cleaning process that a GenAI company may use to remove the defense. So we can look at each and see if there's any reason to expect things to turn out differently than they did in the image domain. The GenAI models follow the same type of training, and while they of course have slightly different architectures to ingest audio instead of images, they still use the same basic operations. The defenses are exactly the same - find small perturbations that are undetectable to humans but produce a large change in model behavior. The cleaning processes are not particularly image-specific, and translate very naturally to audio. It's stuff like "add some noise and then run denoising". Given all of this, it would be very surprising if the dynamics turned out to be fundamentally different just because we moved from images to audio, and the onus should be on the defense developers to justify why we should expect that to be the case. | |||||||||||||||||||||||||||||||||||
▲ | pixl97 5 days ago | parent | next [-] | ||||||||||||||||||||||||||||||||||
>find small perturbations that are undetectable to humans but produce a large change in model behavior. What artists don't realize by this they are just improving the models relative to human capabilities. The adversarial techniques like, for example making a stop sign look like something else, well likely be weeded out of the model by a convergence of model performance to average or above average human performance. | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||
▲ | jjulius 5 days ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||
Thanks! |