Remix.run Logo
Gwern's "Stem Humor" Directory(gwern.net)
7 points by surprisetalk 3 hours ago | 2 comments
throwaway314155 28 minutes ago | parent [-]

Not directly related, but I'm curious if gwern ever caved on their views about GAN's being "abandoned" for diffusion?

https://gwern.net/gan

gwern 5 minutes ago | parent [-]

No. I think the need for adversarial losses in order to distill diffusion models into one-step forward passes has provided additional evidence that GANs were much more viable than diffusimaxis loudly insisted.

(Although I'm not really current on where image generation is these days or who is using GAN-like approaches under the hood or what are the current theoretical understandings of GAN vs AR vs diffusion, so if you have some specific reason I should have "caved", feel free to mention it - I may well just be unaware of it.)