Remix.run Logo
moralestapia 2 days ago

No, that intuition is incorrect.

Denoising models work because a lot of regions turn out to be smooth, you cannot do that "in a discrete way" if that makes sense.

janalsncm a day ago | parent | next [-]

Feel free to give a better explanation. I am not an expert. Clearly denoising models do work on text though.

moralestapia a day ago | parent [-]

This one's closer to the thing.

https://news.ycombinator.com/item?id=44059646

lostmsu a day ago | parent | prev [-]

They may be smooth in embedding space