Remix.run Logo
in-silico 2 hours ago

The training method is very similar to Importance Weighted Autoencoders: https://arxiv.org/abs/1509.00519

kamranjon 2 hours ago | parent | next [-]

In what way is it similar?

in-silico 2 hours ago | parent [-]

This algorithm: sample a bunch of latents, train the model using the one with the lowest error.

IWAE: sample a bunch of latents, weight the loss of training the model using each one by softmax(-error). For images and text where the errors have large variance, those weights become one-hot, yielding this algorithm.

zimablue22 2 hours ago | parent | prev [-]

Yeah. This work is over claiming the novelty quite a bit.