Remix.run Logo
MattCruikshank 7 hours ago

Sure, but NERFs were trying to match your input photos and poses, not some arbitrary prompt, if I understand correctly.

Lerc 7 hours ago | parent [-]

Yes they are image generators. You want image generator generators.

A diffusion style process generating gausians instead of pixels. You could possibly do nerfs that way, but it would be effectively generating a trained network. If you managed to do that it would have broad application throughout the field of AI.

dpoloncsak 4 hours ago | parent [-]

What would this look like in practice? A net that outputs weights for a new net to use?

xigoi 4 hours ago | parent [-]

Couldn’t you “uncurry” such a process to have only a single network?

dpoloncsak 3 hours ago | parent [-]

Probably? I'm no expert, just a SysAdmin trying to keep up really... but in my head it's would look like a form of MoE that would gen the 'Expert' model on demand instead of having a variety baked in.

That's assuming you could even reasonably train a neural net to output viable weights, of course.