Remix.run Logo
simianwords 6 hours ago

Can diffusion models have reasoning steps where they generate a block, introspect and then generate another until the output is satisfactory?

moeadham 6 hours ago | parent [-]

Well, you can take the output of a first pass and pass it back through the model like AR “reasoning” models do at inference time.

simianwords 6 hours ago | parent [-]

Yes and has this been tried?

Topfi 5 hours ago | parent [-]

Yes, Mercury 2 is a reasoning model [0].

[0] https://docs.inceptionlabs.ai/get-started/models#mercury-2