Remix.run Logo
kevmo314 5 days ago

How would flow matching work? In language we have inputs and outputs but it's not clear what the intermediate points are since it's a discrete space.

Etheryte 5 days ago | parent [-]

One of the core ideas behind LLMs is that language is not a discrete space, but instead a multidimensional vector field where you can easily interpolate as needed. It's one of the reasons LLMs readily make up words that don't exist when translating text for example.

kevmo314 5 days ago | parent | next [-]

Not the input and output though, which is the important part for flow matching modeling. Unless you're proposing flow matching over the latent space?

Xmd5a 5 days ago | parent | prev [-]

[flagged]