Remix.run Logo
hakunin 2 hours ago

It helps, but it doesn't make it deterministic. LLMs could all be misled together. A different story would be if we had deterministic models, where the exact same input always results in the exact same output. I'm not sure why we don't try this tbh.

verdverm 2 hours ago | parent | next [-]

I've been wondering if there are better random seeds, like how there are people who hunt for good seeds in Minecraft

exe34 2 hours ago | parent | prev [-]

it's literally just setting T=0. except they are not as creative then. they don't explore alternative ideas from the mean.

hakunin 2 hours ago | parent [-]

Are you sure that it’s T=0. My comment’s first draft said “it can’t just be setting temp to zero can it?” But I felt like T is not enough. Try running the same prompt in new sessions with T=0, like “write a poem”. Will it produce the same poem each time? (I’m not where I can try it currently).