Remix.run Logo
poilcn 5 hours ago

Nice. But these tests raise a question what results are reproducible, the final visual, time, tool calling or it's mostly noise. Like, have you tried same combination or model and harness multiple times?

alvins82 4 hours ago | parent [-]

I have on Qwen3.8 27B. Results are close enough across multiple runs.

mcrk 4 hours ago | parent [-]

So it's not reproducible.