What harness are you using? DS V4 is harness sensitive.

lousken 4 hours ago | parent | next [-]

Are we testing the model or the harness? If benchmarks show certain numbers it should perform as such without it

You can't even run a benchmark without a basic harness, of course the harness has some effect.

	▲	0xbadcafebee 2 hours ago \| parent [-]
		Yep. It's a state machine; change the state, change the result. https://arxiv.org/html/2605.23950v1 \| https://arxiv.org/pdf/2505.15146 \| https://medium.com/@amontzamir/youre-praising-the-wrong-thin...

4 hours ago | parent | prev [-]

[deleted]

freakynit 4 hours ago | parent | prev [-]