Remix.run Logo
shay_ker 5 hours ago

How much do the labs post-train on the harness inputs & outputs? That's a critical piece to understand if a "generic" harness is at all possible

yencabulator 5 hours ago | parent [-]

https://lucumr.pocoo.org/2026/7/4/better-models-worse-tools/ says already too much to use foreign tools.

simonreiff 5 hours ago | parent [-]

I think tools have to be flexible enough to accommodate a range of expected inputs. Even assuming models are trained to supply a particular schema, they are stochastic and randomly output variants regularly. My experience has been that it's better to try to auto-normalize the range of anticipated outputs and make tools as forgiving as possible rather than force an overly strict schema that might not match training data on the model.