Remix.run Logo
renewiltord 2 days ago

That’s what Triplebyte planned on. The truth is I don’t trust anyone else to run evals.

thaumasiotes 2 days ago | parent | next [-]

> The truth is I don’t trust anyone else to run evals.

It's a common sentiment.

But compare https://www.cambridge.org/core/journals/judgment-and-decisio... . ("People predicting the future performance of college students state that interviewing the students aids prediction, although in fact the interviews make predictions less accurate.")

renewiltord 2 days ago | parent [-]

Well, the people who read that are welcome to try that and outcompete me in the market. Triplebyte still exists.

tonymet 2 days ago | parent | prev [-]

you're right there are quality issues, some probably deliberate.

but the screening cost for companies is eye watering so something should be done.