Remix.run Logo
▲ motbus3 a day ago

We are not sure yet. As every tech we show the benefits first then we see the cracks.

I think we might see more soon. I think the fact the are hiding the harness and the "real" model is a signal they are not confident they will keep improving. openai reported 95%+ on some benchmarks with an unpublished harness but when running with public harness and public model it is not a 30%+ improvement it is a 6% if that much...

I really wonder why they need to do that