| ▲ | motbus3 a day ago | |
We are not sure yet. As every tech we show the benefits first then we see the cracks. I think we might see more soon. I think the fact the are hiding the harness and the "real" model is a signal they are not confident they will keep improving. openai reported 95%+ on some benchmarks with an unpublished harness but when running with public harness and public model it is not a 30%+ improvement it is a 6% if that much... I really wonder why they need to do that | ||