| ▲ | lp92 3 days ago | |
Those benchmarks are easily gamed in my opinion. I take them woth a huge grain of salt. I am currently building an integrated CAD + Aero + CAM software package for rapid UAV design iteration, and the open models are all not very good at it. They make a ton of mistakes and I have to end up redoing a lot. And that's using very detailed specs and TDDs provided as context to the models. Opus/Astra/Argon/Gemini Flash 3.8/Sol does a significantly better job in my experience. | ||