Remix.run Logo
▲ A_D_E_P_T 2 hours ago

OpenAI's models -- and even Google's Argon -- have particular niches where they shine. For GPT-6/6.1, it's 3D modeling; Astra is hands-down the best at making .step files, Blender files, etc. For Argon, it's natural language writing and everything that hooks up to Google, e.g. search and maps-based itinerary planning.

Anthropic and DeepSeek (+ GLM) are definitely solving coding, though!

They're all quite different tools.

▲Kurtz79 2 hours ago | parent | next [-]

Artificial Analysis recently released a dedicated 3D benchmark, where Astra lags behind both Opus and Sonnet 5.5 (and yes, open weight models seem to be quite far behind).

https://artificialanalysis.ai/articles/aa-3d

▲A_D_E_P_T an hour ago | parent | next [-]

Interesting!

For me it's large files in Blender (in some cases >400MB), mostly, where Astra excels. I gave it a look, but I don't know if the benchmark encompasses that sort of thing.

.step files are simpler pieces of straightforward code, so it makes sense that Opus and Sonnet 5.5 do very well...

▲swiftcoder an hour ago | parent | prev [-]

its unfortunate they didn't include deepseek in the initial batch of benchmarks

▲ 2 hours ago | parent | prev [-]
[deleted]