Remix.run Logo
famouswaffles 2 hours ago

What did they do to Astra so cracked at vision (and computer use). That ARC 3 score turned out to be no joke/fluke. That huge gap between Astra and Fable (in this case) is basically every hard vison/spatial benchmark i've seen including non-benchmarks like playing games (Portal, Factorio, RimWorld).

SpatialBench - https://x.com/spicey_lemonade/status/2096365630190698516

ZeroBench - https://zerobench.github.io/

Robot Arms - https://openai.robocurve.org/gpt-6-astra/

smusamashah an hour ago | parent | next [-]

I think Opus 5.5 is at same level now. I have seen too many videos made by Opus 5.5 today on twitter.

https://x.com/victormustar/status/2102707412704919910 horse galloping pixel art

https://x.com/LexnLin/status/2102133072585965759 moving train pixel art animation

https://x.com/jkeatn/status/2102441348075057539 painting with code

https://x.com/LCSlates/status/2102503027340988559 video, very detailed prompt though

https://x.com/aj_dev_smith/status/2102504509637587339 generated song/music with code

https://x.com/aj_dev_smith/status/2102575577563570450 another song

famouswaffles 24 minutes ago | parent | next [-]

I don't think so. These are cool but all of this is code to x. I'm talking about actual computer control.

Stuff like: - https://x.com/iam_zachi/status/2095992132620136677

Puzzles, games, painting software, robotic control and now driving. I haven't seen any other model fire on all cylinders like that.

prideout 37 minutes ago | parent | prev | next [-]

These are amazing but the parent comment is referring to vision comprehension, not generation.

smusamashah 27 minutes ago | parent [-]

Yup and I think these examples demonstrate just that. From my experience, both Claude and ChatGPT iterate over what they can see to build things like these. I don't think these examples are made without vision.

bigwheels an hour ago | parent | prev [-]

Do these examples demonstrate new levels of computer use capability?

dyauspitr 2 hours ago | parent | prev [-]

Well, they have the best in class image generator so that probably has something to do with it