| ▲ | jjcm a day ago |
| Image->html test for Argon. I'd put it at B tier, just under gpt 6.1 sol. It isn't A tier like Opus 5.5 or Astra. Argon build: https://html.non.io/lcars-argon/ GPT 6.1 sol: https://html.non.io/lcars-gpt-6.1-sol/ Opus 5.5 (currently SOTA for this): https://html.non.io/lcars-opus-5.5/ Original designs: https://diffui.ai/app/canvas/5093e689-1e74-4f26-b632-2a4500f... |
|
| ▲ | bobviolier a day ago | parent | next [-] |
| I don't know how you rate, but the Opus 5.5 is literally stuttering and lagging when scrolling on a Macbook Air M3 (for me). (Chrome, also incognito) |
| |
| ▲ | jjcm a day ago | parent | next [-] | | More info on this - I ran a few tests on my mac and linux systems with chrome/firefox. I highly suspect this is due to gpu acceleration being disabled. https://image.non.io/e7165331-432b-45c3-986e-c2973f12d377.we... As soon as gpu acceleration is disabled, the webpage goes from 60fps across the three systems I tried to ~7-20fps when software rendering is forced. I suspect if you go to chrome://gpu you'll find something different from what I have here: https://image.non.io/a47a1b03-1b87-4fd5-92a2-b39e62b1cfd9.we... | | |
| ▲ | bobviolier a day ago | parent | next [-] | | Nice research, you are right! Seems that low power mode was on. I have been using the web, Netflix, Apple TV app, and anything else just fine without ever noticing a thing though. So that all being said, a normal website should work totally fine on low power mode, and this should definitely be a negative on the Opus implementation. | | |
| ▲ | jjcm a day ago | parent [-] | | > and this should definitely be a negative on the Opus implementation. I would disagree with this based on two things: 1. the prompt, which explicitly states to render the planets in the background in 3js (thus the gpu implementation). 2. the purpose of this, which is a test of its ability to convert an image design into a html/js/css implementation that matches it as closely as possible. I've talked about this before when it's come up[†]. The purpose is to be a good test, not a good design or website. For reference, here's the full prompt used: > Create a web page implementation from the following instructions: https://diffui.ai/build/Futuristic_Interior_UI_build.md?auth... dont reference any other folders that have similar builds. Focus on the flowing SVGs. Animate elements that make sense to be animated. For the starships that have planets in the background, ask for high quality images with the windows as a transparent background, and recreate the planets behind them in 3js. It should be one single page application that I can just open the index.html file to view. [†] https://news.ycombinator.com/item?id=49997135 [‡] here's a copy of this since the diffui build instructions wont be accessible without an account: https://non.io/lcars-build-instructions |
| |
| ▲ | piperswe 10 hours ago | parent | prev [-] | | Even after ensuring GPU acceleration is enabled on Firefox on Linux, it's still sluggish. |
| |
| ▲ | daemonologist a day ago | parent | prev | next [-] | | The Opus 5.5 implementation is noticeably slow on my machine as well (Firefox, Fedora, Gnome Wayland, AMD 6800U). | |
| ▲ | jjcm a day ago | parent | prev | next [-] | | Interesting! Do you have webgl disabled for incognito or for chrome in general? I wonder if it's trying to do software rendering. FWIW, I have literally the exact same configuration (M3 air, google chrome). Here's a recording on mine where I'm seeing 60fps: https://non.io/video/video-3587018401.mp4 | | |
| ▲ | Gallows4574 a day ago | parent | next [-] | | Mine doesn't stutter on on Firefox on M1 Max, but it pins 7 cores the entire time the page is open, not just while loading. It also uses 50% of GPU in addition to that. Edit: The argon built site pins 1.3 cpu cores. The Sol 6.1 site uses 0.18 cores. | |
| ▲ | dr_kiszonka a day ago | parent | prev | next [-] | | Unless it is something with the playback on my end, your animations and scrolling are a bit jerky too. | |
| ▲ | ziiinq a day ago | parent | prev [-] | | [dead] |
| |
| ▲ | MaxikCZ a day ago | parent | prev | next [-] | | Mac Air M1 in Safari here, buttery smooth. | |
| ▲ | wireless6948 a day ago | parent | prev | next [-] | | Also stuttery on Edge (Chromium), so there might be a pattern here | |
| ▲ | niek_pas a day ago | parent | prev | next [-] | | Fine on arc search (which I think is just WebKit) on iOS. | |
| ▲ | hedgehog a day ago | parent | prev [-] | | Maybe a Chrome bug? It's fine in Safari on an M1. | | |
| ▲ | piperswe a day ago | parent [-] | | Also horrifically sluggish on Firefox on Linux. | | |
| ▲ | hedgehog 9 hours ago | parent [-] | | Weird. Hopefully they converge, I don't miss the days of wildly divergent browser engine behavior. |
|
|
|
|
| ▲ | jjcm a day ago | parent | prev | next [-] |
| One interesting observation - it's the only one I've seen make an ASCII representation of the layout of each of the pages before building: https://image.non.io/46e0cce3-34d9-4fcb-8775-bfc2c70bc4bb.we... |
| |
| ▲ | jadbox a day ago | parent [-] | | That's really interesting I think- literally putting the layout into ascii language to reason about. |
|
|
| ▲ | danpalmer a day ago | parent | prev | next [-] |
| Very subjective, but I'd say the Argon one is the best here. The other two don't quite do LCARS correctly, there are a bunch of lines/curves that are the wrong angle, don't line up, etc. The Argon one looks to me the most like a designer would have done it. Of course this is up to personal taste to some extent. |
| |
| ▲ | jatins 21 hours ago | parent [-] | | Are you checking on desktop? On phone Argon one is completely broken |
|
|
| ▲ | awkwardpotato a day ago | parent | prev | next [-] |
| Argon's build is pretty much unusable on mobile, the header takes up half the screen |
| |
|
| ▲ | jdthedisciple a day ago | parent | prev | next [-] |
| Opus one has by far the worst performance, the only one that's stuttering and making my laptop fans very noisy. |
|
| ▲ | Panzer04 a day ago | parent | prev | next [-] |
| Opus is way slower in firefox on my machine than the other two. |
|
| ▲ | sergiotapia a day ago | parent | prev | next [-] |
| Damn opus 5.5 is just such a good model - what kind of moloch sacrifices are they doing in there |
| |
| ▲ | capnjngl a day ago | parent | next [-] | | Truly S-tier. It's sharp, creative, intuitive. Can't believe how much better it is than Opus 5, then they went ahead and made it cheaper and faster too. | |
| ▲ | jjcm a day ago | parent | prev [-] | | I'm constantly blown away by it. I do think Astra is slightly more intelligent (although worse at this particular benchmark), but Opus 5.5 has become my default model for 99% of what I do. It's so good. |
|
|
| ▲ | demibabs a day ago | parent | prev | next [-] |
| B tier? For me the argon one is really quite bad on mobile; the nav is messed up enough to make the page kinda unusable. |
|
| ▲ | derac a day ago | parent | prev | next [-] |
| On firefox on linux, argon looks great and the other two have graphical issues. |
|
| ▲ | vessenes a day ago | parent | prev | next [-] |
| That Argon build is really bad on mobile fyi |
|
| ▲ | civvv 16 hours ago | parent | prev | next [-] |
| Jesus Christ, so much "stuff" crammed into so little space. What a nightmare of a website. |
|
| ▲ | rrr_oh_man a day ago | parent | prev | next [-] |
| Off topic, but I want to customize a starship now |
| |
|
| ▲ | jbrooks84 a day ago | parent | prev [-] |
| How on earth can you say one is better than the other? It is subjective. |
| |
| ▲ | jjcm 20 hours ago | parent [-] | | For an implementation test, there are a bunch of very objective things you can measure. IE for Argon, the third section doesn't have a top view of the ship with labels going to each section like what's in the design. Opus has it, and animated it as well. One failed to do as instructed, the other went an extra mile. |
|
