Remix.run Logo
▲ simonw 4 hours ago

> The benchmark is saturated. Frontier models are tested with an armadillo in fishnet tights jaywalking on Mars.

OK well I couldn't resist this one:

  llm -m claude-opus-5.5 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
  llm -m gpt-6.1-sol 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
  llm -m gemini-3.8-flash 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
  llm -m mistral/mistral-large-4 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
Default reasoning levels for each: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
▲xmcp123 32 minutes ago | parent | next [-]

Big L for mistral in this benchmark. Sorry Europe.

▲flowardnut 3 hours ago | parent | prev | next [-]

The rover honking is pretty silly, opus has a good sense of humor

▲viraptor 2 hours ago | parent | prev | next [-]

I'm getting 403 inside the tool for this one. (The pelican bike on top works) This has been happening a lot recently.

▲simonw an hour ago | parent [-]

That's a GitHub rate limit. Try again now, I just pushed a hopeful fix: https://github.com/simonw/tools/commit/7793fb74c2d37bd613cdc...

▲viraptor an hour ago | parent [-]

It does seem to, thanks!

▲largbae 3 hours ago | parent | prev [-]

Gemini wins this one clearly. Honey please!