Remix.run Logo
mmaunder 3 hours ago

“Each of the results cost roughly $100,000 in API cost to develop.”

And

“Over the course of a week, one Anthropic researcher worked together with Claude to develop the HAWK attack, and another researcher built a scaffold4 that allowed Claude to fully autonomously discover the AES attack.”

Spending $100k in tokens in a week is an impressive feat even with massive parallelization. I suspect the TPS their internal folks have access to is far higher than their bulk public endpoints.

There’s a tech aristocracy rapidly emerging in our society and it’s going to tear us apart.

kmoser 32 minutes ago | parent | next [-]

Today's state-of-the-art AI systems are the equivalent of late 1970s personal computers: bulky and expensive, but wildly more powerful than what came before. And look what happened: tech improved by orders of magnitude, and eventually computers were tiny and cheap.

I predict the same will happen with AI: certainly the latest and greatest will still command a steep price (yes, supercomputers are still a thing) but for most people who just need something reasonably fast and powerful, cheap (or free) AI will do the trick, especially when run locally.

So no, the aristocracy won't have a lock on the technology because tech is always being democratized. Until arbitrary computation itself is outlawed (and yes, I know, governments and industry are always inching us closer to that), we'll be ok.

jrflo 2 hours ago | parent | prev | next [-]

That's not really that ridiculous. Looking at my ChatGPT stats my biggest day of token usage was 1B tokens (seeing how far Sol Ultra could go on a difficult problem with a quantitative goal and eval harness that it could run on it's own that allowed it to keep going until it succeeded). I blew through my $100 subscription usage in that one day, but with a 80/20 token blend that's $10k in API billing. So, $70k in a week. With the higher cost of Mythos, that's not that crazy. It's more so a testament to how ridiculously marked up API tokens are, or how discounted subscriptions are (who knows which is true)

2 hours ago | parent | prev | next [-]
[deleted]
ecshafer 2 hours ago | parent | prev [-]

So $1-10k in Chinese model time, thus why we must ban them.

heaney-555 an hour ago | parent [-]

If a Chinese model can do it for $1-10K, then why hasn't one?

Why have all the mathematical (and now cryptographic) breakthroughs come from OpenAI and Anthropic?

Is it possibly because the Chinese models are so benchmaxxed they can't make novel discoveries?

arcanemachiner an hour ago | parent | next [-]

They're a few months behind the frontier, which, by the way, only started making these discoveries in the last few months.

poidos an hour ago | parent | prev [-]

Don't know if one has or not, but a lack of announcement is not a lack of success.

mwigdahl 25 minutes ago | parent [-]

Do you really think that if a Chinese model had achieved a significant math breakthrough that it wouldn't be trumpeted to the global media? The "Deepseek moment" was great for China; this would be the same.