Remix.run Logo
▲ harry8 a day ago

Does every large company have a big server with some h100s and a couple of open weight models for just such an occasion. Especially if you don’t have the luxury of being able to wait or postpone eg under cyber attack?

▲wanderingmind a day ago | parent | next [-]

Only until NVIDIA starts cryptography verification and block anything not from US closed models, which should be anytime soon

▲mark_l_watson a day ago | parent [-]

I hope that doesn’t happen. There is a good alternative: if MOE models work for you, then Apple Silicon does a decent job at inference using whatever harnesses you like.

▲sausagefeet a day ago | parent | prev | next [-]

Just get an OpenRouter or Vercel account. Your option aren't pay Anthropic or buy hardware yourself, there are hundreds of providers out there.

▲lavendermon a day ago | parent [-]

Claude has us locked in right now while they subsidize cheap usage to get us subscribed and dependent on their monthly plans.

▲sausagefeet a day ago | parent | next [-]

It depends on what "us" means. I am switched off of Claude almost entirely now except for background things where I want to abuse my subsidized account. Otherwise, OpenRouter + open weight models are my daily drivers. It takes a bunch of work but I'm doing it for roughly a max20 account cost, a bit more, but it's not like the difference is huge. They are less capable but I've modified my workflow to mitigate that as much as possible, and I can still do things when Anthropic goes down.

▲Alwayshasbeeb a day ago | parent [-]

What models are you using? I was satisfied with deepseek v4.1 while ai was still using my brain, before being time-pressured into shipping something I don't understand and now I feel I need stronger models to steer it. Kimi K3 or the closed models through openrouter is too expensive compared to subsidized plans though so I'm using a $20 sub for light reviews/consultations.

▲p_l a day ago | parent | prev [-]

As temporary backup, one can use claude models hosted on GCP - my understanding is that those don't depend on platform.claude.com and should be available even if main claude platform is dead

▲polarsanel a day ago | parent | prev [-]

There is an absolute tonne of competition.