Remix.run Logo
▲ umvi 6 hours ago

Can't wait until we get really well designed harnesses written in a compiled language that doesn't bloat my computer. Will probably have to be written by a company other than OpenAI because codex is like the exact opposite of everything I just listed

▲dummydummy1234 6 hours ago | parent | next [-]

Codex is written in rust, fyi... Not that I disagree.

▲umvi 6 hours ago | parent | next [-]

Oh, I haven't been keeping up. I assumed it was still TS since it prompts me to run npm all the time.

▲Twirrim 6 hours ago | parent [-]

They just use npm as a binary delivery mechanism, for whatever reason (I guess they expect all their users to have npm?)

▲judge2020 3 hours ago | parent [-]

It's pretty darn ubiquitous, yeah. Plus enterprises tend to run npm mirrors, so delivery integrates into existing IT compliance frameworks.

▲lynx97 6 hours ago | parent | prev [-]

Which generates unnecessarily huge binaries.

▲rfgplk 6 hours ago | parent [-]

It's because they statically linked it, and probably rely on a trillion pointless crates (as is standard in Rust development). A good statically linked harness can easily be ~5MB MAX

▲smartmic 6 hours ago | parent | prev | next [-]

Found this one: https://usehax.dev/

Anyone experiences with it?

▲serf 6 hours ago | parent [-]

it's okay.

it's minimal and somewhat opinionated, not integrated well with memory subsystems (although that's kind of the point)

my only real criticism is that last I played with it it deals with slow provider responses very poorly , so lots of locally hosted llms require a lot of tuning to get it to handle streaming/non-streaming/timers well.

way less minimal (but still pretty minimal) I prefer Pi; but different markets I think.

hax fit my openbsd laptop well, espescially since Pi and related derivatives are kind of un-spokenly incompatible with the BSDs.

▲OleksandrC 5 hours ago | parent [-]

(author passing by) Could you please report the issues you've experienced on the repo? I did quite a bit of testing myself on local models (Qwen, Ornith, Gemma, Muse Glimmer) with llama.cpp, and they all worked fine. Details would be helpful.

Also one brief note for Codex users specifically. hax can work out-of-the-box as codex-cli drop-in replacement (since it can use the already authenticated codex token), so it's super easy to try it - basically it will be a zero-config experience.

▲rfgplk 6 hours ago | parent | prev | next [-]

Just write your own harness. Ironically Codex/Claude are both abysmal.

▲theowaway213456 6 hours ago | parent | next [-]

How do you even write a harness that can use a Claude subscription? I thought it was not allowed by Anthropic's ToS and can get you banned?

▲pugz 3 hours ago | parent | next [-]

Amp recently achieved it. Apparently it's permitted as long as you use the Claude Agent SDK. https://ampcode.com/news/use-your-claude-plan

▲colinmarc 4 hours ago | parent | prev | next [-]

It's trivial to bypass this by tweaking the system prompt in other harnesses. They use string matching and a blacklist.

https://x.com/FlorianKluge/status/2041855675295318039

(Whether that's against the ToS is not clear.)

▲sroussey 6 hours ago | parent | prev | next [-]

That’s a different discussion.

▲fasterik 6 hours ago | parent [-]

I suspect a lot of people wouldn't use AI if they had to pay per token at current rates. Yes, it's technically a different discussion, but "just write your own harness" isn't really an answer for the vast majority of us riding on the investor-subsidized subscription plans.

▲rfgplk 5 hours ago | parent | prev | next [-]

If you're using the sub, only OpenAI (via the OAuth token) is viable. Claude is API_KEY only

▲agentdev001 6 hours ago | parent | prev [-]

It's allowed, but you get bumped to per token pricing.

▲arcanemachiner 2 hours ago | parent | next [-]

Not true; They rolled back some of the changes you're thinking about IIRC.

▲bhelkey 6 hours ago | parent | prev [-]

That defeats the purpose of using the Claude subscription.

▲sroussey 6 hours ago | parent | prev [-]

I did, and the weird things you have to do to make work at least decent. I’ve been doing evals and I got some things better than opencode but not as good as pi. Though my goal is to optimize for a browser and browser based llm so it can create stuff in a web container or at least generate ui by requesting json schema (a2ui style).

▲joquarky 3 hours ago | parent | prev | next [-]

They're not made of fairy dust; you can build your own.

▲koe123 6 hours ago | parent | prev [-]

Omp