Remix.run Logo
askonomm 5 hours ago

Finally doing something standards-compliant instead of forcing users into a proprietary workflow.

swyx 4 hours ago | parent | next [-]

fwiw, i am with thariq https://x.com/trq212/status/2092302273099796842 in that prompts should be tuned for models and in fact blindly applying agents.md is probably an antipattern unless you want all models to basically converge to some common ill defined of instruction following - good local minima, bad global minima for model diversity and exploration of intelligence.

aka, sometimes it really is too early to force a standard

hadlock 3 hours ago | parent | next [-]

Is it realistic to rewrite your AGENTS.md every six weeks? That's about how often Anthropic releases a new point release of Opus.

sumedh 3 hours ago | parent [-]

You tell Opus to do it.

esikich 4 hours ago | parent | prev | next [-]

I have had very little luck with agents.md. What has worked well for me is a ./docs folder. They seem to just create and update stuff on their own.

4 hours ago | parent [-]
[deleted]
orlp 4 hours ago | parent | prev | next [-]

If you want this it's trivial to add an AGENTS.md that simply says "if you're Claude read CLAUDE.md, if you're Astra read ASTRA.md". A common entry point is good regardless.

jwolfe 4 hours ago | parent [-]

This wastes both tokens and turns. But yes it's probably the best option we have today.

pishpash 3 hours ago | parent | next [-]

It can try its own file and fall back to generic like here. What's wrong with that?

recursivegirth 3 hours ago | parent | prev [-]

Wasting turns? That is silly, use a better harness. Also token usage can mitigated by incremental discovery instead of stuck 5k+ worth of tokens in the AGENT/Claude md file.

jwolfe 3 hours ago | parent [-]

Every turn means more tokens in ways that are not obvious to most people and lead to tons of unnecessary cache reads.

No harness can batch your agents.md read with the reads the contents of the file tell it to read.

TomGarden 4 hours ago | parent | prev | next [-]

By this logic you'd probably be wise to tier your claude.md by model (sonnet/opus) as well as effort level too, considering the varying failure modes

swyx 3 hours ago | parent [-]

except they have similar pretrain/rlhf data which is the thing u really want to tune for

TomGarden 2 hours ago | parent | next [-]

YMMV but for me even models in the same family fail in different ways, and every incremental update changes it

3 hours ago | parent | prev [-]
[deleted]
willsmith72 4 hours ago | parent | prev | next [-]

depends what you're doing. if you've got a specialized agent deployed in prod, of course your evals and prompts will be targeted towards 1 specific version of a model.

on the other hand if it's just a local coding/"use my computer" agent, i highly doubt the effort in maintaining different prompts is worth any gain in performance

arcanemachiner 4 hours ago | parent | prev | next [-]

No thanks, I'm not tuning a bunch of files just for things to break when I switch models or a new one comes out.

I'll just use my one-size-fits-all AGENTS.md file and tweak it when the one of the clankers screw up. I don't have time for such busywork.

Actually, I will append extra rules to CLAUDE.md (which imports AGENTS.md) since there is a hook there, and Claude has its own foibles. So I'll backpedal a bit there.

qlte 3 hours ago | parent | prev | next [-]

It looks for Claude.md first so I don't understand what you think the problem is with the standard name as a fallback.

atonse 4 hours ago | parent | prev | next [-]

Yeah but are models good enough to review these files and say “i would work better if you worded it this way?”

groby_b 4 hours ago | parent | prev [-]

That's of course rather nonsensical.

In a "one LLM only" environment, your instructions are by default tuned for said LLM.

In a multi-LLM environment, roughly nobody will keep separate sets of instructions for each. It's not a realistic take.

On top of that: If your LLM is so bad at reading that it can't follow a set of instructions that wasn't specifically written just for that one single precious LLM, I sure wonder what that says about your employers repeated statements that ASI is definitely right around the corner.

mahboi 3 hours ago | parent | prev | next [-]

Trying to make a .md file proprietary by changing the name is hilarious

jwolfe 3 hours ago | parent [-]

claude.md predates agents.md.

mahboi 2 hours ago | parent | next [-]

Yeah but .md predates claude.md. I had agent.md files in my repo before Claude tried to act like it's a special protocol.

anon373839 2 hours ago | parent | prev [-]

The world has moved on.

klodolph 5 hours ago | parent | prev | next [-]

CLAUDE.md: @AGENTS.md

fphilipe 5 hours ago | parent | next [-]

    ln -s AGENTS.md CLAUDE.md
kreetx 4 hours ago | parent | next [-]

Why not hardlink - so it wouldn't even know?

wgd 4 hours ago | parent [-]

Because Git can track symlinks and not hard links since they look like ordinary files.

mlnj 4 hours ago | parent | prev [-]

Wake up babe, new recursive self learning technique just dropped.

gcampos 4 hours ago | parent | prev [-]

I tried that before, it doesn’t work. Claude will not prioritize AGENTS instructions the same way it did for CLAUDE.

ln was the only thing that worked for me

llm_nerd 4 hours ago | parent | prev [-]

I'm honestly not sure if this is tongue in cheek and the "finally" is in the silly way it is often used, but the claude.md variant existed first. Indeed, the agents.md thing was pretty clearly a "that's neat, let's do that with a different name".

verdverm 3 hours ago | parent | next [-]

It's "finally" because people have been asking for it for a long time. No one cares that "claude was first," what they want is for Ant to follow the conventions and not put extra work on us. This was such a minimal thing to do, and considering how much they vibe and claim "coding is solved," we thought it would not be too difficult to respect AGENTS.md, so finally seeing it happen, while nice, is too late for me. I've moved on from Big Ai and only use open weight models now.

bredren 4 hours ago | parent | prev [-]

There’s also that whole MCP thing.