Remix.run Logo
▲ JackSlateur 5 hours ago

Just ask the LLM for these words, obviously !

▲yesco 4 hours ago | parent | next [-]

It's funny you mention this, because I've been thinking lately that all the focus on code quality benchmarks for LLMs seems to miss something. In my experience, LLMs aren't actually all that good at prompting other LLMs, and that's exactly the skill that matters for proper subagent usage.

The corpus of code available to train LLMs on is rich in both volume and quality. The same can't be said for LLM prompts. Prompts only came into existence alongside LLMs themselves, so most of the prompts out there are actually LLM generated, and training on them causes every model to overfit to the same patterns.

LLMs can give clear and concise directives to other LLMs, but only for basic tasks. Beyond that, they frequently overstuff their prompts with too much prose and too much direction, and worse, they often fill them with subtle contradictions.

Of course, there's a spectrum here. Some models turn out to be better at this than others, and I suspect this is what differentiates Fable-type models from the rest, and why vendors have started keeping their models' reasoning confidential.

▲dev0id 4 hours ago | parent [-]

The "agent factories" available to employees at the labs and hyperscalers clearly prove that agent delegation does work. Today, maybe that capacity lies with Fable class models, as you pointed out, but there is no doubt with opus 5.5 that this capability will be available to cheaper models as they get better.

▲alienbaby 5 hours ago | parent | prev | next [-]

That's what I've been doing in areas I lack knowledge tbh. Instead of a half assed attempt at describing what I need, I ask an llm to take my base idea and write it up using industry standard jargon as if I were commissioning a team to do the work. Has been working pretty well so far!

▲im3w1l 5 hours ago | parent | prev [-]

Okay so I just asked it "What question should I be asking you but I don't because I'm not smart enough to think of it?" Response was kind of interesting I have to say.

▲jonatron 4 hours ago | parent | next [-]

It gave me a very helpful answer, my project will be improving just because I asked.

▲Natsu 5 hours ago | parent | prev [-]

I did this just now, ironically before I even saw this discussion. I ended up questioning the AI about humanism.