| ▲ | JackSlateur 5 hours ago | |||||||||||||
Just ask the LLM for these words, obviously ! | ||||||||||||||
| ▲ | yesco 4 hours ago | parent | next [-] | |||||||||||||
It's funny you mention this, because I've been thinking lately that all the focus on code quality benchmarks for LLMs seems to miss something. In my experience, LLMs aren't actually all that good at prompting other LLMs, and that's exactly the skill that matters for proper subagent usage. The corpus of code available to train LLMs on is rich in both volume and quality. The same can't be said for LLM prompts. Prompts only came into existence alongside LLMs themselves, so most of the prompts out there are actually LLM generated, and training on them causes every model to overfit to the same patterns. LLMs can give clear and concise directives to other LLMs, but only for basic tasks. Beyond that, they frequently overstuff their prompts with too much prose and too much direction, and worse, they often fill them with subtle contradictions. Of course, there's a spectrum here. Some models turn out to be better at this than others, and I suspect this is what differentiates Fable-type models from the rest, and why vendors have started keeping their models' reasoning confidential. | ||||||||||||||
| ||||||||||||||
| ▲ | alienbaby 5 hours ago | parent | prev | next [-] | |||||||||||||
That's what I've been doing in areas I lack knowledge tbh. Instead of a half assed attempt at describing what I need, I ask an llm to take my base idea and write it up using industry standard jargon as if I were commissioning a team to do the work. Has been working pretty well so far! | ||||||||||||||
| ▲ | im3w1l 5 hours ago | parent | prev [-] | |||||||||||||
Okay so I just asked it "What question should I be asking you but I don't because I'm not smart enough to think of it?" Response was kind of interesting I have to say. | ||||||||||||||
| ||||||||||||||