Remix.run Logo
Etheryte 4 days ago

Strong agree, Claude is very quick to forget things like "don't do this", "never do this" or things it tried that were wrong. It will happily keep looping even in very short conversations, completely defeating the purpose of using it. It's easy to game the numbers, but it falls apart in the real world.

joquarky 3 days ago | parent [-]

I've found it better to use antonyms than negations most situations.

typpilol 3 days ago | parent [-]

Same here. Always tell them the way you want it done.

For example:

Instead of "don't modify the tests"

It should be: analyze the test output and fix the bug in the source code. The test is built correctly.

Not the best but you get the idea.

The one problem with this is if you don't know how to do something properly. Like if you're just writing in your prompt "generate 90% test coverage" , you give it a lot more leeway to do whatever it wants.

And that's how you end up with the source code being modified to fit the test vice versa