Remix.run Logo
renewiltord 3 hours ago

I was able to reproduce the findings with Python deterministic static analyser. You just need to write the correct harness. Mine included the line numbers that caused the issue, the files that caused the issue, and then a textual description of what the bug is. The Python harness deterministically echoes back the textual description of the bug accurately 100% of the time.

I was even able to do this with novel bugs I discovered. So long as you design your harness inputs well and include a full description of the bug, it can echo it back to you perfectly. Sometimes I put it through Gemma E4B just to change the text but it's better when you don't. Much more accurate.

But Python is very powerful. It can generate replies to this comment completely deterministically. If you want, reply and I will show you how to generate your comment with Python.