| ▲ | Retr0id 4 hours ago |
| I worked on this specific task myself, using Claude, and I was not blocked (although I did not succeed!) |
|
| ▲ | nicce 4 hours ago | parent | next [-] |
| Can you be sure that the model was not constrained for you, regardless? Since they can’t help too much with cyber, they might avoid some routes to not get completely flagged and that could influence for not finding the solution. |
| |
| ▲ | Retr0id 4 hours ago | parent [-] | | I have seen behaviour a little like what you describe, in other tasks. When I was cracking the keys for Sony's camera firmware updates, Claude steered away from an obfuscated library, seemingly because it thought it might be related to licensing checks. It was indeed related to licensing checks, but also firmware update decryption. I had to explicitly tell Claude to write a deobfuscator for it, which it did, and eventually I had the keys. I later got Claude to crack their licensing checks too, by convincing it to write a "license checker" program, and then a second "test case generator" script for the license checker... (Opus 4.8 was smart enough to see what I was doing, but Opus 4.6 complied) |
|
|
| ▲ | novia 4 hours ago | parent | prev | next [-] |
| A form of being blocked is sandbagging the models |
| |
| ▲ | Retr0id 4 hours ago | parent [-] | | I saw no evidence of sandbagging. And since it was an open problem, there'd be no reasonable way to "steer away" from the correct solution. |
|
|
| ▲ | dogben 3 hours ago | parent | prev | next [-] |
| Same. I tried it just a few days ago. This news made me almost jump out of bed. |
|
| ▲ | tptacek 4 hours ago | parent | prev [-] |
| Same! |
