|
| ▲ | xmodem 3 hours ago | parent | next [-] |
| "I worked on the physics engine, tests, via widely accessible libraries." is a nonsensical sentence as written, but a colleague who told me they had done this would be telling me a vastly different thing to if they had told me they had compiled the source code to a physics engine. There is a massive difference between prompting "security audit this codebase, make no mistakes", performing an in-depth agent or LLM-assisted focused search for security relevant code, or otherwise manually reviewing code as we did in the pre-LLM era. It behooves us to be honest about our own personal contribution to our output - both towards others and to ourselves. |
| |
| ▲ | tkz1312 3 hours ago | parent [-] | | I don't disagree with you necessarily, and I do think it a good practice to disclose how much of a contribution was llm generated, but regarding the difference an individual makes, I see a huge gap between different colleagues in how well they are able to use llms and the quality of the results they are able to produce with them, so I am increasingly inclined to view them as something closer to a compiler or SMT solver than a contributor in of themselves. | | |
| ▲ | boie0025 an hour ago | parent [-] | | I am also finding this disparity.
I hand off the agent skills I use daily, to produce the results I want in the way I want them, to some people and I still get poor results, and others I get good results. There's something about a combination of tools, prompting and FTGs about the outcomes that combine into these different results. I should imagine at some point that will disappear? |
|
|
|
| ▲ | LoganDark 4 hours ago | parent | prev | next [-] |
| > Quit saying Codex/Claude/an LLM did something. They didn't. You did. I think there's a vast difference between giving source code to a compiler (even a superoptimizing compiler) and giving a prompt to a language model. This distinction absolutely deserves to be called out and not swept under the rug. It doesn't make you any less responsible for what you submit, but it's courteous to your reviewers to be transparent. |
|
| ▲ | p-e-w 4 hours ago | parent | prev | next [-] |
| A frontier AI is nothing like a compiler. The litmus test is how much expertise was required to get it to find the results. If a basic prompt brings up an industry-shaking vulnerability of this caliber, then the human was at best a janitor. |
| |
| ▲ | Izkata an hour ago | parent [-] | | For me it's whether or not they've started committing prompts instead of code. |
|
|
| ▲ | wat10000 3 hours ago | parent | prev | next [-] |
| Is it really fair to say that I did something when my contribution was typing straightforward English prose for thirty seconds and then letting it run? Your hypothetical makes the opposite point from what you intend. If someone in 2015 said that they worked on a physics engine, and all they did was run the compiler on existing code, we'd laugh them out of the room. Pointing an existing computer program at existing work doesn't count as doing very much. |
|
| ▲ | NooneAtAll5 4 hours ago | parent | prev [-] |
| no, it's more like "I worked on physics engine. Well, more precisely, I used already made library and never even looked at actual physics" |