| ▲ | adrian17 3 days ago | |
The commit names look very weird too, feel more like marketing speak: > BREAKTHROUGH: Fix critical ID mismatch in Cap'n Web protocol > TIER 3 ULTIMATE: Extreme Stress Tests & Advanced Capability Composition > Achieve Cap'n Web protocol mastery with perfect capability composition (note: this exact commit name is repeated another time) The commit descriptions are even worse. If they’re so blatantly not written for anyone to read, why bother generating them at all? | ||
| ▲ | brian_meek 2 days ago | parent | next [-] | |
OP here. :-) (feel like I should put an emoji here). My focus as I "built" this was getting to a correct implementation, and putting in place guards and context to achieve that. As I moved through the process I added more and more ways to eval progress toward that. An area I didn't invest any of my effort in was commit messages, and some of them caused me to spit take as I saw them go by. I think this is something that can definitely be improved, and this conversation is fuel for thought on how to do this. | ||
| ▲ | svieira 2 days ago | parent | prev [-] | |
Yeah, LLM-created commit messages verge on "Brilliant Paula" for some reason. It's probably because nobody bothers to RLHF commit messages (yet). | ||