Remix.run Logo
cadamsdotcom 9 hours ago

Love the idea of RL for codebase health.

And a benchmark to measure against!

Imagine a "MaintainabilityBench" that rewards models which detect code duplication while working on a task and perform some refactor instead of glibly duplicating; or that detect the need for a new architectural layer, or that hoist a type constraint so there's no need for dumb casts. You can keep on imagining scenarios.

There are probably a few hundred distinct elements to RL for. The books "Working With Legacy Code" and "Architecture of Open Source Applications" would be great fodder.

Sadly don't have time to build it, there's this mountain of reviews in front of me...

dominotw 8 hours ago | parent [-]

> perform some refactor instead of glibly duplicating;

wouldnt that be part of original RL though. why would it be a seperate thing.

cadamsdotcom 8 hours ago | parent [-]

Because writing code that passes a test is different to passing the test while also noticing and performing a refactor.