If dirt-simple type operations like copy-paste yield useful improvements with even a small probability that would seem to open things up for adaptive reconfiguration and whole other classes of optimizations like genetic algorithms.

That right. Here is some interesting research on that https://sakana.ai/evolutionary-model-merge/