| ▲ | synapsomorphy 3 hours ago | |
Sokoban is cool, but far from the most interesting thing here, which is the design of experiment factories for verifiable domains. The base building blocks you need to make this work: - dataset - unhackable success metric - hardened, isolated f(dataset, solver) -> metric - helps a ton but not required: human with strong intuitive domain understanding This is exactly the kind of RL environment in which the models are forged, so they're truly excellent at basically all stages of this process. I'm working on something similar for image and video compression. The SOTA approach for these things currently is mostly deep neural networks. But agent powered experiment factories let you cover FAR more ground in algorithm-space than before, which makes deterministic and explicit algorithms, with little or no heuristics (aka floating point weights) feasible once again. Explicit algorithms (SGD) grew implicit ones (neural nets) that are more powerful and general, but also more opaque and less efficient. Now those implicit ones have made search over explicit algorithms vastly faster, which is making them increasingly competitive with neural methods. | ||