Unless I am mistaken, this would be the first heuristic-free model trained to play tetris, which is pretty incredible, since mastering tetris from just raw game state has never been close to solved, till now(?)

Pufferlib already had a pretty good model before: https://puffer.ai/ocean.html?env=tetris