These models still seem to struggle with getting repeated patterns right. Others have mentioned piano keys; I've noticed they also almost always fail to generate a valid Go board.