https://chessbenchllm.onrender.com

There are several models with greater than 1200 elo

Also https://dubesor.de/chess/chess-leaderboard

I'll admit that's better than I expected, but these ratings also imply there are plenty of humans who will beat LLMs at chess.