Remix.run Logo
banannaise 3 days ago

A bunch of these are just improper procedure: several who hit the clock before choosing a promotion piece, and one who touches a piece that cannot be moved. Even those that aren't look like rational chess moves, they just fail to notice a detail of the board state (with the possible exception of Vidit's very funny king attack, which actually might have been clock manipulation to give him more time to think with 0:01 on the clock).

Whereas the LLM makes "moves" that clearly indicate no ability to play chess: moving pieces to squares well outside their legal moveset, moving pieces that aren't on the board, etc.

fl7305 3 days ago | parent | next [-]

Can a blind man sculpt?

What if he makes mistakes that a seeing person would never make?

Does that mean that the blind man is not capable of sculpting at all?

sixfiveotwo 3 days ago | parent | prev [-]

> Whereas the LLM makes "moves" that clearly indicate no ability to play chess: moving pieces to squares well outside their legal moveset, moving pieces that aren't on the board, etc.

Do you have any evidence of that? TFA doesn't talk about the nature of these errors.

krainboltgreene 3 days ago | parent [-]

Yeah like several hundred "Chess IM/GMs react to ChatGPT playing chess" videos on youtube.

sixfiveotwo 3 days ago | parent | next [-]

Very strange, I cannot spot any specifically saying that ChatGPT cheated or played an illegal move. Can you help?

krainboltgreene 3 days ago | parent [-]

https://www.youtube.com/watch?v=iWhlrkfJrCQ He has quite a few of these.

sixfiveotwo 2 days ago | parent [-]

> Yeah like several hundred "Chess IM/GMs react to ChatGPT playing chess" videos on youtube.

If I were to take that sentence literally, I would ask for at least 199 other examples, but I imagine that it was just a figure of speech. Nevertheless, if that's only one player complaining (even several times), can we really conclude that ChatGPT cannot play? Is that enough evidence, or is there something else at work?

I suppose indeed one could, if one expected an LLM to be ready to play out of the box, and that would be a fair criticism.

krainboltgreene 2 days ago | parent [-]

I really wish I hadn't replied to you.

SonOfLilit 3 days ago | parent | prev [-]

But clearly the author got his GPT to play orders of magnitude better than in those videos

krainboltgreene 3 days ago | parent [-]

In no way is it clear, there's no evidence.