Yes, a cartel is a failure mode to be wary of, but it's quite tedious to call an attempt to negotiate an international agreement a cartel. Global agreements are necessary to solve global problems, and many people believe that "AI is moving too fast" is a global problem.

Also, all they've really said is that they think it would be a good idea. That's a long way from an actual agreement.