> I've always said that LLMs are great for generating test suites

I always found that LLMs aren't great at writing tests, they have no notion of CI maintainability and they write a lot of "is 1 = 1?" worthless type of tests.

I've noticed they also love to write jest/vitest exhaustive input cases when one will do the job.