I’m not here to defend credit agencies but I will point out that the GDPR does put the onus on them to make sure the information is accurate. This is a net positive.

The power to delete your data with them would actually result in exactly the situation you described, likely without the requester knowing that’s what’ll happen!