Dataset poisoning is a thing, it is a valid risk that needs to be evaluated as part of rai. Misalignment is also a risk. Just go through Arxiv for a taste.