Wouldn’t this still be technically a copyright violation? It seems unlikely this is all public domain stuff.

Yes, but you'd have trouble finding someone who has standing and desire to sue.