If we used ascii delimited values none of this would be a problem. The amount of effort spent on csv must be close to a million man years and all because we want to edit the files with a text editor without a special mode.

The files are CSV-adjacent, I should say. The issue here isn't the delimiter in fact, it's the fact that the format differs slightly between files, even within the same project. That, and the mismatch with the SQL DB format I want.