My question is this: why is Palantir required for this kind of fairly basic data analysis? Couldn't they use much cheaper, probably open platforms for data science & analytics?

I don't see where it says who's paying whom. Maybe the deal is that Palantir gets more personal data to throw in a national profile database.