For what it’s worth, his children were quite successful by all accounts. Two of the boys became successful businessmen after emigrating to the US and one of the boys became a director of the railway network in Hannover. Seems as though they weren’t harmed by their upbringing.

I mean just like most scientists at the time Gauss was rather wealthy, so it is unsurprising they were fine.