I think this error may be in the historical-basemaps data, because it is also present on https://historicborders.app/year/1800?lng=169.5234304&lat=-4...

It's more than character encoding. If you click on it, the description of New Zealand is "a quintuple star system some 1,200 light-years from the Sun"