Looking at the CAS number[1], it's the sodium oxide component of it that's likely the problem, yeah.

And yep, Na2O + H20 -> 2 NaOH, sodium hydroxide :)

[1] https://www.epa.govt.nz/database-search/chemical-classificat...