He means he doesn't say it was necessarily bad intent, but mentions it as a possibility ("thinking out loud").

Thinking out loud isn't a free pass to say stuff without consequences. Sure we are all protected under free speech, but free speech doesn't remove the meaning and the impact words have in the world.