That's just a fact, not something to argue around. People will judge you for many reasons, some cultural, some political, some ethical, some personal, some valid, some not. Its human nature.
Which is also not illegal and within some bounds and exceptions, a protected right across the globe.