"Culture fit" is an euphemism for "did the interviewer like you?"

If most interviewers don't like you, that's something for you to think about. It's not necessarily bad, if you have a very specific personality that most people find disagreeable, then it's a good idea to look out for companies that cater to your personality, and where you will fit in. But it is something to think about.