I think the Cuban exiled community in Florida have too much of a hold on US politics as they leverage their local power a lot given FL is a swing state.

Weirdly, making this kind of criticism never warranted me a label of anti-Hispanic or anti-Cuban.

I would say it is borderline when you focus on the group rather than individuals. Also the Cubans haven't had the same history of racism as the Jewish people.