Yes and no. Generally, you don't necessarily get bullied but you lose opportunities to interact with people. Most students in the US do not care about academics more than they need to, and the kind of "nerd" to care about math and science likely doesn't have much to talk about with these people or even is able to have a meaningful conversation without being told something along the lines of "it's not that deep" or "I'm not reading allat"