I guess flutes and to a lesser extent clarinets were seen as "girly" (or maybe gay) instruments and boys were bullied for playing them.

The association isn't new, see the related slur for gay people.