Idk if that's universal, when I run into people who struggle with English or just don't know it my first thought has never been this is a stupid person.

"Looking stupid" and "being a stupid person", or even "coming off as a stupid person" are not the same things.