Flimsy? No. I mean they won't survive a tornado, but homes aren't usually built with surviving a direct tornado hit in mind.

Sure it's not as strong as brick or concrete blocks, but it's strong enough for normal, every day use.

Where it does pale in comparison is hanging heavy objects on the wall. You do need to secure heavy loads to a stud, instead of just drilling and anchoring anywhere in the wall. However what it lacks there it more than makes up for in ease of routing low-voltage cables in an existing home.

Also, if I really wanted it, I could knock out almost all of my interior walls and completely change the layout of my home. Not something you do on a whim, but you can absolutely do so when renovating a home.