I do like this, but since most people put some big case on their phone anyway, does the thickness of the phone matter that much?

Well, a thick phone with a thick case is very thick while a thin phone with a thick case is only somewhat thick and a thin phone with a think case is only barely thick.