The problem is the seams. Seam durability has been the driving force in a lot of "obvious" clothing inventions over the ages, and is why things like medieval crotchless hose were around for so long.