> Is it just that it's a pain to write apps for it..?

Other way around: Maintaining Xorg itself is awful.