I also feel like it's just a matter of time until someone cracks the nut of making agents better understand GUI's and more adept at using them.
Is there progress happening in that trajectory?