> I can't see why I'd want an agent to click around Gnome or Ubuntu desktop but maybe that's just me?

What if you want to develop desktop apps?