| ▲ | zorked 2 hours ago | |
I don't know about Chatgpt but I used Kimi (they have a Chinese-only plugin that does desktop control - works fine if you enable it even if you don't know Chinese). Observing how it works, it's mostly using the accessibility features of the user interfaces - it fetches a sort of DOM for the desktop applications. Only rarely it has to take a screenshot. | ||