App Connector · Automation
Desktop Automation
Hands and eyes for native desktop apps.
Let the assistant control desktop apps: read the screen, click, type, and launch apps.
What you can do
Turn the connector on with your own account and the assistant works inside Desktop Automation.
Control input
Move the mouse, click, type, and press keyboard shortcuts on your behalf.
See the screen
Capture screenshots and read the accessibility tree to find on-screen elements.
Manage apps
Launch, switch to, and close desktop apps.
Things you can ask
Type these in chat once the connector is on.
How you sign in
No account. The first install downloads a local engine (cua-driver). On macOS, grant Accessibility and Screen Recording permission once. Windows and macOS are supported. Linux is not yet available.
Activation is per workspace, so the connector can be on for one project and off for another.
More in Automation
Connectors stack: turn on several and the assistant moves work between them.
Connect Desktop Automation to Plexon
Install Plexon, open the Apps view, and turn on Desktop Automation. From then on you just ask.