App Connector · Automation
Desktop Automation
Read the screen and work in desktop apps from chat.
Let the assistant control desktop apps: read the screen, click, type, and launch apps. Hand it one whole goal for a single window and it works through that on its own with Jev, a fast decision model, on from the start with a switch in Settings.
What you can do
A connector lets the assistant use an app or tool for you. Once connected, ask it to work with Desktop Automation.
Control input
Move the mouse, click, type, and press keyboard shortcuts on your behalf.
See the screen
Capture screenshots and find the buttons, fields, and text on screen.
Manage apps
Launch, switch to, and close desktop apps.
Things you can ask
Type these in chat once the connector is on.
What you need
No account is needed. Plexon downloads the required software to your computer. On macOS, grant Accessibility and Screen Recording permission. Windows and macOS are supported; Linux is a preview for X11 and XWayland apps. Turning Plexonaki on installs it for you.
Setup details
No account. The first install downloads a local engine (cua-driver). On macOS, grant Accessibility and Screen Recording permission once. Windows and macOS are supported. Linux is a preview: X11 and XWayland apps. A screenshot of a window drawn natively on Wayland may come back black.
When a task uses an online app, that app receives the request. Its results may also be sent to the AI service handling your chat. You can turn the connector on for one workspace and leave it off for another.
Once Desktop Automation is on
A connected app is a source. These are the parts of Plexon that draw on it.
- AI Chat & Modes
Turn one on with your own account and the assistant works inside that app.
- Dynamic Workflows
An inbound message or a poll on a connected app starts a run.
A Tool step calls a connector directly, spending zero AI tokens.
- Dashboards
A widget's data can come from a connector tool call, refreshed on a timer.
- Action Record & Tool Rules
A call to a connected app is written down before it runs and again when it ends, with the app named on the row.
More in Automation
Connectors stack: turn on several and the assistant moves work between them.
Connect Desktop Automation to Plexon
Install Plexon, open Apps, and follow the setup steps for Desktop Automation. Then describe what you want to do in chat.