Skip to content
PLEXON AI
Theme
Download
Desktop Automation logo

App Connector · Automation

Desktop Automation

Read the screen and work in desktop apps from chat.

Let the assistant control desktop apps: read the screen, click, type, and launch apps. Hand it one whole goal for a single window and it works through that on its own with Jev, a fast decision model, on from the start with a switch in Settings.

What you can do

A connector lets the assistant use an app or tool for you. Once connected, ask it to work with Desktop Automation.

Control input

Move the mouse, click, type, and press keyboard shortcuts on your behalf.

See the screen

Capture screenshots and find the buttons, fields, and text on screen.

Manage apps

Launch, switch to, and close desktop apps.

Things you can ask

Type these in chat once the connector is on.

Open the invoice PDF and read me the totalFill this desktop form from the spreadsheetSwitch to the design app and export the current frame

What you need

No account is needed. Plexon downloads the required software to your computer. On macOS, grant Accessibility and Screen Recording permission. Windows and macOS are supported; Linux is a preview for X11 and XWayland apps. Turning Plexonaki on installs it for you.

Setup details

No account. The first install downloads a local engine (cua-driver). On macOS, grant Accessibility and Screen Recording permission once. Windows and macOS are supported. Linux is a preview: X11 and XWayland apps. A screenshot of a window drawn natively on Wayland may come back black.

When a task uses an online app, that app receives the request. Its results may also be sent to the AI service handling your chat. You can turn the connector on for one workspace and leave it off for another.

Once Desktop Automation is on

A connected app is a source. These are the parts of Plexon that draw on it.

  • AI Chat & Modes

    Turn one on with your own account and the assistant works inside that app.

  • Dynamic Workflows

    An inbound message or a poll on a connected app starts a run.

    A Tool step calls a connector directly, spending zero AI tokens.

  • Dashboards

    A widget's data can come from a connector tool call, refreshed on a timer.

  • Action Record & Tool Rules

    A call to a connected app is written down before it runs and again when it ends, with the app named on the row.

Connect Desktop Automation to Plexon

Install Plexon, open Apps, and follow the setup steps for Desktop Automation. Then describe what you want to do in chat.