Actions & Sequences

Overview

The Actions tab lets you build, save, and replay sequences of actions — clicks, keystrokes, bash commands, AI messages, and more. Unlike chat-based interactions where the AI decides what to do, saved actions are deterministic: they execute exactly as you defined them, every time.

This makes actions ideal for:

• Repeatable workflows — Login sequences, form submissions, data entry routines
• Multi-step automations — Navigate to a page, extract data, process results
• Consistency — Ensure the same steps run the same way across multiple runs
• Data-driven processing — Run the same sequence across many rows of captured data

The Actions Tab

The Actions tab sits alongside the Chat, Queue, and other tabs on your agent page. It shows:

• Toolbar — Add New button, Record toggle, filter dropdown, Play All with delay controls
• Action List — A drag-and-drop list of all saved actions
• Bulk Operations Bar — Appears when you select multiple actions

How Actions Get Saved

Actions can be saved to your sequence in two ways, controlled by the Auto-Save setting in Action Settings:

Auto-Save Enabled (Default)

When auto-save is on, every action the AI performs during a chat session is automatically saved to your action history. As the agent clicks, types, runs commands, and navigates — each action appears in the Actions tab in real time.

This is great for building sequences organically: tell the agent what to do via chat, and the actions are captured automatically.

Auto-Save Disabled

When auto-save is off, AI actions still appear in the chat as tool-call blocks, but they include an "Add" button. You manually choose which actions to save to your sequence. This gives you selective control — keep only the actions you need and skip the rest.

Recording Actions Manually

Beyond capturing AI actions, you can record actions directly by interacting with the live sandbox preview.

How to Record

1. Open the Actions tab
2. Click the Record button (next to "Add New") — it requires an active sandbox
3. The button turns red and shows a pulsing REC indicator
4. Click, scroll, and type on the live sandbox preview — each interaction is captured as an action
5. Click REC again to stop recording

What Gets Captured

The Action Editor

Click Add New to open the Action Editor, or click any existing action to edit it. The editor provides a full-featured interface for creating and configuring actions.

Action Categories

The editor organizes actions into four categories:

Mouse Actions

Input Actions

Navigation Actions

Advanced Actions

Custom Titles and Notes

Every action supports:

• Custom Title — A descriptive name (e.g., "Click Login Button", "Enter Search Query"). This replaces the auto-generated label in the action list.
• Note — Additional context (e.g., "Use the test account credentials", "Wait for page to load first").

Placeholder Syntax

For Type Text and AI Message actions, you can use placeholder syntax to inject data from captured datasets:

• {{field_name}} — Replaced with the field value from the current data row
• {{field_name | default_value}} — Uses the default if the field is empty

This powers data-driven playback, where the same action sequence runs across many rows of data.

Replaying Actions

The Actions tab provides several ways to replay your saved actions:

Play Single Action

Click the Play button (▶) on any action card to execute just that one action immediately on the sandbox.

Play All Actions

Click Play All Actions at the top of the Actions tab to execute the entire sequence from start to finish. The agent runs each action in order with a configurable delay between them.

Play From Here

Open the play dropdown (▶ ▾) on any action card and select Play from here. This starts playback from that specific action and continues through the rest of the sequence.

Play Selected

When you have actions selected (via checkboxes), a Play button appears in the bulk operations bar. This runs only the selected actions in their original order.

Auto-Play Delay

Use the delay dropdown next to the Play All button to configure the wait time between actions:

Playback Progress

During playback, a progress indicator appears showing:

• Standard playback: "Playing action 3 of 12"
• Data-driven playback: "Row 2 of 10 • Action 3 of 5"

Click Stop at any time to halt playback immediately.

Data-Driven Playback

When your agent has captured structured data (via the Data Capture action), you can run your action sequence across every row of that data.

How It Works

1. Build an action sequence that uses {{field}} placeholders (e.g., type {{company_name}} into a search box)
2. Ensure you have captured data with matching field names
3. Click Play All — the system detects placeholders and offers data-driven mode
4. Each row in your dataset runs the full sequence independently
5. Placeholders are substituted with the actual values from each row

This is powerful for tasks like: "For each company in my list, search for it on LinkedIn, capture the company page, and save the results."

Organizing Actions

Drag-and-Drop Reorder

Grab the grip handle (⠿) on any action card and drag it to a new position. The sequence order updates immediately and persists to the database.

Duplicate Actions

Hover over an action and click the duplicate icon (⧉) to create a copy. Useful for repeating similar steps with slight modifications.

Delete Actions

Hover over an action and click the trash icon. Click again to confirm. Deletions are permanent.

Filter by Type

Use the filter dropdown in the toolbar to show only specific action types:

• All — Show everything
• Bash — Only bash commands
• Click types — left_click, double_click, etc.
• Type — Only text input actions
• Any other action type present in your sequence

Bulk Operations

Selecting Actions

• Hover over an action to reveal its checkbox
• Click the checkbox to select/deselect
• Shift+Click to select a range (from last selected to current)
• Select All toggle in the bulk bar selects all visible (filtered) actions

Bulk Actions

When one or more actions are selected, a bulk operations bar appears at the bottom:

Action Settings

Open the settings drawer (gear icon) from the Actions tab to configure:

Auto-Save Actions

Toggle whether AI actions are automatically saved to your action history. When disabled, actions appear in chat with an "Add" button for manual selection.

Clear Action History

Permanently delete all saved actions from this agent. This shows a confirmation dialog with warnings — cleared actions cannot be recovered.

Tips & Best Practices

• Start with auto-save on — Let the AI build your initial sequence, then refine by editing, reordering, and removing actions
• Use custom titles — Name your actions descriptively so the sequence reads like a script: "Navigate to Login", "Enter Username", "Click Submit"
• Add Wait actions — Insert waits between actions that trigger page loads or animations
• Test incrementally — Use "Play from here" to test specific parts of your sequence without running everything
• Use AI Message actions — For steps that need intelligence (like "find the right button" or "summarize this page"), use an AI Message action instead of hardcoded clicks
• Combine recording and editing — Record a rough sequence by clicking through the sandbox, then refine coordinates and add advanced actions in the editor
• Keep sequences focused — Build multiple short sequences rather than one massive one. You can run them separately or combine later

What's Next?

• Chat & Sandbox — Learn about the chat interface and live desktop preview
• Datasets — Understand captured data that powers data-driven playback
• Runs & Scheduling — Schedule your action sequences to run automatically
• Credentials — Store credentials securely for Use Credential actions