Skip to main content
Automatic execution runs tests with AI assistance, minimizing manual intervention.

Overview

In automatic mode:
  • Steps execute automatically
  • AI assists with element detection
  • Progress is tracked in real-time
  • Human intervention only when needed

Interface Layout

Execution Phases

Phase 1: Precondition Analysis

Before running steps:
  1. Device Check: Verify device is connected
  2. App Check: Verify target app is installed
  3. State Analysis: Analyze current device state
  4. Preconditions: Display required preconditions

Phase 2: Step Execution

For each step:
  1. Prepare: Read step configuration
  2. Analyze: If using locators, find element
  3. Execute: Perform the action
  4. Verify: Check for errors
  5. Capture: Take screenshot

Phase 3: Result Collection

After all steps:
  1. Summary: Compile results
  2. Screenshots: Organize captured images
  3. Report: Generate execution report

AI Analysis Features

Element Detection

When using element locators:
  • AI analyzes the screen
  • Locates the target element
  • Falls back to coordinates if needed

Adaptive Execution

AI can:
  • Handle minor UI changes
  • Detect unexpected dialogs
  • Suggest corrections

Analysis Overlay

During analysis, an overlay shows:

Controls

Pause Button (⏸️)

  • Pause current execution
  • Review current state
  • Continue when ready

Stop Button (✕)

  • Stop execution
  • Record partial results
  • Return to test round

During Failure

When a step fails:
Options:
  • Retry: Attempt the step again
  • Skip: Skip this step, continue
  • Abort: Stop the entire execution

Countdown Timer

Triggered Execution

When execution is triggered remotely:
  • 10-second countdown before start
  • Option to cancel if needed

Viewing Results

During Execution

  • Step-by-step progress
  • Current step details
  • Screenshots per step

After Completion

Detailed Results

Click View Details to see:
  • Individual step results
  • Failure reasons
  • Screenshots for each step
  • Timing information

Best Practices

Test Design for Automation

  1. Use element locators: More reliable than coordinates
  2. Add wait steps: Allow UI to settle
  3. Include verification: Confirm expected states
  4. Handle edge cases: Configure error handling in steps

Execution Tips

  1. Stable device state: Start from known state
  2. Network connectivity: Ensure stable connection
  3. Screen on: Keep device screen active
  4. No interruptions: Close notification-heavy apps

Troubleshooting

”Element Not Found”

  1. Check element locator configuration
  2. Verify element is visible on screen
  3. Try different locator strategy
  4. Add fallback coordinates

Execution Hangs

  1. Check device connection
  2. Verify Qaptly service is running
  3. Check for device dialogs/popups
  4. Restart streaming

Inconsistent Results

  1. Add longer wait times
  2. Use more specific locators
  3. Check for timing-dependent steps
  4. Review device state before execution

Related: