Skip to main content

Surface Click

Description

Surface Click performs mouse click actions on screen elements identified through image recognition. Use this step when you need to interact with buttons, links, or other clickable elements in remote or virtual environments where standard object handles are not available. It supports five click types — left click, right click, double click, middle click, and mouse move — and lets you target a specific position on the matched image, such as center, left, right, or a custom relative offset. This step is commonly used in Citrix or remote desktop workflows where every on-screen element is rendered as an image rather than an accessible UI object.

Configurations

Field NameDescription
Step NameName of the step. This name has to be unique in a single workflow.
Match Pattern- Retrieve Single closest match: It searches for and retrieves a single closest match. If the image is not found or multiple matches are found, then it throws an error.
- Retrieve Multiple close matches: It searches for matching patterns and retrieves the closest matches.
- Retrieve All matches: It searches for and retrieves all matches (not below 50% or above 150% of the original size).
Click TypeClick Type has five options as below:
1. Click - It performs left click action.
2. Right Click - It performs right click action.
3. Double Click - It performs double-click action.
4. Middle Click - It performs left Middle click action.
5. Mouse Move It performs Mouse Move action.
PositionChoose position on the selected image to perform the click action.
1. Left Center Left position of the Image.
2. Right Center Right position of the Image.
3. Center Center of the Image.
4. Custom Relative position from the entire Image. It could be anywhere on the screen. It is preferable to have the relative position of the relative element to click is closer to the current position.
Image IndexImage index is generated by the image locator of surface spy.
Timeout(in seconds)Specify a timeout in seconds to locate the image.
ImageView the selected image.