GUI Automation

GUI Automation plugin steps are used for automation of Web, Windows and Java Applets applications, on Windows and Linux OS.

Note:

Web technology works on Windows and Linux OS.
Java and Windows technologies work on Windows OS only.
Workflows designed with:
- Either Windows or Java technologies must run sequentially.
- A combination of Windows, Web, and Java technologies must run sequentially.
- Web technology can run parallel.
In cases where multiple rows are passed to a step, it is recommended to either use Windows/Java GUI steps within a child-workflow or employ sequential row-passing mechanisms such as Loop step.
For Java Technology, Security Warning popup that appear before opening the applet from web needs to be handled using GUI: Special Key Actions.
For Incognito Mode, make configuration changes in extension. Refer Appendix: Web extension installation.
If any non-Web GUI step is added in the workflow after Start browser step, then either Explicit Delay or Web wait until step needs to be add after start browser step.
When using the Java technology, the target application should be visible on active screen.
For Java/Applet Automation - Kindly open the applet target application by double clicking using windows automation steps.
In the plugin, the headless mode is supported for Web technology only.

Important:

You cannot create workflows, which have a combination of steps from both, Web GUI [Classic] and new GUI Automation plugins.
If you are automating webpages or web applications that might display ads, you will need to either design your automation to handle the ads or use an ad blocker extension to ensure your automation runs smoothly.
To upgrade from current GUI Automation version to version 4.0, complete the following steps in AE server and then upload the latest jar:
- Sign in as Sys Admin. Go to System Settings and enable the maintenance mode.
- Disable the workflows and then delete the GUI Automation plugin. For details, see the System Admin guide.

The following browser versions are supported for GUI Automation/GUI Spy in Release 4.0.

Browser Support	OS	Chrome	Firefox	IE	Microsoft Edge
Release 4.0	Windows	110 and above	110 and above	11	80 and above
	Linux	110 and above	110 and above		-

Important:

Installing Browser Extension is mandatory.
Browser Extensions are available on EPD. Download and install the required extensions.

GUI Spy

GUI Spy is used to build workflows with GUI Automation plugin steps for Web and Windows applications.

The GUI Spy dialog gives options to operate in Web, Windows or Web + Windows modes.

Note: If you select Windows Automation checkbox, then you can work with both Windows and Java technologies.

Select the Find windows element indices checkbox, if you want to search for the windows elements.
Select the Start in Incognito Mode checkbox, if you want to start the browser in the incognito mode. Else, the browser will start in the normal mode.
Note: The incognito mode will work only if you select the Web Automation checkbox.

References:

For sample workflows refer to the following projects in the AutomationEdge_R8.0.0_ProcessStudio_Activity_Guide:

Compatibility:

Windows 7/8.1/10, Windows Server 2008/2012/2016

Prerequisites:

Microsoft .NET Framework 4.8 or above

Check Plugin Support:

You may check if your target application elements are supported by Windows Application GUI Plugin steps.
Verify the target application elements against "Accessibility Insights for Windows" application.
You may check only for Element accessibility. Choose the criterion, Element from the list as seen in the following image:

Notes:

Use GUI Spy to build a workflow with GUI Automation plugin steps for Windows.
AutomationEdge Workflows with GUI Automation Windows steps should be marked Sequential.

Common action buttons:

No.	Common Buttons
1	Help	Click to see the Plugin description and configuration details.
2	OK	Click to accept configurations.
3	Cancel	Click to discard configurations.