Checking Results in the Output Panel #
After executing the scenario, test results are displayed in real-time in the Output Panel.
(Example: The Output Panel displays the step name, execution time (hh:mm:ss), and related messages.)
When an Assertion action is included, the test results are color-coded based on the outcome:
- Red for Failed
- Yellow for Warning
- Green for Passed
Hovering over a completed step in the Output Panel highlights the corresponding step in the scenario with the same color, making it easier to identify the execution location.
Verifying Results Using the Step Result Window #
Clicking on a step in the Output Panel opens the Step Result window, where you can review the tested UIObjects. This window allows you to compare the scenario authoring screen with the running screen to analyze each step in detail and ensure accuracy.
① Displays the executed step name.
② Shows the step result message.
③ Lists the UIObjects used in the test.
④ Displays the screen and resolution used during scenario creation.
⑤ If an anchor was used during scenario creation, it will be displayed (clicking the anchor shows its properties in section ⑥).
⑥ Shows the attributes of the UIObject.
⑦ Displays the screen and resolution of the executed scenario.
⑧ Hovering over the ‘?’ help icon explains the meaning of UIObject colors.
⑨ Clicking the ‘Show Details’ button provides additional information about the tested UIObject (enabled when matching fails).
⑩ Clicking the anchor displays its properties.
⑪ Shows the attributes of the matched UIObject.
Step Result Display Based on Language Settings #
Actions affected by language settings:
- Store Value
- Store Random Number
- Store Random Text
- If Value
- Loop NTimes
- Loop Value
- Assert Value
- Script
- Block
Clicking an action in the Output Panel opens the Step Result window, allowing for a detailed review of each step’s execution results.
① The step name of the action is displayed.
② The result message of the step is shown.
③ Displayed only if the key attribute was used during scenario creation.
④ A list of attributes and their values set during step creation is displayed. For PASSED results, the list is collapsed by default and can be expanded to view details by clicking.
Exporting Test Results #
Exporting as a ZIP File #
After completing the test, you can export the test results by clicking the Export Test Results button (
) in the Output panel.
Exporting scenario execution results is useful for analyzing errors or seeking additional support.
The exported file is compressed in .zip format and contains logs, execution screen images, and other relevant data.
Sharing the exported file allows you to provide detailed test results and receive feedback for troubleshooting.
Encrypting zip Files #
- For macOS (OSX):
- Create a secure disk image and set it as the Workspace to encrypt the test result files.
- For Windows:
- Use Folder Properties > Advanced Attributes > Encrypt contents to secure data to encrypt the test result files.
Troubleshooting & Support Requests #
If an error occurs during scenario execution or additional support is needed, follow these steps:
- Describe the issue: Provide a brief explanation of the problem or the support needed.
- Attach the file: Include the exported test result file (.zip format).
- Send an email: Email the description and the attached file to contact@apptest.ai.