Visual Test Report

• View a Report

• Comparison Score

• Comparing Baseline and Current Executions

• Skip Regression on a Step

• Navigation

• Filtering

View a Report

Below are the required steps necessesary for a user to view a Visual Test report

Navigate to Reports Page. Select a report with the Visual Testing icon.

visual_testing_icon

Click the Visual Testing Report tab.

visual_testing_reports_page

Once these steps are followed, the visual testing report will be displayed and it will look similar to the image below

visual_testing_report_complete

Comparison Score

Each step will have a status attached to it based on it's comparison score. There are 4 different statuses:

• Perfect Match (100% Regression Match)

• Pass (99% - 94% Regression Match)

• Caution (93% - 87% Regression Match)

• Fail (<87% Regression Match)

The user can view a step's comparison score by hovering over the status icon on the top right of the card.

visual_testing_status

Comparing Baseline and Current Executions

To view the comparison between the baseline execution and current execution, click on any of the step cards. This will bring the user to Comparison View. To view the comparison score of the current execution, hover over the status icon in the top right corner.

visual_testing_comparison_view_score

Click on the eye icon to highlight changes between the baseline and current executions

visual_testing_after_regression

Perfect and Passing comparison scores will show zero to very insignficant changes. These minor changes may not always show changes within the comparison view when clicking on the eye icon.

visual_testing_comparison_view_no_changes

Skip Regression on a Step

If the user does not want to run a regression test on a specific step, the user can disable screenshots for that step before executing the test with Visual Testing. Doing this will result in the step not showing any regression score, as seen below

Note: To execute a Visual Regression test with disabled screenshots, the user must first execute a baseline test with those selected screenshots disabled.

Navigation

Click the arrows to navigate through steps. User can also input a test step number to immediately jump to that test step.

Click any of the step cards on the side panel to navigate to that selected step

The user can click the grid icon to return to Visual Testing Grid view.

Filtering

There are two ways to filter steps:

• Search field

  • filter by step number or description.

• Filtered Screenshots

  • filter by comparison score