Visual Regression Testing With Qyrus Mobile
Last updated
Last updated
Visual Test Report
Visual Regression Testing on Qyrus allows users to compare screenshots between test script executions for visual discrepancies. This can be done on the entire test script or on specific screens as an action type ("Visual Testing Verify Screen"). Comparisons are done after a test script execution completes and passes to ensure consistency between screenshots.
Because of the subjective nature of Visual Regression Testing, Qyrus uses a combination of AI and Traditional Computer Vision techniques to capture differences from both a human perception perspective ("Similarity Score") and from a pixel-to-pixel perspective ("Pixel Pass").
Similarity Score The AI component of Visual Testing in Qyrus. Comparisons focus on notable features of the screen (text, images, color, lists). This is meant to mimic the way a human would check for similarities.
Pixel Pass A direct comparison of each screenshot's pixels based on their position on the screen. Pixels that differ are marked as "error pixels". The score is calculated as follows:
Other customizations like ignoring portions of screenshots or setting pixel fail thresholds can help tailor visual comparisons based on the needs of each screen. More details can be found at the links below.
