Ctrlk
Documentation Home
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Test-Reports-and-Analysis

Comprehensive test reports are a fundamental aspect of your testing workflow, providing deep, actionable insights into your test executions across manual sessions and automated Appium runs. Qyrus Device Farm generates detailed reports encompassing performance vitals, full session video recordings, screenshots, system logs, and Appium automation traces.

What is Included in Test Reports:

  1. Session & Device Information: Complete summary including session name, execution date, duration, user account, hardware specifications, and device identifiers.

  2. Interactive Device Vitals: Performance metrics tracking CPU utilization, memory consumption, and network throughput over the session timeline, with export to CSV and PNG formats.

  3. Full Video Recording: Complete high-definition video evidence capturing every user gesture, transition, and app response.

  4. Screenshots Gallery: Timestamped gallery of all manual and automated screenshots captured during the session.

  5. Device System Logs: Live system-level logs and logcat/syslog dumps capturing app events, background tasks, and error traces.

  6. Appium Logs (for Automation): Step-by-step Appium automation command logs with HTTP request/response payloads for debugging automation failures.

Alt text

Steps to View Reports

  1. Navigate to Sessions for your project.

  2. In the sessions summary table (Manual or Automation tab), locate your test execution and click “Show Details”.

Alt text
Alt text

Session Information & Email Sharing

The top section of the report provides quick metadata regarding the execution:

  • Session Name: Name specified during test initiation.

  • Date & Region: Timestamp of the test run and data center region where the device was hosted.

  • Session Duration: Total active time (e.g., 0h 14m 32s).

  • User Email: Email ID of the tester who ran the session.

Alt text

Sharing Reports via Email:

  1. Click the Envelope (Email) icon on the Session Info card.

  2. Enter one or more recipient email addresses (comma-separated).

  3. Click “Send” to dispatch a report summary link.

Alt text

Device Information

The Device Info card outlines the hardware and platform specs of the host device:

  • CPU Architecture: Processor model and core specs.

  • Screen Resolution: Pixel width and height (e.g., 1080x2400).

  • RAM: Total device physical memory.

  • OS Version: Android or iOS platform release.

  • Device Type: Dedicated or Shared device allocation.

  • Device Name & Device UUID: Unique hardware and cloud identifiers.

Alt text

Full Video Recording Playback

Device Farm records the full visual stream of every testing session:

  • Click “Play Video” in the video card to launch the video playback modal.

  • Use playback controls to scrub through the timeline, pause at key moments, and verify visual bugs or rendering issues.

Alt text

Viewing & Exporting Device Vitals

Click on the “Device Vitals” tab to analyze resource consumption across the session lifecycle:

  • CPU Usage Graph: Time-series line chart displaying CPU percentage utilized by your application and system processes.

  • Memory Usage Graph: Tracks RAM consumption over time to help pinpoint memory leaks.

  • Network Usage Graph: Monitors network bandwidth upload and download rates.

Alt text

Exporting Vitals Data:

  • Download Vitals.csv: Export the raw time-series data points as a .csv spreadsheet for external performance analysis.

  • Download Vitals.png: Export high-resolution rendered graphical charts as .png images for inclusion in QA presentations and stakeholder reports.

Note: Device vitals collection is supported on real Android and iOS devices.

Accessing Logs & Screenshots

1. Device Logs:

Click the “Device Logs” tab to inspect system messages, crash logs, and application standard output captured during the session. You can search within the log text or export the full log file.

Alt text

2. Screenshots Gallery:

Click the “Screenshots” tab to view all screenshots captured manually via the control bar or captured programmatically during automation runs. Click on any thumbnail to view the full-size image or download it.

Alt text

3. Appium Logs (Automation Sessions):

For automation runs, switch to the “Appium Logs” tab to review the server interaction log, including HTTP request routes, payload arguments, locator strategies evaluated, and session termination events.

Last updated