Multi Cycle Execution Summary Report

The Multi Cycle Execution Summary report can be used to view the current status and progress of multiple cycles together. The report shows details around cases added to the cycles, their status, execution effort, defects, etc. for all specified cycles. e.g. If you have multiple cycles for a particular release covering new features and regression, you can run this report to include all cycles of a release and see how your testing is progressing in all cycles.

Generating Multi Cycle Execution Summary Report

Click on the right chevron, next to the report name to get the input screen for the report. In the Cycles field, specify the cycles for which you want to generate the Execution Summary Report. Clicking on Generate will generate the Execution Summary Report. The filter option can be enabled to narrow down the cycles list. You can filter the cycles list by Component, Release, Cycle Tags, by Folders or by any of the custom fields.

Open

The report output is shown below and each section is explained in detail next.

Open

Cycles Overview

The top section consists of different statistics of the specified cycles. The statistics consist of:

1. Cycles: number of cycles provided as input

2. Unique Cases: number of unique cases across the specified cycles

3. Total cases: total number of cases to be executed

4. Incomplete Cases: number of cases in In Progress, Blocked and Not Run status

5. Passed Cases: number of Passed cases in all the cycles

6. Failed Cases: number of Failed cases in all the cycles

7. Estimated Effort: It is the Total effort which is calculated based on the “estimated effort” time of all cases across all cycles

8. Runs: number of runs in all the cycles

9. Actual Effort: It is the Actual effort, which is calculated based on the “actual effort” i.e. time taken to execute/ run all cases

10. Remaining Est. Effort: It is the sum of the estimated effort for the incomplete cases

11. All Defects: total number of defects raised in the cycles (including all the runs)

12. Latest Run Defects: number of defects associated with the latest run of cases across cycles
    
    

     

Cycles Summary

This section gives details of execution for all the cycles specified in the input by using bar charts for Case distribution, Estimated Effort distribution and a table with numerical details. This information can be used to see how the overall testing is progressing for a given set of cycles.

Case Distribution: shows case count by the selected cycles, broken down by last run execution status of cases

Estimated Effort Distribution: shows Remaining and Completed Est. Effort for cases in each cycle. Completed estimated effort is total of estimated effort for completed cases (cases in Passed/Failed status). Similarly, remaining estimated effort is total of estimated effort for incomplete cases (cases in Blocked/In Progress/Not Run status)

Detailed Execution Table: shows start date and end date of all specified cycles along with numbers of cases in each of the execution status, # of runs, defects, etc.

The user has the option to filter cycles to see the ones with pending executions (Not Run, In Progress and Blocked cases) as highlighted in the image below.

Defect Summary

This section shows the defect summary in three ways - defect status distribution, defect priority distribution and defect details table.

The left pie chart can be used to see Defects distribution based on status and the right pie chart to see Defects distribution based on Priority. On hovering upon these pie charts, you can view the details like status, priority and count.

The defect details table shows all the defects in rows with details like the type of the defect, it’s key, the title associated with the defect, it’s priority, status, the assigned reporter, etc.

There is an option for the user to see the distribution and details for all defects found in all runs of all the cycles by un-checking the highlighted option as shown below.
By default its checked and shows the distribution for defects only associated with the latest runs.

Users have the option to add more columns to the defect details table by using the highlighted button above. On clicking the “Select Columns” button, the below screen is displayed which allows users to add desired columns to the table. In the screenshot below, the highlighted section displays the order in which the selected columns will be shown. Key & Summary cannot be removed from the table.

The columns selected will be stored as user’s preference and same columns will be available the next time report is generated.