The Execution Summary Report can be used to view the current status and progress of an execution cycle. The report shows details about cases added to the cycle, their status, execution effort, defects, and many more. The Execution Summary report can be created only for one cycle.
In this documentation, you’ll understand:
Steps to Generate Execution Summary Report
Step 1: To generate Execution Summary Report, simply click on the Chevron option for Execution Summary.
Step 2: Once you click on the chevron icon, the Execution Summary Report input window will be displayed on the screen. Click on the Cycle field and select a cycle for which you want to generate the report.
Users can also use the filter option to narrow down the Cycles list. They can filter the Cycles list by Component, Release, Cycle Tags, Folders, or any custom fields (which can be added via the inverted triangle icon).
Step 3: Finally, click on the Generate button.
Users can also save reports to reuse them later by clicking on the Save button.
Once you click on the Generate button, the report output will be displayed on the screen.
.png?version=2&modificationDate=1712041770816&cacheVersion=1&api=v2&width=756&height=1087)
Execution Summary Report Output - Overview
Here’s a detailed explanation of the Execution Summary report output.
Cycle Overview
The first section of the Execution Summary report consists of the Title, objective, start date and end date of the cycle.
Cycle Statistics & Execution Distribution
The next section, Cycle Statistics and Execution Distribution displays different statistics of the cycle on the left and shows a pie chart on the right-hand side. The pie chart shows the cases (included in the cycle) by their execution status. On hovering over each slice of pie, the status count can be seen. The statistics on the left consist of:
Total Cases: Informs you about the total number of cases added in the cycle.
Incomplete Cases: It’s a cumulative sum of the In Progress, Blocked and Not Run cases.
Passed Cases: It shows the number of Passed cases in the cycle and the box can be clicked to get more details about the passed cases.
Failed Cases: It shows the number of Failed cases in the cycle and the box can be clicked to get more details about the passed cases.
Estimated Effort: It is the Total effort which is calculated based on the “estimated effort” time of all cases.
Actual Effort: It is the Actual effort, which is calculated based on the “actual effort” i.e. time taken to execute/ run all cases.
All Defects: Informs you about the total number of defects raised in the cycle. It also shows how many defects are currently in Open status i.e. not in the Done status category. You can click the box to get additional details.
Latest Run Defects: Informs you about only the defects relevant to the latest run of the cycle and also how many of those are in Open status i.e. not in the Done status category. You can click the box to get additional details.
Cycle Execution Summary
The Cycle Execution Summary section gives a quick overview of the case execution status and defect count of the cycle. This information can be used to ascertain problem areas quickly. The data can be viewed with respect to the Case Folder structure, Sets or based on Components. All numbers are clickable.
By default, “Show only non-empty items” is selected which means only those folders/components will be shown from which cases were added to the specified cycle. This checkbox doesn’t apply to Sets as we only show sets to which cases belong.
Folders Grouping: An entry in the table is the cumulative sum of the folders and the subfolders. The value enclosed within brackets, in each entry, is the number of cases directly under the folder.
At the end of the table, the Total row gives the overall count of the Total cases included in the cycle, the total number of cases in different statuses and also the total count of defects. The total is not displayed for Sets as one case may belong to multiple Sets.
Defect Summary
The Defect Summary section shows the defect summary in three ways- defect status distribution, defect priority distribution and defect details table.
The left pie chart can be used to see Defects distribution based on Status and the right pie chart to see Defects distribution based on Priority. On hovering over these pie charts, you can view the details like status, priority and count.
The defect details table shows all the defects in rows with details like the type of the defect, its key, the title associated with the defect, its priority, status, the assignee, reporter, etc.
Users have the option to add more columns to the defect details table by using the highlighted button above. On clicking the “Select Columns” button, the below screen is displayed which allows users to add desired columns to the table. In the screenshot below, the highlighted section displays the order in which the selected columns will be shown. Key & Summary cannot be removed from the table.
The columns selected will be stored as the user’s preference and the same columns will be available the next time the report is generated.
Users also have the option to view all the defects by clicking on the “Show in Issue Navigator” button. Once the user clicks on the Show in Issue Navigator button, they will be redirected to the Issues screen, where they can view the issue key, its summary, assignee, and issue reporter.
The issues which are shown in the grid (defect details table), will only be opened in new tab by clicking on Show in Issue Navigator. By default, defects only associated with the latest runs will be displayed in issue navigator. If user uncheck the Show only the latest run defects option, issue navigator will show all the defects.
Users have the option to filter the data of the defect details table based on the data available in the table by simply clicking on the filter icon on the column level.
There are some columns in the defect details table that do not have filter options, such as the created date, etc.
For further queries and suggestions, feel free to reach out to our customer support via help@aiotests.com.