As a user, you need to keep certain rules in mind while setting the Status of Run and Run Steps in AIO Tests.
In this documentation, you’ll understand:
Rules for Status of Run
If the status of Run Steps is modified, the status of Run is also updated. So status changes made in Steps, percolate up to the status of Run according to the rules defined below.
If you try to set the status of all the Run Steps as Not-Run then the status of the Run also becomes Not Run.
If you mark the status of all the Run Steps as In-Progress then the status of the Run also becomes In-Progress.
If you mark the status of all the Run Steps as Passed then the status of Run also becomes Passed.
If you set the Status of any of the Run Steps as Failed, the status of the Run becomes Failed.
If any of the Run Steps is not Failed but Blocked, the status of the Run is Blocked.
If no Run Step is marked as Failed or Blocked and any/ some but not all of the Run Step(s) is/ are marked as Passed, then the status of the Run is In-Progress.
The below screenshot has been taken from our ATM example where all the Run Steps are marked as Not Run except the third Run Step which is marked as Passed- the Status of Run becomes In-Progress.
Similarly, If no Run Step is marked as Failed or Blocked and any of the Step Run(s) is/are marked as In-Progress, then the status of the Run changes itself to In-Progress.
Refer to the table below for a clear understanding of the above rules:
Run Steps Status | Run Status | ||||
Not run | In Progress | Passed | Failed | Blocked | |
|
|
|
|
| Not Run |
|
|
|
|
| In Progress |
|
|
|
|
| Passed |
|
|
|
|
| Failed |
|
|
|
|
| Blocked |
|
|
|
|
| In Progress |
|
|
|
|
| In Progress |
Cells marked with
means when some/ any step is under that status.Cells marked with
means that none of the steps have that status.A blank cell means other statuses won't matter if
and condition(s) are met.
Remember while considering percolate up, only direct child status is considered which means if a Case A is linked to Case B, Case B is linked to Case C, and if user marks a Run step in C as Failed (e.g. C.2), then the status will be percolated up to B, i.e. status of B will be failed and thus status of A will also be failed.
Similarly , if we change the status of C directly (not the Run steps) to Blocked then status of B will only consider the status of its direct child which is C (not the steps of C).
Rules for Status of Run Steps
If the Status of the Run is directly modified, then the status of all the Run Steps is also updated. So status change made at the Run level percolates down to the status of Run Steps according to the rules defined below.
Percolating down happens, only if, the status of Run is changed to Passed, and if:
all Run Steps (including steps of linked steps) have either Status of Not Run or Passed.
none of the Run Steps (including steps of linked steps) have any data in it i.e. data may only have Actual Results/ Comments/ Attachments/ Defects.
For further queries and suggestions, feel free to reach out to our customer support via help@aiotests.com.