Computation and Meaning of the Coverage Column
The computation of the coverage column is based on the status of the Calculate Coverage with Or checkbox. If the checkbox is selected, the AND operation is used to calculate the coverage, otherwise the OR operation is used. The following table lists the possible Coverage column results for the various result combinations, based on whether the AND or OR operator is used:
|
Combination
|
Result with AND
|
Result with OR
|
|---|---|---|
|
Passed, Failed
|
Failed
|
Partly Passed
|
|
Passed, Blocked
|
Blocked
|
Partly Passed
|
|
Passed, Partly Passed
|
Partly Passed
|
Passed
|
|
Blocked, Partly Passed
|
Blocked
|
Partly Passed
|
|
Blocked, Failed
|
Blocked
|
Blocked
|
|
Failed, Partly Passed
|
Failed
|
Partly Passed
|
|
Passed, Blocked, Failed
|
Blocked
|
Partly Passed
|
|
Passed, Blocked, Partly Passed
|
Blocked
|
Partly Passed
|
|
Passed, Failed, Partly Passed
|
Failed
|
Partly Passed
|
|
Failed, Blocked, Partly Passed
|
Blocked
|
Partly Passed
|
|
Passed, Blocked, Failed, Partly Passed
|
Blocked
|
Partly Passed
|
|
Passed, Not Applicable
|
Party Passed
|
Passed
|
|
Party Passed, Not Applicable
|
Partly Passed
|
Partly Passed
|
|
Failed, Not Applicable
|
Failed
|
Failed
|
|
Blocked, Not Applicable
|
Blocked
|
Blocked
|
|
No test cases for the requirement
|
Not Covered
|
Not Covered
|
The second and third columns in this table show the coverage status for the combination of test run results, depending on whether the AND or the OR operator is used. The computation is the same for requirements, using the coverage statuses of the test cases to compute the coverage for the requirement.
The Partly Passed result with the OR operator is "stronger" than the Blocked or Failed results. For example, the following image shows a subtree where the coverage is computed with the AND operator (default):
The Suspension requirement result is Failed because it has a Failed and a Passed test run. According to the first row of the table, this combination results in Failed with the AND operator.
If the OR operator is used instead, the coverage is Partly Passed:
The computation is affected by the Number of recent Test Runs shown option in the filter because only the test runs that are shown in the tree are considered in the computation.