Test Case Execution
The Test Runner dialog automatically shows the next available test case in the current test set, which is:
• The test cases by default are executed in the order they appear in the test set.
You can navigate to the next, previous, or last test case in the test set using the arrows on the navigation bar in the Test Runner dialog. However, this is only possible if the test set is not set to sequential, which enforces the order of test cases.
• You can jump to a different test case by using the arrows in the navigation bar
.
◦ Enter the test case number in the input box on the navigation and press enter.
◦ Click the search icon next to the navigation bar to bring up the Choose a Test... dialog. The dialog box lists all the not-completed test cases, which can be filtered and any of them can be selected as your next test case.
• The Test Runner dialog shows the test cases which are not executed yet. If you have already run Test "X" within the test run, then this test case is not available in the test runner.
• You can stop and close the Test Runner dialog any time during the run, and come back later. The execution is continued at the next not-yet-run test case, which is where you left off, except if somebody else has run the same test.
• After each step is completed the Test Runner dialog automatically saves the results in the background. This is to avoid data loss in case of the browser crashes or some other issues.
• Multiple Testers can work on the same test set run simultaneously. The system automatically takes care of concurrency. If a test case "X" is being run by another user then that test case is not available to the next Tester. Hence, no work is duplicated. If the same user-account runs the same test set from two different browsers (multiple sessions), then they do not get the same test case. This prevents accidental overwriting of each others work.
• If a test case has parameters, the test case is run as many times as the number of parameters are available. The Test Runner does not go to the next test case until all parameters are completed, however you can skip some of the parameters too. For more details, see Test Parameterization.
• Typically only test cases which are in Accepted state are run by the Test Runner, but this can be configured. For more information, see Running Only Accepted or All Test Cases?