Overall build status report without test case assignment
Posted: Thu Mar 03, 2011 4:30 pm
Hi,
As of TestLink version 1.9.1 the Test Reports > General test plan metrics : Overall build status now shows the passed/failed/blocked/not run counters for assigned test cases only. In previous versions ALL test cases assigned to the test plan were counted (see http://mantis.testlink.org/view.php?id=3406 [^])
Due to this newly implemented reporting system , it is now impossible to see the execution status of all test cases on a specific build when assignment to users is not used. I.e. the report will now indicate '0' values since no assignments were done. As far as I can see there is no way to see/retrieve this kind of information in TestLink 1.9.1.
The situation described above would occur for a test project run by a small test team & in which all test cases are executed on each build (i.e. full regression testing). In this case the test coordinator does not distribute the test case execution amongst its team members by assigning them in TestLink, since this poses an unnecessary overhead (the team members sit in the same room and divide the test cases themselves).
Perhaps the overall build status screen should show both views : one based on assigned test cases and one based on all test cases added to the test plan.
Is there anyone else who uses the TestLink tool as described in the scenario above?
As of TestLink version 1.9.1 the Test Reports > General test plan metrics : Overall build status now shows the passed/failed/blocked/not run counters for assigned test cases only. In previous versions ALL test cases assigned to the test plan were counted (see http://mantis.testlink.org/view.php?id=3406 [^])
Due to this newly implemented reporting system , it is now impossible to see the execution status of all test cases on a specific build when assignment to users is not used. I.e. the report will now indicate '0' values since no assignments were done. As far as I can see there is no way to see/retrieve this kind of information in TestLink 1.9.1.
The situation described above would occur for a test project run by a small test team & in which all test cases are executed on each build (i.e. full regression testing). In this case the test coordinator does not distribute the test case execution amongst its team members by assigning them in TestLink, since this poses an unnecessary overhead (the team members sit in the same room and divide the test cases themselves).
Perhaps the overall build status screen should show both views : one based on assigned test cases and one based on all test cases added to the test plan.
Is there anyone else who uses the TestLink tool as described in the scenario above?