Hi,
As of TestLink version 1.9.1 the Test Reports > General test plan metrics : Overall build status now shows the passed/failed/blocked/not run counters for assigned test cases only. In previous versions ALL test cases assigned to the test plan were counted (see http://mantis.testlink.org/view.php?id=3406 [^])
Due to this newly implemented reporting system , it is now impossible to see the execution status of all test cases on a specific build when assignment to users is not used. I.e. the report will now indicate '0' values since no assignments were done. As far as I can see there is no way to see/retrieve this kind of information in TestLink 1.9.1.
The situation described above would occur for a test project run by a small test team & in which all test cases are executed on each build (i.e. full regression testing). In this case the test coordinator does not distribute the test case execution amongst its team members by assigning them in TestLink, since this poses an unnecessary overhead (the team members sit in the same room and divide the test cases themselves).
Perhaps the overall build status screen should show both views : one based on assigned test cases and one based on all test cases added to the test plan.
Is there anyone else who uses the TestLink tool as described in the scenario above?
Overall build status report without test case assignment
Moderators: Amaradana, TurboPT, TL Developers
Re: Overall build status report without test case assignment
We don't use test case assignment either. But I do not see the problem you are describing. I go to the General test plan metrics. The column "Assigned" is all zeros. But the NotRun/Passed/Failed/Blocked columns are populated with statistics.
Re: Overall build status report without test case assignment
Correct, except that the 'not run ' & all percentages are not calculated correctly since they are currently based on the number of assigned test cases (see also defect http://mantis.testlink.org/view.php?id=4290 )
It seems to me that currently a mix of values based on 'assigned test cases to persons' (assigned,not run & all percentage values) and on 'added test cases to the test plan' is used (passed,blocked & failed) ...
It seems to me that currently a mix of values based on 'assigned test cases to persons' (assigned,not run & all percentage values) and on 'added test cases to the test plan' is used (passed,blocked & failed) ...