Overall build status report without test case assignment

LATEST Official version.
Questions and discussions - NO ISSUES
FOR ISSUES => http://mantis.testlink.org

Moderators: Amaradana, TurboPT, TL Developers

Post Reply
pvmeerbe
TestLink user
Posts: 6
Joined: Tue Dec 18, 2007 12:40 pm

Overall build status report without test case assignment

Post by pvmeerbe »

Hi,

As of TestLink version 1.9.1 the Test Reports > General test plan metrics : Overall build status now shows the passed/failed/blocked/not run counters for assigned test cases only. In previous versions ALL test cases assigned to the test plan were counted (see http://mantis.testlink.org/view.php?id=3406 [^])

Due to this newly implemented reporting system , it is now impossible to see the execution status of all test cases on a specific build when assignment to users is not used. I.e. the report will now indicate '0' values since no assignments were done. As far as I can see there is no way to see/retrieve this kind of information in TestLink 1.9.1.

The situation described above would occur for a test project run by a small test team & in which all test cases are executed on each build (i.e. full regression testing). In this case the test coordinator does not distribute the test case execution amongst its team members by assigning them in TestLink, since this poses an unnecessary overhead (the team members sit in the same room and divide the test cases themselves).

Perhaps the overall build status screen should show both views : one based on assigned test cases and one based on all test cases added to the test plan.
Is there anyone else who uses the TestLink tool as described in the scenario above?
Unhandled
Advanced user
Posts: 67
Joined: Sun Jan 23, 2011 11:28 pm

Re: Overall build status report without test case assignment

Post by Unhandled »

We don't use test case assignment either. But I do not see the problem you are describing. I go to the General test plan metrics. The column "Assigned" is all zeros. But the NotRun/Passed/Failed/Blocked columns are populated with statistics.
pvmeerbe
TestLink user
Posts: 6
Joined: Tue Dec 18, 2007 12:40 pm

Re: Overall build status report without test case assignment

Post by pvmeerbe »

Correct, except that the 'not run ' & all percentages are not calculated correctly since they are currently based on the number of assigned test cases (see also defect http://mantis.testlink.org/view.php?id=4290 )

It seems to me that currently a mix of values based on 'assigned test cases to persons' (assigned,not run & all percentage values) and on 'added test cases to the test plan' is used (passed,blocked & failed) ...
Post Reply