Page 1 of 1

Reports for multiple cycle

Posted: Fri Nov 30, 2012 8:55 am
by SThayalan
We want to generate a report for the whole product not just for a particular run. Say,

Module 1 – 5 TC
Module 2 – 10 TC

Cycle 1:
Module 1 – 5 Pass, 0 Failed
Module 2 – 5 Pass, 3 Failed, 2 Not Executed

Cycle 2:
Module 2 – 10 Pass

I want generate a report so that I should be able to see the whole picture. If I use the build and/or Platform feature associated with Cycle 1 & 2 I’m getting mixed results due to the fact that it populates the last run results.

If I use different Test Plan then it can be achieved but I couldn't able to comb all the Test plan results to one report. If I use just one test plan and different builds then results showing for ‘General Test Plan Metrics’ report sections Results by top level Test Suites & Test results according to test priorities showing misleading matrix since it’s picking the last run results. There are test cases not considered for cycle 2 that also showing on the results. There is no clear demarcation for different cycles on all the matrices.

The same issue with platform as well.

Please suggest a way so that I can see all the cycle summary reports and show only data relevant to the last or all the cycle on all the reports.

Re: Reports for multiple cycle

Posted: Wed Dec 05, 2012 5:21 am
by Amaradana
What i would suggest you is get the report for different test plans/as soon as the build is over, as for your needs and then aggregate to the single excel which makes easy

Re: Reports for multiple cycle

Posted: Wed Dec 05, 2012 7:56 am
by SThayalan
Thanks Amaradana. That’s the approach I too proposed to my Executives and managers in my company. However they don't like the idea of manual work involved in aggregating the test plan results. Basically they want to see the results as and when required from the tool itself. So, they suggest creating a report merge all the test plans or else ask me to come up with a better approach.

Re: Reports for multiple cycle

Posted: Wed Dec 05, 2012 9:35 am
by fman
if you company can make donation we can take development of this feature (feature has to be share also with community).
Let me know