I work on the Dev and QA teams for my employer (an ISV), and our QA team recently adopted TestLink (currently using 1.8.2). In just a few months we've created many cases, suites, plans, etc. We author software for Windows, and we find it desirable to track test case execution outcomes for each Windows OS that we support (from XP and XP x64 up to Srv2008R2 and its 64-bit counterpart).
We are currently experimenting with Custom Fields as a means to track TC outcomes on a per-build, per-OS basis. However, we've found that it's therefore necessary for us to add a new report to TestLink to summarize the per-build, per-OS outcome data.
I write to solicit feedback from the TestLink community.
Is it a good idea for us to use Custom Fields to track the outcomes of test cases as I've described?
If not, what alternatives should we consider?
If so, would someone from the community be willing to review our custom settings and the little blocks of code I've written for our new report?
Thanks,
appropriate use of custom fields?
Moderators: Amaradana, TurboPT, TL Developers
on 1.9 a new concept will be available Platforms, that can be useful IMHO for you.
If you want to experiment with this new feature you need to get code from CVS head on sourceforge.
Custom fields has some minor problems regarding how to create effective reports that use Custom fields as some selection criteria.
They work OK to collect info that you want to display on reports, but without trying to do logic on custom field contents
If you want to experiment with this new feature you need to get code from CVS head on sourceforge.
Custom fields has some minor problems regarding how to create effective reports that use Custom fields as some selection criteria.
They work OK to collect info that you want to display on reports, but without trying to do logic on custom field contents
We'd like to evaluate 1.9's "Platforms" feature. Where can I find instructions on doing the CVS checkout from your sourceforge repository?
Also, with regard to the implementation of the custom report, my code calls
$cfield_mgr->get_linked_cfields_at_execution($args->tproject_id,1,'testcase',null,null,$args->tplan_id,'exec_id');
in order to retrieve the records showing the outcome from each test case within the test plan that's been executed (a la testCasesWithCF.php). However, instead of displaying each of these records individually, it counts up the number of passes and failures and displays those counts along with their percentage of the total number of the plan's executed test cases.
Does the method get_linked_cfields_at_execution() have the minor bugs you mentioned?
What is the likelihood that this method's behavior will change in the future?
What is the likelihood that it will be deprecated in the future?
Also, with regard to the implementation of the custom report, my code calls
$cfield_mgr->get_linked_cfields_at_execution($args->tproject_id,1,'testcase',null,null,$args->tplan_id,'exec_id');
in order to retrieve the records showing the outcome from each test case within the test plan that's been executed (a la testCasesWithCF.php). However, instead of displaying each of these records individually, it counts up the number of passes and failures and displays those counts along with their percentage of the total number of the plan's executed test cases.
Does the method get_linked_cfields_at_execution() have the minor bugs you mentioned?
What is the likelihood that this method's behavior will change in the future?
What is the likelihood that it will be deprecated in the future?