Test Execution Filtering

LATEST Official version.
Questions and discussions - NO ISSUES
FOR ISSUES => http://mantis.testlink.org

Moderators: Amaradana, TurboPT, TL Developers

Post Reply
colross
TestLink user
Posts: 4
Joined: Thu May 20, 2010 8:57 pm

Test Execution Filtering

Post by colross »

Hi - I have a question. I am unsure if my understanding of the feature is incorrect, or if the feature does not quite work correctly.
I am running the 1.9 Beta 6
When you go to the "Test Execution" link, you get a coloured display on the left. (Incidentally, this is one of my favourite features).
The colouration shows by default for the "build to execute" that you have selected in the Settings area. When you change the "build to execute" the colouration changes to match the new build that yo have selected.
Within the Filter section, there is a possibility to select Result [ANY] on "latest execution", or "ALL builds" and other options.
My expectation here is that the colouration would now show all executions, so that I can see at a glance what is missing (regardless of the "build to execute")
This is not the case, however. The colouration strictly follows the build in the "Settings" area.
Is my expectation incorrect? If so, what is the purpose of this filter, as it seems to have no effect?

Cheers
Colin
Julian
Advanced user
Posts: 28
Joined: Thu Apr 23, 2009 2:48 pm

Re: Test Execution Filtering

Post by Julian »

your analysis is absolutely correct.

filters do only serve the purpose of reducing the amount of test cases shown

example of how to use the filter:

you want to run all tests that failed for a prior build with the newest build.

you set the filter to:
Result: failed
on specific build:
1.0

-> tree will show all test cases that failed for build 1.0 BUT coloring of test cases stays the same!
colross
TestLink user
Posts: 4
Joined: Thu May 20, 2010 8:57 pm

Re: Test Execution Filtering

Post by colross »

Thanks for the info.
If I were to raise an enhancement on this (it is a brilliant way of getting insight into where exactly you are), what is the likelihood that it would be implemented?
Julian
Advanced user
Posts: 28
Joined: Thu Apr 23, 2009 2:48 pm

Re: Test Execution Filtering

Post by Julian »

very low as people do not like changes here.

see our last try to change colors: http://mantis.testlink.org/view.php?id=3450

the only alternativ would be another setting allowing to influence the coloring.

something like
color tree according to
- last execution for all builds
- last execution for build chosen for execution
- ...
slbogdan
TestLink user
Posts: 2
Joined: Sat Jul 03, 2010 10:30 am

Re: Test Execution Filtering

Post by slbogdan »

Hi, i have a problem with testcase execution filtering too.

I am using 1.9 build and after executing some testcases I wanted to filter it using filter Result. The problem is whatever value I set for Result filer all testcases are shown.

Someone else had same problem?

Thank you!
ansar
Advanced user
Posts: 27
Joined: Fri Jul 29, 2011 8:24 pm

Re: Test Execution Filtering

Post by ansar »

My testers are having the same problem. We have multiple builds per release cycle.

When you use the filter:

Result=Not Run
on ANY Build

I would expect to only see Test Cases that have not been run at all listed, but I am still seeing all test cases listed in the Tree View.

Is this a bug or expected behavior?
Post Reply