Latest Exec, Last Build and exec tracking (using BUILDS)
Posted: Tue Sep 01, 2015 2:11 pm
Perhaps I'm completely misunderstanding 'Last Execution' and 'Last Build' on the Test Results Matrix page but I would interpret this to be, in the following example:
I have 6 builds, Build1 to Build6. I have executed test cases in various spots across the builds but I have executed every test case in Build3. When I run the Test Results Matrix query, I'm expecting that I would get a list of test cases with execution results for each build. I would then expect that:
- "Last Build" - provides the test result for the last build this test case was run on the set of chosen builds
- "Last Execution" - provides the last test result regardless of build chosen
So:
Build1 Build2 Build3 Build4 Build5 Build6
TC1 P N/A P F N/A N/A
In this example, if I choose, Build3, Build4, Build5, Build6, I would expect to see: "Last Build - N/A", "Last Execution - F"
In the second example, if I chose just Build6, I would expect to see "Last Build - N/A", "Last Execution - F".
What I get is: "Last Build - N/A", "Last Execution - N/A".
This means that, on projects with a larger number of builds, I cannot get the last execution of that test case. Testlink seems to only use the selected builds which, honestly, changes the data. I've executed on Build4, that build should be reported as "Last Execution" regardless of what builds are chosen to search on.
Given that the amount of data can cause problems with the backend and unresponsive browser pages, reducing the builds chosen is desirable so you can get the "Last Execution" of assigned test cases.
What am I missing here? Why would choosing a subset change the "Last Execution" report?
Thanks,
-Rick
I have 6 builds, Build1 to Build6. I have executed test cases in various spots across the builds but I have executed every test case in Build3. When I run the Test Results Matrix query, I'm expecting that I would get a list of test cases with execution results for each build. I would then expect that:
- "Last Build" - provides the test result for the last build this test case was run on the set of chosen builds
- "Last Execution" - provides the last test result regardless of build chosen
So:
Build1 Build2 Build3 Build4 Build5 Build6
TC1 P N/A P F N/A N/A
In this example, if I choose, Build3, Build4, Build5, Build6, I would expect to see: "Last Build - N/A", "Last Execution - F"
In the second example, if I chose just Build6, I would expect to see "Last Build - N/A", "Last Execution - F".
What I get is: "Last Build - N/A", "Last Execution - N/A".
This means that, on projects with a larger number of builds, I cannot get the last execution of that test case. Testlink seems to only use the selected builds which, honestly, changes the data. I've executed on Build4, that build should be reported as "Last Execution" regardless of what builds are chosen to search on.
Given that the amount of data can cause problems with the backend and unresponsive browser pages, reducing the builds chosen is desirable so you can get the "Last Execution" of assigned test cases.
What am I missing here? Why would choosing a subset change the "Last Execution" report?
Thanks,
-Rick