Lates Test Result not addicted to Build release time - Bug?

[cwde]

Hi,

i'm using Testlink 1.9 and there seems something wrong in handling test result verdicts in the "test results matrix"

the manual says:
The order in which Builds are added to a Test Plan determines which Build is most
recent. The results from the most recent Build will take precedence over older Builds.

so i created a Build called "Release Beta5" on 01.04.2012 and marked it with "passed with restrictions" -> final verdict is "passed with restrictions"
after then i created a build called "Delivery RC1" on 22.04.2012 and marked it with "passed" -> final verdict is "passed with restrictions" again ?!?

seems like the final verdicts are assigned from the last shown build entry (in test result matrix) which is sorted in alphabetically order.
i attached a screenshot of the test result matrix where you can see, that the last created build (Delivery RC1 / 22.04.2012) is not sorted depending on creation date. normally this build should be the the last column before "Last build" column and "Last build" column should have the Result of the latest added Build which is "Delivery RC1" (passed) - but "Last build" shows the verdict "passed with restrictions"

test result matrix

http://s1.directupload.net/file/d/2876/mn6ezogk_png.htm

builds management

http://s14.directupload.net/file/d/2876 ... em_png.htm

Seems like this is a bug ... or does someone disagree with me?

regards
chris

Ps: again what i expect:
- Builds columns in test result matrix should be sorted in creation date and NOT in alphabetically order
- last build verdicts should have the result of the latest created build ( the date what i select when i create a build in build management )

[fman]

We need to clarify some concept on next release (1.9.4)
Important thing is that release date on BUILD is not (yet) used on reports.
And also we need to know if can be used ( because is NOT MANDATORY data), to order builds
IMHO opinion [Last Build} column will always generate misunderstandings. (I've not develop this report).

Regarding how columns have to ordered (by Build Name or other), think only solution to make things clear ( on next TestLink MAJOR VERSION i.e 2.0 or up) will be use Display ordered by Build Name and display also Release Date.
We need to add a new option to allow user how to order:
- Build Name
- Release Date

but again this will be (may be TestLink 2.0).

I've done quick test and seems our sentence (displayed on report)

This report shows the last test case execution result for each build.
Example:
Test Case has been executed in this order:
Build 1.0 - Passed; Build 1.0 - Failed
-> Last Result for Build 1.0 is Failed because second execution overrides older results.

"[Last Build]" and "Last execution" column show data according to this example:
Test Case has been executed in this order:
Build 1.0 - Passed; Build 1.0 - Failed; Build 2.0 - Blocked; Build 1.0 - Passed
-> [Last Build] : Blocked because Build 2.0 is the last build created for which a result has been set.
-> "Last Execution" : Passed because Build 1.0 has been executed at last.


Seems not to be RIGHT

[cwde]

Hi,

i just checked the test report against the test result matrix with my example and test report shows correct result (passed) - result matrix "last build" shows "passed with restrictions".
but these differences really confuses me, because the "test result matrix" is a very good way to show a Quality assurance team the sw development over all builds with a final result displayed. till now the displayed final result called "last build" is not the correct final result and therefore the matrix is not useful to me. imho you should implement the release date on builds in the reports and show a correct final result (result of the last created/released and last executed build) in a column called e.g. "latest result" or "overall result" .. however

Regarding how columns have to ordered (by Build Name or other), think only solution to make things clear ( on next TestLink MAJOR VERSION i.e 2.0 or up) will be use Display ordered by Build Name and display also Release Date.
We need to add a new option to allow user how to order:
- Build Name
- Release Date

an order option of the columns in the "test result matrix" would be nice. but i think, the order of the "release date" should be the default.

would be nice if you find a solution, implemented in a soon following release ...
hope you can understand my doubts in using testlink.

regards
chris

[fman]

we can understand your doubts, hope you also understand that this is a community effort => amount of workforce we can put varies a lot over time, depending of our 'real day by day work'.
In any case we do our best to improve TestLink as soon as possible (that normally is not as soon as users expect)

If you think this is an issue, please help us opening on Mantis and putting as much as possible info there (is ok if you copy and past from there, is not ok if you just put a link to this post)

regards

[cwde]

of course i understand that every programming issue takes some time beside your paid work. i just wanted you to classify such an item with a (in my opinion) higher priority for implementation, because it causes in usage some real confusions.
Anyway i would like to support you with infos to that issue within you MANTIS bug tracking system, but i never used it and dont know how to communicate this item to you.
but independent to that i will of course be patient for next release(s) ...

kind regards

[cwde]

now in mantis ... 0005012