Chart - Results by Tester - How it works & Future

Post Reply
fman
Member of TestLink Community
Posts: 3123
Joined: Tue Nov 15, 2005 7:19 am

Chart - Results by Tester - How it works & Future

Post by fman »

This CHART provide metrics related NOT TO EFFECTIVE Tester Executor, but to Assigned Tester.

Simple Example
Test Plan PLONE
Just ONE build: 1.0
Users defined on TL: admin, Tester_JR, Tester_YR
Test Cases linked to Test Plan
TC-01,TC-02,TC-03,TC-04,TC-05,TC-06,TC-07,TC-08

Tester Assignment FOR BUILD 1.0
TC-01,TC-02,TC-03: Tester_JR
TC-04,TC-05 : Tester_YS
TC-06,TC-07,TC-08: NOT ASSIGNED

If TC-01 is executed by admin (status=BLOCKED), if we go to charts, we will see:

1. NO TRACE of admin activity
2. One test case with status BLOCKED, with Tester_JR as tester

Because since TestLink 1.9.3, Tester Assignment is managed at BUILD Level, we face another issue with this CHART, because do not consider BUILDS (IMHO due to some missing refactoring while moving from TestLink 1.9.2 to 1.9.3).

Let's play a little bit and see how things changes:

Tester Assignment FOR BUILD 2.0 - ALL TEST CASES HAS NO Tester Assignment
TC-01,TC-02,TC-03: NOT ASSIGNED
TC-04,TC-05 : NOT ASSIGNED
TC-06,TC-07,TC-08: NOT ASSIGNED

Go to Charts - Report By Testers
1. NO TRACE of admin activity
2. One test case with status BLOCKED, with Tester_JR as tester
NOTHING HAS CHANGED

Now, TC-01 is executed by admin (status=FAILED), if we go to charts, we will see:
1. NO TRACE of admin activity
2. One test case with status BLOCKED, with Tester_JR as tester
3. One test case with status FAILED, with Tester_JR as tester

Change Tester Assignment FOR BUILD 2.0 - Assign TC-01 to Tester_YS
TC-01 : Tester_YS
TC-02,TC-03 : NOT ASSIGNED
TC-04,TC-05 : NOT ASSIGNED
TC-06,TC-07,TC-08: NOT ASSIGNED

On charts we get:
1. NO TRACE of admin activity
2. One test case with status BLOCKED, with Tester_JR as tester
3. One test case with status FAILED , with Tester_YS as tester

This means that test count has been moved to Assigned Tester of LATEST Execution,or at least this seems.
Ok, try to verify is this is the behaviour:
Then If we re-run TC-02 on BUILD 1.0 (status=PASSED), the chart will change again ?
We expect test count be moved to Tester_JR => but on 1.9.3 this DO NOY HAPPENS.

Now, Create a new BUILD 3.0, do not assign
Execute on 3.0, TC-02 => nothing changes => still is displayed for Tester_YS.
Assign to admin TC-02, BUILD 3.0
Chart changes => test case execution is moved to admin

Change assignment on 3.0 to Tester_JR
Chart changes => test case execution is moved to Tester_YS !!!!! not to Tester_JR.

What is happening? seems that DB Tester ID is used in some way (WRONG) on algorithm.
On DB used to test this:
admin => ID=1 (as usual)
Tester_YS => ID=9
Tester_JR => ID 36.

Well and then, Dev Team is going to fix this on 1.9.4 ?
ANSWER is NO.
We are going TO REMOVE this CHART.
We plan to add on 2.0, results by Assigned Tester ON BUILD Basis.
Post Reply