Page 1 of 1

CF_EXEC_TIME and CF_ESTIMATED_EXEC_TIME Report Problems.

Posted: Tue Jan 08, 2013 5:51 pm
by mtavares
CF_EXEC_TIME -

When using CF_EXEC_TIME and CF_ESTIMATED_EXEC_TIME.

I Select Test Report -->
I Select Metrics and Test Case Custom Fields.

When I selected the top-level folder aka parent:

Both fields are displayed:

Estimated time for executing 2845 test cases (hours):47.17
Time used for executing 2845 test cases (hours):85.12

However:

When I repeat the same steps one-level down on the suite level:

Estimated time for executing 348 test cases (hours):5.8

In this case I do not get the Time Used only the Estimated time.

I will be glad to provide very detailed steps to reproduce and log a bug once a get confirmation on the supported behavior.

Re: CF_EXEC_TIME and CF_ESTIMATED_EXEC_TIME Report Problems.

Posted: Tue Jan 08, 2013 6:44 pm
by mtavares
Pre-steps:
I have a project with: CF_EXEC_TIME and CF_ESTIMATED_EXEC_TIME enabled on Test Execution and set to display on Test Execution. The Type is a float and it is available for Test Case.

My Test Plan has two suites, each containing four test cases.
There are no platforms and only 1 build is specified.

In Test Suite1 the Estimated Execution Time was set to 2 minutes for each test case
The Test Cases in suite 1 were executed and passed and the actual test time was put in as 3 minutes.

Estimated Execution Time (minutes): 2
Actual Execution Time (minutes): 3

For Test Suite2 the estimated Execution Time was set to 1:
The Test Cases in suite 2 were executed and passed and the actual test time was put in as 2 minutes.

Estimated Execution Time (minutes): 1
Actual Execution Time (minutes): 2

I correctly select my Test Plan “Test Plan 5” and Select Test Report.

I select Test Case Custom Fields and Metrics and click on the upper level folder “Test Report 5”
Results: Estimated time for executing test cases (min): 12
Actual Execution Time is (min) 20

I select Test Case Custom Fields and Metrics and click the first suite “suite 1”
Results: Estimated time for executing 4 test cases (min):8
Actual Execution Time is not Listed.

I select Test Case Custom Fields and Metrics and click the second suite “suite 2”
Results: Estimated time for executing 4 test cases (min):4
Actual Execution Time is not Listed.