Testlink Performance isssue for large setup

ninads78 · Post by **ninads78** » Wed Oct 15, 2008 12:54 pm

We are evaluating testlink for our test management tool. We are also evaluating it performance wise, in which we are currently facing issues.

We have around 30,000 - 40,000 test cases for one project and around 12,000 test cases for execution on an average for a typical cycle. There are around 150 testers that would using testlink and there could be more than 50+ simultaneous connections

I am facing lot of performance issue with the operations like Edit test case, execute test case, assign test case. The tree structure to get generated it takes lot of time even when only one user is using the system. The testlink is configured to use JTREE.

Is there any way we can improve the performance of testlink?

Post by **fman** » Wed Oct 15, 2008 1:42 pm

1. we have made some improvements on 1.8 on tree using EXT JS.
2. Anyway this amount of test cases on one test project is too much
and a tesplan with 12.000 will be unmanageable.

Problems will arise with script execution time and with memory usage.

I suggest using last CVS code from 1.8 and the old Julius Ceaser maxima:

Divide and Conquer => try to do not go over 5000 test cases on one test plan.

I do not know if with this kind of structure (PHP, MysQl, etc) we will be able
to give a good increase on performance. Really I do not have enough experience.

regards

ninads78 · Post by **ninads78** » Thu Oct 16, 2008 3:59 am

I checked out 1.8 using the tree EXTJS, it had much better performance than what 1.7.4 JTREE has.
I won't be able to use 1.8 till its official release is out. The only problem till now that I saw with 1.8 is with IE the create test plan and create test project is not properly visible and we can't do this operation using IE. The IE version I am using is IE 6.0.2900.5512

Do we have any setting to be done on database, PHP or Apache front to increase the performance? I am using Apache 2.2.9 and Postgres DB.

The setup I am looking at is going to be accessed across geographical locations with total of 150-200 users, where mostly 50-80 users using Testlink simultaneously. Do you think Testlink can sustain such an configuration?
I am planning to check on a high end system with Xeon quad core processor with 4GB RAM, do you think this configuration could work for such kind of setup?

Post by **fman** » Thu Oct 16, 2008 2:39 pm

one dev team member is doing work on performance analisys and seems he has found a couple of bugs that have performance impact.

Important: to test 1.8 use LAST CVS code.

Is possible your you to send me your db zipped ? then we can do tests
without need to create DB.

You will face another problem migration to 1.8, and if you send us the db I can do some tests (on my laptop migration of 5000 test cases takes 30 min)

I'm doing all my tests on my laptop with XP, 1.3G Ram, apache and mysql

my email francisco.mancardi@gmail.com

regards

ninads78 · Post by **ninads78** » Fri Oct 17, 2008 7:30 am

Another performance issue with Testlink 1.7.4 is that when we click on Execute or apply filter on execute or click a folder under execute, it tries to load all the test cases under the main folder or subfolder which is clicked.

Is there any way to turn that feature off? I am not interested in Bulk execution and defiantly don' t want if a folder has 500 test cases to load all those 500 test cases

We are looking into code to turn it off, but if you already have a fix or know the change, please do share it with me.

Thanks

Post by **havlatm** » Wed Oct 22, 2008 1:06 pm

We would like to release 1.8 RC1 in really near future with improved performance. It will help us if you try this version with your data and report performance results and/or your satisfaction.
We hope that you will see significant improvement.

Post by **fman** » Thu Oct 23, 2008 8:21 am

on 1.8 we have added a config option to disable read of all test cases in test suite when you click on test suite.
you can got 1.8 code and try to reproduce our change on 1.7 if you wnat

feel free to contact me

please try to give us your BIG DB to use as our standard performance data set

lshiva86 · Post by **lshiva86** » Thu Nov 13, 2008 4:18 am

Hi,

I have posted the code in mantis long back. If you have an id on tracker you can access this link http://www.testlink.org/mantis/view.php?id=1824. Else, we need to wait till testlink community people put it on user contribution.

In the link provided above, there are instructions as to how the changes need to be done. Also, upload.zip contains the code and a document describing the analysis is also uploaded.

If you need anything else, do ask me. Thank you!

Regards,
Lakshmi