Performance problem

[gunter]

Hello,
since we have updated from 1.8.5 to 1.9.1
i see that the performance is going down extremely. We have now 2000 TC's complete.
In a single testplan we have 1000 until 1400 TC's. Biggest problems we had are in the testreports
and in Add or remove TC's to testplan functionality. Specially the last function is very problematical.
For all testplan's this function is very slow. Response time: some minutes!
For a view plans i only got a white screen. (error in php)
To solve this i have increased the memory_limit up to now: ini_set('memory_limit', '2512M');

But this is to big for my server. He had only 3.5GB on memory. And when i call 2 or more times a
big query then the server begins to swap. And so the performance is going more down.
The server runs with linux and mysql.

Current i try to increase the memory of the server, but it is not easy, because it's not my server
and the server runs in a data centre.
But the real question is, why i need so much memory ? Is this realy necessary or is there a bug in the query's?
Or what else can i do to increase the performance.
Thank's in advance
Gunter

[gunter]

Second information,

when i go to section "Add / Remove Test Cases " and click on a child testsuite in the tree on the left site,
it does'nt matter how much tc's are in the testsuite.

Nearly the complete memory (2.5GB) is used for, as an examble, 4 TC's.
This looks like that the complete tree will be readed and transferred from the server to the client.
Maybe this query is not optimal ?

When i go to section "Assign Test Case Execution" then there is no problem.
For me it looks like that there should be a similar query. But this query is very fast
and need only a little of the server memory.

I am not a php programmer so it's not possible for me to debug this problem.
Is there anyone who can confirm this problem ?
Best Regards
Gunter

[Amaradana]

Can you please list your machine deatils like OS/Server details, etc and can you send me your database to below email id m.amardeep@gmail.com?

[gunter]

Hello Amaradana

hope this info will help,
with db is problematic, i have to ask.

But if you have any code for testing to find out the problem i will try to run it on my server.
Best regards
Gunter


Fedora Core release 6 (Zod)
Linux create 2.6.20-1.2962.fc6 #1 SMP Tue Jun 19 19:27:14 EDT 2007 i686 i686 i386 GNU/Linux



processor : 0
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 3
cpu MHz : 3200.473
cache size : 2048 KB
physical id : 0
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips : 6403.96
clflush size : 64

processor : 1
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 3
cpu MHz : 3200.473
cache size : 2048 KB
physical id : 0
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips : 6399.34
clflush size : 64

processor : 2
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 10
cpu MHz : 3200.473
cache size : 2048 KB
physical id : 3
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl cid cx16 xtpr lahf_lm
bogomips : 6399.45
clflush size : 64

processor : 3
vendor_id : GenuineIntel
cpu family : 15
model : 4
model name : Intel(R) Xeon(TM) CPU 3.20GHz
stepping : 10
cpu MHz : 3200.473
cache size : 2048 KB
physical id : 3
siblings : 2
core id : 0
cpu cores : 1
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 5
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl cid cx16 xtpr lahf_lm
bogomips : 6399.33
clflush size : 64

[Amaradana]

Hi Gunter,
I am having Windows XP in my machine and i use XAMPP which works perfectly as you said if the data is too long, once i faced problem like its having 15000 cases and 3 to 4 projects. i really can not test in fedora operating system.

I am not sure if its db problem or server problem, I am thinking this is only problem from server side as i can work with out any issues. wait for people to reply if some one uses fedora, or you can send your db so that i will test and let you know my observations.

[gunter]

Maybe it's a problem of the numbers of the builds.
In the past, every time i got a white screen when i try to add more tc's,
than i increased the memory limit.
But now im in the near of the real memory,
so i coud'nt increase more.

But today i get a white screen again.
So i tried to delete some build and after that
the function is working correct.

In front of the deleting i have had 63 builds.
After deleting of 5 Builds the white screen is gone and the function will work.

best regards
Gunter

[jack090]

I would move your mysql instance to a seperate machine and have 1 box dedicated as the application server and 1 for the DB. This will increase efficiency.

[gunter]

Currently i have transferred Testlink on a new virtual Windows 2003 Server.
The problem with the use of to much memory is now more worst.

So i believe it could be a problem with the filtering.
Whatever filter i use the memory usage starts from 1.8GB to 3.6GB and then it comes to an error message.
I am not a php programmer so i don't understand that complex filter module.

But "Assign Test Case Execution" is very similar and it works on the same Project and Plan very fast.
So i thing there must be anything wrong with the SQL Statement .
Any idea what could happen ?

best regards
Gunter

[fman]

please open an issue with as much details as possible:

1. DB Type
2. web server type
3. number of test project, test suites, test cases

on mantis

[KC_Ray]

I hate to butt in to someone elses problems, but we had **woeful** performance with our TL 1.9. We also have thousands of TC's and running reports took ages.. infact, the server ground to a halt when reports were run, and they took 15 minutes, maybe an hour or more. Many unhappy users....

Our server? Running CENTOS 5.5 linux with twin 4 core cpu's and 32GB ram, + MYSQL so not underpowered!!

All our problems have been fixed by installing TL193 and copying the database to a new instance, and upgrading that new instance. Really fixed. Reports take seconds. Users can log in and use the tool. People have stopped phoning me to complain about TL.

Managers are happy their reports run. Users are happy they can test. Ipso-facto, I'm happy

[fman]

We are working on a big refactoring of core methods that have performance issues.
We expect to have some results on a month more or less.
We will announce on news when done