Is there somewhere an unbiased comparison TestLink vs. QaTraq (or other Opensource or reasonably priced Test Case Management Tools / I am not talking about Testdirector ).
In the QaTraq Forum in one older thread from mid 2006 it is mentioned:
We have twice as many downloads each week than our nearest rival (which is TestLink).
On the other hand on the Website http://www.opensourcetesting.org it is stated that TestLink has been roughly twice more downloaded compared to QaTraq.
What are the weaknesses/strengths of TestLink compared to QaTraq (and others)?
First - I consider we have no rivals, i.e. any other good effort to build a test management system is welcomed.
Second - if you want a testdirector clone -> Salome is for you
Third -I do not if someone has done the comparison you want.
My opinion:
qaTrac must have better look and feel (we lack a Graph Designer in our team), and have surely good features.
We (develop) and love TL, and want to make it better.
then my opinion can not be fair. Only choice -> download both, compare and give us a good comparison doc
Thanks for the fast reply. I was aware of the fact that I am posting in a TestLink Forum, still was hoping that somebody could give me a honest/professional hint. At the end of the day if one product works I would not change it or look for something better, but in my situation it would be nice to save some (initial) time for the review.
I already "played" a little bit with TestLink (and definitiely do like it), also with SpiraTest (commercial, but not soo expensive) and now before making the definitive decision came across QaTraq.
Anyhow I wish you a lot of success! Keep the good work.
I hoped that users give more attentions to this question. I think that a lot of them compared several tools before they choose a one.
One difference is, that qatrack is just a business case. It's owned by a company. They would like to get some money for additional features. We are community. So if you would like to have pay for support ... choose qatraq.
Originally the tool was copied features from testlink 1.5. I don't know, what it offers now.
I am looking for a test management tool for my work also and find TestLink and QaTraq. Currently, I am evaluating TestLink. However, the first impression I have on the tools are:
1. Both TestLink and QaTraq are Open Source applications.
2. TestLink is free while QaTraq is partially free. Reports are paid features in QaTraq.
3. TestLink is supported by a community while QaTraq is support by a commercial company.
4. TestLink and QaTraq operate based on a different testing process.
5. Testing process adopted by QaTraq seems to be comprehensive and complete while that of TestLink seems to be vague.
6. Both tools trace tests back to requirements.
7. Both tools do not trace tests back to design.
By the end, I think you should choose a tool that meet the testing process of your work instead of just features available from the tool. Tool is only the mean to improve the effectiveness of your work process.
I decided to move from evaluation into trial with TestLink on a real project.
Both have their plus and minus. Both tools claimed to be open sources and free.
QaTraq seems to have a thoughtful process. However, it provides no report unless you are willing to pay. In other words, you can keep entering things into it. But you cannot print it out. This make me feel like being cheated.
TestLink allows in and out. But, its testing process does not fit my workplace. It requires some tricky customization to fit my works. Since TestLink developers have settled in its testing process and the process seems accepted by existing users, I have no intention to request change to this process.
Thanks for the answer. I am still quite uncertain. As you are saying both products have their +/--sis. I however tend to go at the end for QaTraq - the process is definitely more mature. Re. paying for reports, yes you are absolutely correct QaTraq is not pure OpenSource, on the other hand to pay a little bit is not so bad (compared to "monsters" like TestDirector this is still a bargain...).
I agree with the result of your analyse. In addition the current version TL 1.7 was cursed by core changes. So some process related features was broken (and was not fixed in 1.7 yet).
Good information for Francis: I personally interested in relation of TestLink to well known standards as is IEEE Test Plan Standard and others. Test specification audit is in scope of 1.8.
I really like the open-minded & professional communication of the people involved with TestLink development. Independently which product we decide to utilize, TestLink IS really a good product! And hopefully Versions 1.8 ... 2.x will solve the "process" problems - should keep an eye on it
havlatm wrote:I personally interested in relation of TestLink to well known standards as is IEEE Test Plan Standard and others. Test specification audit is in scope of 1.8.
Which IEEE Standards you are talking about? Do you mean Testing Process or Testing Document Template? Please advise.
I mean for example: IEEE 829 (Test Plan). I also has some materials from BCS testing foundation. Generally, important points of testing process are included in the most of materials.
A good place to go for information to compare the two projects is the bugbase. See what sorts of problems users are complaining about in each system ... and see how the developers react.
My take is that both products are somewhat tweaky and force you into their ways of thought on process. They're not as flexible to variations in process as are the bugbases I'm familiar with (Bugzilla, which everyone use because everyone uses it; and Mantis, which I like better for its customizability.)
I have not yet test QaTraq, but for my poit of view an important point with Testlink is "it's CVS option". I think it is a very good point to have a version management of the Test.
to mroeder
Note, that they have a company maintained product and they expect to get money from support and some features. TestLink are free community.
Should you expect that appropriate comparison is reaction of developers?
Anyway, the kind of reported problems seems to be valuable comparison.
).
