New request: integration testlink in subversion

The release related discussions, plans and questions.
Locked
Farina
TestLink user
Posts: 2
Joined: Wed Jan 30, 2008 2:41 pm

New request: integration testlink in subversion

Post by Farina »

Hi,
I'm Angela from Italy and I'm a tester, my society asks to me to create a Quality Center.
Testlink and Mantis are ok for us and my collegues are very happy to use them.
My problem now is how integrate testlink with mantis under subversion tool, because my society uses this tool to configure all projects.

Thank in advance. :D
Angela
Laurent
Advanced user
Posts: 22
Joined: Thu Apr 13, 2006 5:46 pm
Location: Milpitas

What kind of integration is needed with subversion?

Post by Laurent »

I am curious about your request. We use subversion internally and I don't see what would be needed in terms of integration. But maybe you have something specific in mind.

Do you need to collect the change sets? Do you want to create a new TL build everytime a checkin is made?

We are about to do this as a post-checkin hook. Basically creating a build from svn to TL.
Farina
TestLink user
Posts: 2
Joined: Wed Jan 30, 2008 2:41 pm

Post by Farina »

Hi Laurent,
thanks for the answare and sorry because maybe I'm not been clared.
I try to explain better my request.
My problem is this:
- I create a project under TL with all test, I execute the tests
- If it's present a bug, from TL I can add it to mantis
- The bug is seen from developers under subversion (mantis is under it) and the bug is solved and closed

At the end, I would close the cicle inserting in TL that the related test is closed because the bug is solved.
Maybe the integration expression was not clear, I'm sorry, I hope that I explain better now what is my action item.
Maybe, your solution is ok also for me.
Could you explain me how you made it?

Thanks
Angela
Laurent
Advanced user
Posts: 22
Joined: Thu Apr 13, 2006 5:46 pm
Location: Milpitas

Maybe there is another way

Post by Laurent »

Ok, I think I undertand what you are looking for.

So basically, you find a bug, create an entry in Mantis, and add the bug number to TL so that you have a trace.
Now unless you are doing some white/grey box testing, your chances of knowing which area of the code cause the problem are slim, unless you have partitioned Mantis very cleanly.

Now the developer takes your bug and resolves it (you are the one who should be closing it, right?).

Where I see an integration required is between Mantis and SVN. Upon check in/commit, the dev. puts the bug number in the commit notes and Mantis changes the state to resolved (As I may have said, I am not very familiar with Mantis).

If they are nice :) they give you proper release notes with a candidate, or you find your way through the commit notifications/change log and gather the bug fixes. Regress them, and close them. Et voila.

Some bug tracking system also allow you to gather change sets. Some Fancy one such as Rational UCM/ClearQuest, Accurev will do it automatically.

Doing this kind of integration is in my opinion not trivial (trunk, versus branches, merge points, etc.) so that wouldn't blame the TL dev. not to take this route, because then you have all the other SCM tools. This is a real problem for commercial products as well. I know a few companies that have move their product to the eclipse platform (e.g. Scapa) for that simple reason.

I think that 1.8 is supposed to deliver a plug-in architecture, which will give you the liberty to extend its functionality.

As far as your last question is concerned, well SVN offers a series of hooks (also know as triggers in ClearCase)

In my group, it is for instance located under /directmnt/repository/swrepos/hooks
and there you can find pre-commit, post-commit , email notifications, etc.
Hooks are written Perl.

The TL dev team has been working on a XML-RPC API. I am in the process of testing it internally. What it means is that you need to have their server installed with your TL (I think you need 1.7.3). Because it is XML-RPC you can basically interface TL from pretty much any languages (including Perl).

So bottom line, you process the commit on post or pre commit hook, get the information you need, connect to test-link and update the information at you leisure. Not that complicated to do. The TL team has given some sample clients written in Python and Ruby, I have written my own in Lua.

I use test link in another manner (our automated test runner (will) update the test cases part of a build automatically).

If this is still not what you are looking for, I suggest that you think exactly what you need to be done and file a feature request in Mantis (TestLink).

If the dev team believes that it makes sense for the community, then you might see your wish come true.

Best of luck.

/Laurent
havlatm
Member of TestLink Community
Posts: 940
Joined: Mon Oct 31, 2005 1:24 am
Location: Czech

Post by havlatm »

Laurent, thank you for great analyze. I can confirm your expectations. The main purpose of TL is test plan, specification and reporting. So we would like to concentrate to enhance internal functionality. I believe that the new API interface solves the possibility to integrate more specific functionality by users.

I find one interesting feature in the discussion. TestLink could be able collect information about solved bugs of specific build (for reporting purpose). Please add request to tracker if you interested to have it in future.
Laurent
Advanced user
Posts: 22
Joined: Thu Apr 13, 2006 5:46 pm
Location: Milpitas

Feature Request?

Post by Laurent »

Let me think about it and I will. I still think that TL should be SCM agnostic (for your own sanity :).

Cheers
havlatm
Member of TestLink Community
Posts: 940
Joined: Mon Oct 31, 2005 1:24 am
Location: Czech

Post by havlatm »

Please use our tracker to specify the request if you finish the idea into specification shape. It's more easy to maintain for us.
Laurent
Advanced user
Posts: 22
Joined: Thu Apr 13, 2006 5:46 pm
Location: Milpitas

Post by Laurent »

I intend to. I also saw that you posted a donation link. Expect something coming our way in a near future.
havlatm
Member of TestLink Community
Posts: 940
Joined: Mon Oct 31, 2005 1:24 am
Location: Czech

Post by havlatm »

Great to read it. :-)
Anyway, I will be more happy if we can extend our team by clever people like you.
Laurent
Advanced user
Posts: 22
Joined: Thu Apr 13, 2006 5:46 pm
Location: Milpitas

Post by Laurent »

I have been thinking about this and I am not too sure where I can make a contribution (Not a PHP dev. - I work in the embedded space , Linux, Lua, etc.)
fman
Member of TestLink Community
Posts: 3123
Joined: Tue Nov 15, 2005 7:19 am

Post by fman »

You can help us with:
- functional analisis
- user level documentation
- case studies

In any project (as you now) there is more than just coding.

Regards
elsmik
TestLink user
Posts: 4
Joined: Thu Feb 21, 2008 2:37 pm

maybe a solution scmbug

Post by elsmik »

Hallo

i think this will help you http://www.mkgnu.net/?q=scmbug

to start http://blog.platinumsolutions.com/node/102

and in subversion you can have this properties bugtraq: on folder level
this will give you the posibility to add a bug number

i dont have tried it jet in this combination but it sounds good

zwerg
Locked