Automated excecution of testcases

[ana]

I want to know is there any way by which i can use testlink to execute testcases automatically,by integrating any other automated system with its.

[Rodrigue]

Hi ana,
After searching a while on that topic I found out that it´s impossible to automate tests with TL. But so far I know there´s this so-called XMLRPC which enables interacting with TL through scripts. This could be used to automatically pass test results to TL. Howhever I have not succeded in getting it to work on my desk till yet.
Hope someone can help...

[naveentiru]

Hi,

Please let me know, if you get a way to work XMLRPC with TL.

Thanks,
Naveen

[kcurran]

We have been using the XMLRPC interface to update automated results in TL. We use the Perl XMLRPC::Lite module to accomplish this.

[naveentiru]

Could you please help me to explain the process of XMLRPC interface to update the automated results in TL.

Please share any docs for help.

We have been using the XMLRPC interface to update automated results in TL. We use the Perl XMLRPC::Lite module to accomplish this.

[kcurran]

Our automation reports the test results in a specific test plan.

Each automation run creates a new build within the test plan.

The automation updates the test case(s) result( referencing the test case name in the test plan which are well known names between Testlink and the automation application.)

[Jeremy]

From the 1.8 roadmap: "Basic support for test automation (experimental) "

1.8 has been out for a little while now - is there any support, no matter how half-baked, for executing automated test cases from TL? The company I work for is evaluating test case management GUIs to bundle with our automated testing libraries and honestly the only place TL comes up short is the inability to kick off automated test cases.

[jiang]

by default, this button was not there, it can be enabled per the install instruction.
when it's clicked, it seems to call something:

Call to undefined function executeTestCase() in /var/www/testlink/lib/execute/execSetResults.php on line 573


and line 573 is:
$executionResults[$tcase_id] = executeTestCase($tcase_id,$tree_mgr,$cfield_mgr);


not sure how to use it.

any example?

[Amaradana]

Same i was also looking how to integrate. As far as i know we can integrate Selenium RC with testlink i guess, where XMLRPC is a interface, but i have no idea how to do it/integrate. I am also looking for this info. Let us know if some one can help in this for us.

[AnneGaelle]

Hi !

I wrote some python scripts to execute a whole test plan at a time or to use the "Execute and Save Results" buttom. I'm now dealing with the same things in java code. Some examples are provided to use xml rpc methods (/lib/api/sample_client under TestLink repository). There's just a little error when using reportTCResult method, replace tcid by testcaseid and tpid by testplanid in method definitions. I also think the build id is no more optional but required.
I can no more access to python scripts because I changed of company but I may help you if you meet some troubles.

Amaradana, I'm interesting by the integration of Selenium RC. Can you say me a bit more.

Hope it can be useful.

[Amaradana]

Hi Anne,
Thank you, can you please explain a elaborate how you managed your automation or can you please document this, as this would help us a lot for other users, i am sure most of the users who are using testlink have no idea about how to use xmlrpc, and what it does, as there were no documents present. this would really help us if you can document how you managed. Some where when i searched in Googled i read an article about this when the test importance is set to automated, we get a extra button "execute and save", up on clicking this it calls Selenium RC/control i guess, and that test case would be executed and saves the result in the testlink database, in this process, XMLRPC is used as an interface. In this way we can do but the point is we have no documents how to configure this or use. So i was looking keenly for this information.

[AnneGaelle]

Hi !

I have some work dued for the end of the week but I may be able to produce (on Monday) a documented example in java or python, explaining how to use the methods of TestLink API. If you wanted to use Selenium RC, I think java code is the better solution because, if i am right, Selenium is able to produce java code.
Did you get the example given by testlink team at lib/api/sample_clients/java ?

If you want to use the "Execute and Save results" buttom, you can not use the methods of TestLink API. It is another way to proceed which is not explained in TestLink documentation (or I never found it !). In that case, you have to write an XML-RPC server (and not client contrary to the other case) which implements a method call executeTest. I will try to find my code and post as soon as possible.

[Amaradana]

Hi ,

Thank you, that will be really helpful for the users and off course me too and also for the better improvement of testlink for the future . Please document how to use and integrate as well, yes the api folder present in the testlink, i never understood the use of it, i am trying too understand everything in terms of database and also the functionality that are not documented. Please post it here or you can also email to me at m.amardeep@gmail.com. So that i will see if we can improve the automation process related documents are included in the next version. Thanks once again, will wait for your reply and document

[Guillaume]

Hi !

I'm trying to link TestLink and Selenium too.
I enabled 'Execute and Save results' and I would like write an XML-RPC server to be able to launch Selenium RC with good script files when user clicks on 'Execute and Save results' button.
So I'm interesting in AnneGaelle's code too !

Amaradana, if you progressed, can you explain how to write this XML-RPC server and integrate this code in TestLink.


Thanks

Gullaume

[Amaradana]

Hi Guillaume,
We are also looking for same thing, i am waiting for Anne reply.