[wsas-java-dev] Re: Integrating smoke test with nightly build

[Charitha Kankanamge]

Hi Azeez,
We are planning to start form linux build and move froward with Windows. 
Following will be the test procedure.

1. Get the nightly build before making the archived version

2. Copy the build to a directory

3. Call smoke test script (See below)*

4. Log test results

5. If test are successful, copy the build to a nightly build download 
directory of the build machine

6. Continue the existing build script to make the zip file


Smoke test script
~~~~~~~~~~~~~~
Smoke test 1
--------------------

Start wso2wsas.sh

Check whether wso2wsas.sh starts successfully

Smoke test 2
------------------------------

Access admin console

Invole a service

Chinthana will help us to create a shell script to implement the above.

Regards
Charitha


Charitha Kankanamge wrote:

> azeez at wso2.com wrote:
>
>> One of the problems we are facing is that even though the WSAS nightly
>> build is successful, WSAS does not startup properly or doesn't behave as
>> expected i.e. it smokes when turned on. This was revealed by one of 
>> recent
>> JIRAs filed by Jonathan. The nightly builds may have some defects, but
>> should never smoke.
>>
>> Therefore, we must have a set of smoke test scripts integrated with the
>> nightly build system. If all unit tests pass & the build is successful,
>> the smoke tests will be run against the build. Smoke test failure will
>> fire an alert. A nightly build which smokes should not be uploaded to 
>> the
>> nightly build repository. This is a best practice adopted by some of the
>> leading software engineering companies.
>>
>> Charitha, please lead this effort in developing a set of smoke test
>> scripts for WSAS. You can start with a simple script that checks whether
>> there are any exceptions when WSAS is started up, and then gradually 
>> grow
>> this script. Once this is done for WSAS, we can also implement this for
>> other products.
>>
>> -- Azeez
>>
>>
>>  
>>
> Sure Azeez. We will look in to this ASAP. We will need to find out a 
> suitable test automation tool in order to develop smoke test scripts.
>
> Regards
> Charitha
>
>
> _______________________________________________
> Wsas-java-dev mailing list
> Wsas-java-dev at wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/wsas-java-dev
>
>