[wsas-java-dev] Re: Integrating smoke test with nightly build

[Charitha Kankanamge]

azeez at wso2.com wrote:

>One of the problems we are facing is that even though the WSAS nightly
>build is successful, WSAS does not startup properly or doesn't behave as
>expected i.e. it smokes when turned on. This was revealed by one of recent
>JIRAs filed by Jonathan. The nightly builds may have some defects, but
>should never smoke.
>
>Therefore, we must have a set of smoke test scripts integrated with the
>nightly build system. If all unit tests pass & the build is successful,
>the smoke tests will be run against the build. Smoke test failure will
>fire an alert. A nightly build which smokes should not be uploaded to the
>nightly build repository. This is a best practice adopted by some of the
>leading software engineering companies.
>
>Charitha, please lead this effort in developing a set of smoke test
>scripts for WSAS. You can start with a simple script that checks whether
>there are any exceptions when WSAS is started up, and then gradually grow
>this script. Once this is done for WSAS, we can also implement this for
>other products.
>
>-- Azeez
>
>
>  
>
Sure Azeez. We will look in to this ASAP. We will need to find out a 
suitable test automation tool in order to develop smoke test scripts.

Regards
Charitha