[Registry-dev] Registry Performance testing

[Sanjaya Karunasena]

Few areas which you many want to ensure coverage when designing the tests.

* Depth of the tree (# of directory levels)
* Versions created at the root of the tree
* Versions created at a mid level (h/2)
* Versions created at the leaf level
* Number of artifacts (leaf level items)

Is there a way to test concurrency using a similar approach?

/Sanjaya

On Wednesday 02 April 2008, Sanjiva Weerawarana wrote:
> Hi Krishantha,
>
> I haven't looked at what you wrote yet but please make sure we have a good
> load test .. something that puts a few 100k resources into the registry
> and tests performance. We should also set up another test that adds a few
> million resources and tests it.
>
> We need to set up these tests to run on some box and for the reports to be
> sent to this list.
>
> Thanks,
>
> Sanjiva.
>
> krishantha wrote:
> > Hi All.
> >
> > I have written a Registry API and junit based performance test suite in
> > order to test average execution times for Resource/collection
> > get,put,delete and rename functions with specific data volume. users can
> > specify the data volume by changing three, four variable values. I
> > didn't commit this code in to registry svn trunk since executing this
> > kind of performance test takes long time. As suggested by deepal I think
> > it is better to build this suite with Ant with registry dependency.
> >
> > Please find the source of the test [1]. You guys may  have suggestions
> > to improve the code. So all your suggestions are appreciated.
> >
> > Within next few days I am going do performance analysis/comparison using
> > this suite and jmeter for selected registry development milestones.
> > Please find the attached file listing test suite result sample .
> >
> > Regards,
> > Krishantha.
> >
> > [1]https://svn.wso2.org/repos/wso2/trunk/commons/qa/registry/performance-
> >testing
> >
> >
> >
> > ------------------------------------------------------------------------
> >
> > End of Adding 250 users to the role registryTeam
> > End of Adding 10 roles
> > End of creating 1000 Resources
> > End of Adding Dependencies to  1000 Resources
> > End of Assign User level write and delete permissoin to  250 users
> > End of Assign role level write and delete permissoin to  1000 resources
> > End of creating 2nd version of  1000 resources
> > Average Resource get time: 97 ms
> > Average Collection get time: 40 ms
> > Average Resource put time: 1670 ms
> > Average Collection put time: 1498 ms
> > Average Resource delete time: 1468 ms
> > Average Collection delete time: 1419 ms
> > Row Count of each Registry Table
> >
> > Row count REG.VERSIONS: 9203
> > Row count REG.ARTIFACTS: 3502
> > Row count REG.COMMENTS: 2400
> > Row count REG.DEPENDENCY: 1967401
> > Row count REG.DEPENDENCY_MANAGEMENT: 998
> > Row count REG.LOGS: 9601
> > Row count REG.PROPERTIES: 0
> > Row count REG.RATINGS: 1200
> > Row count REG.TAGS: 3600
> > Row count REG.UM_PERMISSIONS: 14020
> > Row count REG.UM_ROLES: 14
> > Row count REG.UM_ROLE_ATTRIBUTES: 0
> > Row count REG.UM_ROLE_PERMISSIONS: 19521
> > Row count REG.UM_USERS: 253
> > Row count REG.UM_USER_ATTRIBUTES: 250
> > Row count REG.UM_USER_PERMISSIONS: 28537
> > Row count REG.UM_USER_ROLES: 503
> > Row count REG.CHILDREN: 0
> >
> >
> > ------------------------------------------------------------------------
> >
> > _______________________________________________
> > Registry-dev mailing list
> > Registry-dev at wso2.org
> > http://wso2.org/cgi-bin/mailman/listinfo/registry-dev