Personalize

Why doesn't Mule run the performance tests they have been talking about for the last two years?

I came across this post on the mule-user list recently, where a user questioned why Mule didn't encounter the issues we reported against Mule during our performance testing. Its been almost a year since I published two sets of benchmarks of Apache Synapse / WSO2 ESB against a leading commercial ESB, as well as Apache ServiceMix and Mule. We explained the scenarios, and made the code/configurations used publicly available, and even made the load generator tool (a Java clone of ApacheBench) available freely. Although we reported these issues we faced with Mule, we never heard back from them, except ofcourse for the whining from Dave about our benchmark results, to which Sanjiva replied.

Its very interesting to note this comment from Ross Mason on Dain Hansen (BEA)'s blog from November 2006:

"Dain, its very misleading to quote your benchmark figures in a comparison with figures for Mule that were quoted originally by a user without any context and certainly are not benchmark figures. We are working on publishing some figures by the end of the year, but in the meantime maybe you should edit your posting. Cheers, Ross

Posted by: rossmason on November 10, 2006 at 7:37 AM"

Its been over two (2) years! since this comment.. but why don't we still see *any* performance benchmarks from Mule yet? Are you hiding something Mule ;-) ?