As an ArgoUML contributor I'm going to blog my activities here, so that they may draw interest by other developers or help other developers when doing tasks similar to what I've done. AND(!) the grand vision that makes an Argonaut what he is, TO THRIVE IN THE BIG DANGEROUS WORLD, TAKING THE Argo TO A GOOD SHORE ;-))

Wednesday, December 05, 2007

2007-12-05

I'm working now on issue #4923 and this requires some measurements of the time the automated headless tests take to run. Thanks to Linus' efforts in setting up a continuous integration server this isn't very difficult, I will simply take the latests 10 results from the revisions of the JUnit reports summary and compare them with the next 10 results after making my change in the model-mdr implementation.

So, here are the values and the total average before the change:

Before changes, Java 5 tests.
revisionTestsFailuresErrorsSuccess rateTime (s)
rev=445611151099.91%3065.731
rev=444311151099.91%2921.652
rev=443111151099.91%2899.956
rev=440811172099.82%2792.906
rev=439211163099.73%2789.595
rev=4378111600100.00%2866.223
rev=4367111600100.00%2842.319
rev=4355111700100.00%2861.930
rev=4345111700100.00%2887.080
rev=4340110100100.00%2787.845
Average time:2871.524

 

Before changes, Java 6 tests.
revisionTestsFailuresErrorsSuccess rateTime (s)
446211151099.91%2715.539
444811151099.91%2665.635
443711151099.91%2665.288
440011163099.73%2526.352
4383111600100.00%2627.562
4372111600100.00%2596.418
4360111700100.00%2651.676
4350111700100.00%2654.227
4332110100100.00%2514.612
4318110100100.00%2509.551
Average time:2612.686

Tomorrow I'll make tests with ArgoUML running to check if the MDRModelImplementation constructor is called during its execution and if not I'll commit my changes to MDR. Then, it is a matter of waiting 10 days for the veredict of the performance hit.

Update on 2007-12-19: added averages and results after changes.

Afer changes, Java 5 tests.
revisionTestsFailuresErrorsSuccess rateTime (s)
4611111600100.00%2910.440
4594111600100.00%2917.587
4581111600100.00%2905.284
4570111600100.00%2903.603
4559111600100.00%2898.110
4546111600100.00%2909.500
4533111500100.00%2906.624
4521111500100.00%2904.351
4508111500100.00%2939.427
4496111500100.00%2903.854
Average time:2909.88

 

Afer changes, Java 6 tests.
revisionTestsFailuresErrorsSuccess rateTime (s)
4586111600100.00%2665.922
4575111600100.00%2665.115
4564111600100.00%2660.793
4552111600100.00%2677.356
4538111500100.00%2668.918
4526111500100.00%2677.958
4514111500100.00%2699.183
4501111500100.00%2687.672
4488111500100.00%2630.221
447411151099.91%2757.297
Average time:2679.04

So, a ~2.5% performance hit in Java 6 and a ~1.3% hit under Java 5.

Reader Shared items

Followers