[Insight-developers] Testing times

Bill Hoffman bill.hoffman@kitware.com
Mon, 24 Mar 2003 11:15:21 -0500


There is some progress being made in the run time of tests for ITK.
Thanks to those that have helped.   However, I think we still have
a way to go before things are good.  It still takes 11 minutes to run
all of the tests.    Which is not bad, but the following few tests,
take up more than half of that time:

( complete list can be found here:
http://www.itk.org/Testing/Sites/hythloth.kitware/Linux-gcc322/20030324-0500-Nightly/Notes.html )

Can smaller data sets be used, with the same code coverage?


      8.37 %    70.06 s   Testing/Code/Algorithms/itkGibbsTest
      6.31 %    52.76 s   Testing/Code/Algorithms/itkImageRegistrationMethodTest_16
      3.60 %    30.09 s   Testing/Code/Algorithms/itkCannySegmentationLevelSetImageFilterTest
      3.24 %    27.07 s   Testing/Code/Numerics/Statistics/itkGoodnessOfFitMixtureModelCostFunctionTest
      3.18 %    26.62 s   Examples/Segmentation/IsolatedConnectedTest
      3.00 %    25.13 s   Testing/Code/Common/itkLevelSetFunctionTest
      2.59 %    21.66 s   Testing/Code/Algorithms/itkDemonsRegistrationFilterTest
      2.20 %    18.37 s   Examples/Filtering/BilateralImageFilterTest
      2.15 %    18.02 s   Testing/Code/Algorithms/itkMultiResolutionImageRegistrationMethodTest_1
      1.87 %    15.65 s   Testing/Code/Algorithms/itkImageRegistrationMethodTest_14
      1.80 %    15.06 s   Testing/Code/Algorithms/itkImageRegistrationMethodTest_13
      1.73 %    14.48 s   Testing/Code/Algorithms/itkLaplacianSegmentationLevelSetImageFilterTest
      1.73 %    14.44 s   Testing/Code/Common/itkImageIteratorWithIndexTest
      1.69 %    14.17 s   Testing/Code/BasicFilters/itkInterpolateImagePointsFilterTest
      1.64 %    13.74 s   Testing/Code/Algorithms/itkMultiResolutionPDEDeformableRegistrationTest
      1.62 %    13.52 s   Testing/Code/BasicFilters/itkHausdorffDistanceImageFilterTest
      1.61 %    13.47 s   Testing/Code/BasicFilters/itkBloxBoundaryPointImageToBloxBoundaryProfileImageFilterTest
      1.50 %    12.54 s   Examples/Segmentation/GeodesicActiveContourWhiteMatterTest
      1.42 %    11.90 s   Testing/Code/Algorithms/itkThresholdSegmentationLevelSetImageFilterTest
      1.34 %    11.24 s   Examples/Segmentation/ShapeDetectionLevelSetWhiteMatterTest
      1.34 %    11.22 s   Testing/Code/Algorithms/itkMultiResolutionImageRegistrationMethodTest_2
      1.26 %    10.55 s   Testing/Code/Algorithms/itkMultiResolutionPyramidImageFilterTest
      1.20 %    10.06 s   Testing/Code/Algorithms/itkBinaryMask3DMeshSourceTest
      1.16 %     9.67 s   Testing/Code/Algorithms/itkCurvatureFlowTestTcl
      0.94 %     7.90 s   Testing/Code/Algorithms/itkDeformableTest
      0.88 %     7.39 s   Testing/Code/Algorithms/itkMeanSquaresImageMetricTest