VTK/SoftwareQuality/NightlyExpectedBuildTestFailures: Difference between revisions
(17 intermediate revisions by 3 users not shown) | |||
Line 23: | Line 23: | ||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-23|2013-02-23]] | [[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-23|2013-02-23]] | ||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-26|2013-02-26]] | |||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-27|2013-02-27]] | |||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-03-02|2013-03-02]] | |||
==Analyze== | ==Analyze== | ||
Line 33: | Line 39: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersParallelStatisticsCxx-MPI-TestRandomPMomentStatisticsMPI vtkFiltersParallelStatisticsCxx-MPI-TestRandomPMomentStatisticsMPI] | ||
| 1 | | 1 | ||
| Memory Leak | | Memory Leak | ||
Line 39: | Line 45: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-volTM3DCropRegions vtkRenderingVolumePython-volTM3DCropRegions] | ||
| 1 | | 1 | ||
| Failing since [http://open.cdash.org/index.php?project=VTK&date=20130204 Feb 4] | | Failing since [http://open.cdash.org/index.php?project=VTK&date=20130204 Feb 4] | ||
Line 45: | Line 51: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeometryCxx-TestImageDataToUniformGrid vtkFiltersGeometryCxx-TestImageDataToUniformGrid] | ||
| 1 | | 1 | ||
| AIX only | | AIX only | ||
Line 51: | Line 57: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestContourWidget2 vtkInteractionWidgetsCxx-TestContourWidget2] | ||
| 1 | | 1 | ||
| [http://open.cdash.org/testDetails.php?test=178390042&build=2823952 Regression defect, small] | | [http://open.cdash.org/testDetails.php?test=178390042&build=2823952 Regression defect, small] | ||
Line 57: | Line 63: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestGlyph3DMapperOrientationArray vtkRenderingOpenGLCxx-TestGlyph3DMapperOrientationArray] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178422932&build=2824162 Regression defect] AIX only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkParallelMPIPython-TestPProbe vtkParallelMPIPython-TestPProbe] | ||
| 1 | | 1 | ||
| Python syntax | | Python syntax | ||
Line 69: | Line 75: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterNearestCropped vtkRenderingVolumePython-TestFixedPointRayCasterNearestCropped] | ||
| 1 | | 1 | ||
| [http://open.cdash.org/testDetails.php?test=178384129&build=2823951 Regression defect] | | [http://open.cdash.org/testDetails.php?test=178384129&build=2823951 Regression defect] | ||
AIX exit | AIX exit | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingParallelCxx-MPI-TestClientServerRendering vtkRenderingParallelCxx-MPI-TestClientServerRendering] | ||
| 1 | | 1 | ||
| [http://open.cdash.org/testDetails.php?test=178354074&build=2823558 Failed to connect] | | [http://open.cdash.org/testDetails.php?test=178354074&build=2823558 Failed to connect] | ||
Line 82: | Line 88: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaDeleteRegression JavaDeleteRegression] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 88: | Line 94: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInfovisLayoutCxx-TestCirclePackLayoutStrategy vtkInfovisLayoutCxx-TestCirclePackLayoutStrategy] | ||
| 1 | | 1 | ||
| [http://open.cdash.org/testDetails.php?test=178377163&build=2823849 Regression defect, major] | | [http://open.cdash.org/testDetails.php?test=178377163&build=2823849 Regression defect, major] | ||
Line 94: | Line 100: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaDeleteAndGC JavaDeleteAndGC] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 100: | Line 106: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleTrackballCamera vtkInteractionStylePython-TestStyleTrackballCamera] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178422784&build=2824162 Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTextureRGBADepthPeeling vtkRenderingOpenGLCxx-TestTextureRGBADepthPeeling] | ||
| 1 | | 1 | ||
| [http://open.cdash.org/testDetails.php?test=178390201&build=2823952 Regression defect | | [http://open.cdash.org/testDetails.php?test=178390201&build=2823952 Regression defect] Intermittent | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestPickingManagerWidgets vtkInteractionWidgetsCxx-TestPickingManagerWidgets] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestPickingManagerWidgets Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterLinearCropped vtkRenderingVolumePython-TestFixedPointRayCasterLinearCropped] | ||
| 1 | | 1 | ||
| | | Threading issues | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTextActor3DAlphaBlending vtkRenderingOpenGLCxx-TestTextActor3DAlphaBlending] | ||
| 1 | | 1 | ||
| | | DASH23 X server issue. | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeCxx-TestHAVSVolumeMapper vtkRenderingVolumeCxx-TestHAVSVolumeMapper] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 136: | Line 142: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestGlyph3DMapperMasking vtkRenderingOpenGLCxx-TestGlyph3DMapperMasking] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 142: | Line 148: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestImplicitPlaneWidget2b vtkInteractionWidgetsCxx-TestImplicitPlaneWidget2b] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 148: | Line 154: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIONetCDFCxx-SLACMultipleModes vtkIONetCDFCxx-SLACMultipleModes] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 154: | Line 160: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersProgrammablePython-progGlyphsBySource vtkFiltersProgrammablePython-progGlyphsBySource] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 160: | Line 166: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTexturedBackground vtkRenderingOpenGLCxx-TestTexturedBackground] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 166: | Line 172: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaManualGC JavaManualGC] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 172: | Line 178: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickCamera vtkInteractionStylePython-TestStyleJoystickCamera] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickCamera Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCorePython-TestLinePlotColors vtkChartsCorePython-TestLinePlotColors] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 184: | Line 190: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeTcl-volTM3DCompressedCropRegions vtkRenderingVolumeTcl-volTM3DCompressedCropRegions] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 190: | Line 196: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-volTM3DCompressedCropRegions vtkRenderingVolumePython-volTM3DCompressedCropRegions] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 196: | Line 202: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOGeometryCxx-TestWindBladeReader vtkIOGeometryCxx-TestWindBladeReader] | ||
| 1 | | 1 | ||
| | | Bigendian defect | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestOpacity vtkRenderingOpenGLCxx-TestOpacity] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 208: | Line 214: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeneralCxx-TestGradientAndVorticity vtkFiltersGeneralCxx-TestGradientAndVorticity] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 214: | Line 220: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterNearest vtkRenderingVolumePython-TestFixedPointRayCasterNearest] | ||
| 1 | | 1 | ||
| | | Threading | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkImagingCorePython-TestCheckerboard vtkImagingCorePython-TestCheckerboard] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 226: | Line 232: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOExportCxx-TestGL2PSExporterRaster-VerifyRasterizedPNG vtkIOExportCxx-TestGL2PSExporterRaster-VerifyRasterizedPNG] | ||
| 1 | | 1 | ||
| | | CubeAxesActor error, used wrong buffer in GL2PS rasterization | ||
| | | David L. -- Baselines updated, [http://review.source.kitware.com/#/t/2242/ Gerrit] patch pushed | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeometryCxx-TestStructuredGridConnectivity vtkFiltersGeometryCxx-TestStructuredGridConnectivity] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 238: | Line 244: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsPython-TestInteractorEventRecorder vtkInteractionWidgetsPython-TestInteractorEventRecorder] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 244: | Line 250: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterLinear vtkRenderingVolumePython-TestFixedPointRayCasterLinear] | ||
| 1 | | 1 | ||
| | | Threading | ||
| | | | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleTrackballActor vtkInteractionStylePython-TestStyleTrackballActor] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleTrackballActor Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestTextWidget vtkInteractionWidgetsCxx-TestTextWidget] | ||
| 1 | | 1 | ||
| | | DASH23 X server issue | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaGCRegression JavaGCRegression] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 268: | Line 274: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingParallelCxx-MPI-TestParallelRendering vtkRenderingParallelCxx-MPI-TestParallelRendering] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 274: | Line 280: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeneralCxx-TestIntersectionPolyDataFilter2 vtkFiltersGeneralCxx-TestIntersectionPolyDataFilter2] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 280: | Line 286: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickActor vtkInteractionStylePython-TestStyleJoystickActor] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickActor Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaRegression JavaRegression] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 292: | Line 298: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCoreCxx-TestScatterPlotMatrix vtkChartsCoreCxx-TestScatterPlotMatrix] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 298: | Line 304: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometryMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometryMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 304: | Line 310: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingCorePython-TestOpacity2 vtkRenderingCorePython-TestOpacity2] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 310: | Line 316: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeCxx-TestProjectedHexahedra vtkRenderingVolumeCxx-TestProjectedHexahedra] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 316: | Line 322: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersSelectionCxx-TestLinearSelector3D vtkFiltersSelectionCxx-TestLinearSelector3D] | ||
| 2 | | 2 | ||
| | | incorrect cardinality | ||
| | | Dave Demarle | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHybridTcl-3DMorph vtkFiltersHybridTcl-3DMorph] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 328: | Line 334: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCut vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCut] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 334: | Line 340: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructured vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructured] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 340: | Line 346: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DClip vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DClip] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 346: | Line 352: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-volTM2DRotateClip vtkRenderingVolumePython-volTM2DRotateClip] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 352: | Line 358: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernarySphereMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernarySphereMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 358: | Line 364: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestGaussianBlurPass vtkRenderingOpenGLCxx-TestGaussianBlurPass] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 364: | Line 370: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometry vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometry] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 370: | Line 376: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContourMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContourMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 376: | Line 382: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructuredMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructuredMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
| | | | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeneralCxx-TestDensifyPolyData vtkFiltersGeneralCxx-TestDensifyPolyData] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 388: | Line 394: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingCoreTcl-TestOpacity2 vtkRenderingCoreTcl-TestOpacity2] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 394: | Line 400: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOMPIParallelCxx-TestPWindBladeReader vtkIOMPIParallelCxx-TestPWindBladeReader] | ||
| 2 | | 2 | ||
| | | Bigendian defect | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkGUISupportQtCxx-TestQtDebugLeaksView vtkGUISupportQtCxx-TestQtDebugLeaksView] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 406: | Line 412: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DCut vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DCut] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 412: | Line 418: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTranslucentLUTTextureDepthPeeling vtkRenderingOpenGLCxx-TestTranslucentLUTTextureDepthPeeling] | ||
| 2 | | 2 | ||
| | | Disabled for ATI's | ||
| | | Sean | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCutMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCutMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 424: | Line 430: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHybridPython-3DMorph vtkFiltersHybridPython-3DMorph] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 430: | Line 436: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingCoreTcl-CamBlur vtkRenderingCoreTcl-CamBlur] | ||
| 2 | | 2 | ||
| | | Started failing after tcl changes | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeTcl-TestFixedPointRayCasterLinearCropped vtkRenderingVolumeTcl-TestFixedPointRayCasterLinearCropped] | ||
| 2 | | 2 | ||
| | | Threading | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeelingPass vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeelingPass] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 448: | Line 454: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersFlowPathsCxx-TestBSPTree vtkFiltersFlowPathsCxx-TestBSPTree] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 454: | Line 460: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeeling vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeeling] | ||
| 3 | | 3 | ||
| Unknown | | Unknown | ||
Line 460: | Line 466: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCoreCxx-TestLinePlot3D vtkChartsCoreCxx-TestLinePlot3D] | ||
| 3 | | 3 | ||
| [http://open.cdash.org/testSummary.php?project=11&date=2013-02- | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCoreCxx-TestLinePlot3D Regression defects] | ||
| | | Marcus [http://review.source.kitware.com/#/t/2230/ Gerrit topic] | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG] | ||
| 3 | | 3 | ||
| [http://open.cdash.org/testSummary.php?project=11&date=2013-02- | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG Regression defects] that differ in various machines | ||
| | volume rendering | ||
| Dave L. [http://review.source.kitware.com/#/t/2242/ Gerrit] | |||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContour vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContour] | ||
| 4 | | 4 | ||
| Unknown | | Unknown | ||
| | | Berk | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkCommonCoreTcl-TestSetGet vtkCommonCoreTcl-TestSetGet] | ||
| 5 | | 5 | ||
| Timeout | | Timeout | ||
Line 486: | Line 493: | ||
==Improve== | ==Improve== | ||
The following Gerrit reviews addressed the defects. | The following Gerrit reviews addressed the defects. | ||
{| class="wikitable sortable" border="1" cellpadding="5" cellspacing="0" | |||
|- | |||
| Test | |||
| Gerrit patch | |||
| Summary | |||
|- | |||
| | |||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02-23&name=vtkCommonCoreTcl-TestSetGet vtkCommonCoreTcl-TestSetGet] | |||
| [http://review.source.kitware.com/#/t/2197/ ENH: Reduce the output of TestSetGet.tcl] | |||
| TestSetGet.tcl produces over 6 meg of output. This patch reduces that to 50k. | |||
|} | |||
==Control== | ==Control== | ||
Once reduced to 0, developer diligence is needed to keep the defects to 0. | Once reduced to 0, developer diligence is needed to keep the defects to 0. |
Latest revision as of 16:37, 2 March 2013
The VTK Nightly Expected builds show the status of VTK on VTK supported platforms at a fixed time each day. Although the Gerrit Review Process and Continuous Builds attempt to catch build defects early, it is the Nightly Expected builds that show the health of VTK on a broader collection of systems. Recurring nightly failures make it difficult for a developer to see if her changes have affected the spectrum of platforms.
This experiment uses the DMAIC methodology of the Six Sigma management process to "Define", "Measure", "Analyze", "Improve" and "Control" to resolve these issues.
The basic methodology (from Wikipedia) consists of the following five steps:
- Define process goals that are consistent with customer demands and VTK's strategy.
- Measure key aspects of the current process and collect relevant data.
- Analyze the data to verify cause-and-effect relationships. Determine what the relationships are, and attempt to ensure that all factors have been considered.
- Improve or optimize the process.
- Control to ensure that any deviations from target are corrected before they result in defects. Set up pilot runs to establish software quality, move on to production, set up control mechanisms and continuously monitor the process.
Define
Keep the number of VTK Nightly Expected recurring test failures(defects) to 0. When the defects are above 0, developers find it difficult to notice that their changes introduce new defects.
Measure
Recent summaries:
Analyze
Test | Failing | Defect | Assigned To |
vtkFiltersParallelStatisticsCxx-MPI-TestRandomPMomentStatisticsMPI |
1 | Memory Leak | Unassigned |
1 | Failing since Feb 4 | Unassigned | |
1 | AIX only | Unassigned | |
1 | Regression defect, small | Unassigned | |
1 | Regression defect AIX only | Unassigned | |
1 | Python syntax | Unassigned Existing gerrit topic | |
vtkRenderingVolumePython-TestFixedPointRayCasterNearestCropped |
1 | Regression defect
AIX exit |
Bill |
1 | Failed to connect | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect, major | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | Regression defect Intermittent | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
vtkRenderingVolumePython-TestFixedPointRayCasterLinearCropped |
1 | Threading issues | Bill |
1 | DASH23 X server issue. | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Bigendian defect | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Threading | Bill | |
1 | Unknown | Unassigned | |
1 | CubeAxesActor error, used wrong buffer in GL2PS rasterization | David L. -- Baselines updated, Gerrit patch pushed | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Threading | ||
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | DASH23 X server issue | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometryMaterial |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
2 | incorrect cardinality | Dave Demarle | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructured |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernarySphereMaterial |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContourMaterial |
2 | Unknown | Unassigned |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructuredMaterial |
2 | Unknown | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
2 | Bigendian defect | Unassigned | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
2 | Disabled for ATI's | Sean | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCutMaterial |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Started failing after tcl changes | Bill | |
2 | Threading | Bill | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
3 | Unknown | Unassigned | |
3 | Regression defects | Marcus Gerrit topic | |
vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG |
3 | Regression defects that differ in various machines
volume rendering |
Dave L. Gerrit |
4 | Unknown | Berk | |
5 | Timeout | Unassigned |
Improve
The following Gerrit reviews addressed the defects.
Test | Gerrit patch | Summary |
ENH: Reduce the output of TestSetGet.tcl | TestSetGet.tcl produces over 6 meg of output. This patch reduces that to 50k. |
Control
Once reduced to 0, developer diligence is needed to keep the defects to 0.