VTK/SoftwareQuality/NightlyExpectedBuildTestFailures: Difference between revisions
(24 intermediate revisions by 3 users not shown) | |||
Line 23: | Line 23: | ||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-23|2013-02-23]] | [[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-23|2013-02-23]] | ||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-26|2013-02-26]] | |||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-02-27|2013-02-27]] | |||
[[VTK/SoftwareQuality/NightlyBuildSummary-2013-03-02|2013-03-02]] | |||
==Analyze== | ==Analyze== | ||
Line 29: | Line 35: | ||
| Test | | Test | ||
| Failing | | Failing | ||
| | | Defect | ||
| Assigned | | Assigned To | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersParallelStatisticsCxx-MPI-TestRandomPMomentStatisticsMPI vtkFiltersParallelStatisticsCxx-MPI-TestRandomPMomentStatisticsMPI] | ||
| 1 | | 1 | ||
| | | Memory Leak | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-volTM3DCropRegions vtkRenderingVolumePython-volTM3DCropRegions] | ||
| 1 | | 1 | ||
| | | Failing since [http://open.cdash.org/index.php?project=VTK&date=20130204 Feb 4] | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeometryCxx-TestImageDataToUniformGrid vtkFiltersGeometryCxx-TestImageDataToUniformGrid] | ||
| 1 | | 1 | ||
| | | AIX only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestContourWidget2 vtkInteractionWidgetsCxx-TestContourWidget2] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178390042&build=2823952 Regression defect, small] | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestGlyph3DMapperOrientationArray vtkRenderingOpenGLCxx-TestGlyph3DMapperOrientationArray] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178422932&build=2824162 Regression defect] AIX only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkParallelMPIPython-TestPProbe vtkParallelMPIPython-TestPProbe] | ||
| 1 | | 1 | ||
| | | Python syntax | ||
| Unassigned | | Unassigned [http://review.source.kitware.com/#/t/2111/ Existing gerrit topic] | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterNearestCropped vtkRenderingVolumePython-TestFixedPointRayCasterNearestCropped] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178384129&build=2823951 Regression defect] | ||
| | AIX exit | ||
| Bill | |||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingParallelCxx-MPI-TestClientServerRendering vtkRenderingParallelCxx-MPI-TestClientServerRendering] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178354074&build=2823558 Failed to connect] | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaDeleteRegression JavaDeleteRegression] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 87: | Line 94: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInfovisLayoutCxx-TestCirclePackLayoutStrategy vtkInfovisLayoutCxx-TestCirclePackLayoutStrategy] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178377163&build=2823849 Regression defect, major] | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaDeleteAndGC JavaDeleteAndGC] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 99: | Line 106: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleTrackballCamera vtkInteractionStylePython-TestStyleTrackballCamera] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178422784&build=2824162 Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTextureRGBADepthPeeling vtkRenderingOpenGLCxx-TestTextureRGBADepthPeeling] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testDetails.php?test=178390201&build=2823952 Regression defect] Intermittent | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestPickingManagerWidgets vtkInteractionWidgetsCxx-TestPickingManagerWidgets] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestPickingManagerWidgets Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterLinearCropped vtkRenderingVolumePython-TestFixedPointRayCasterLinearCropped] | ||
| 1 | | 1 | ||
| | | Threading issues | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTextActor3DAlphaBlending vtkRenderingOpenGLCxx-TestTextActor3DAlphaBlending] | ||
| 1 | | 1 | ||
| | | DASH23 X server issue. | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeCxx-TestHAVSVolumeMapper vtkRenderingVolumeCxx-TestHAVSVolumeMapper] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 135: | Line 142: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestGlyph3DMapperMasking vtkRenderingOpenGLCxx-TestGlyph3DMapperMasking] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 141: | Line 148: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestImplicitPlaneWidget2b vtkInteractionWidgetsCxx-TestImplicitPlaneWidget2b] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 147: | Line 154: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIONetCDFCxx-SLACMultipleModes vtkIONetCDFCxx-SLACMultipleModes] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 153: | Line 160: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersProgrammablePython-progGlyphsBySource vtkFiltersProgrammablePython-progGlyphsBySource] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 159: | Line 166: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTexturedBackground vtkRenderingOpenGLCxx-TestTexturedBackground] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 165: | Line 172: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaManualGC JavaManualGC] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 171: | Line 178: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickCamera vtkInteractionStylePython-TestStyleJoystickCamera] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickCamera Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCorePython-TestLinePlotColors vtkChartsCorePython-TestLinePlotColors] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 183: | Line 190: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeTcl-volTM3DCompressedCropRegions vtkRenderingVolumeTcl-volTM3DCompressedCropRegions] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 189: | Line 196: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-volTM3DCompressedCropRegions vtkRenderingVolumePython-volTM3DCompressedCropRegions] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 195: | Line 202: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOGeometryCxx-TestWindBladeReader vtkIOGeometryCxx-TestWindBladeReader] | ||
| 1 | | 1 | ||
| | | Bigendian defect | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestOpacity vtkRenderingOpenGLCxx-TestOpacity] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 207: | Line 214: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeneralCxx-TestGradientAndVorticity vtkFiltersGeneralCxx-TestGradientAndVorticity] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 213: | Line 220: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterNearest vtkRenderingVolumePython-TestFixedPointRayCasterNearest] | ||
| 1 | | 1 | ||
| | | Threading | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkImagingCorePython-TestCheckerboard vtkImagingCorePython-TestCheckerboard] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 225: | Line 232: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOExportCxx-TestGL2PSExporterRaster-VerifyRasterizedPNG vtkIOExportCxx-TestGL2PSExporterRaster-VerifyRasterizedPNG] | ||
| 1 | | 1 | ||
| | | CubeAxesActor error, used wrong buffer in GL2PS rasterization | ||
| | | David L. -- Baselines updated, [http://review.source.kitware.com/#/t/2242/ Gerrit] patch pushed | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeometryCxx-TestStructuredGridConnectivity vtkFiltersGeometryCxx-TestStructuredGridConnectivity] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 237: | Line 244: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsPython-TestInteractorEventRecorder vtkInteractionWidgetsPython-TestInteractorEventRecorder] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 243: | Line 250: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-TestFixedPointRayCasterLinear vtkRenderingVolumePython-TestFixedPointRayCasterLinear] | ||
| 1 | | 1 | ||
| | | Threading | ||
| | | | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleTrackballActor vtkInteractionStylePython-TestStyleTrackballActor] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleTrackballActor Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionWidgetsCxx-TestTextWidget vtkInteractionWidgetsCxx-TestTextWidget] | ||
| 1 | | 1 | ||
| | | DASH23 X server issue | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaGCRegression JavaGCRegression] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 267: | Line 274: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingParallelCxx-MPI-TestParallelRendering vtkRenderingParallelCxx-MPI-TestParallelRendering] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 273: | Line 280: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeneralCxx-TestIntersectionPolyDataFilter2 vtkFiltersGeneralCxx-TestIntersectionPolyDataFilter2] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 279: | Line 286: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickActor vtkInteractionStylePython-TestStyleJoystickActor] | ||
| 1 | | 1 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkInteractionStylePython-TestStyleJoystickActor Regression defect] AIX and OSMesa only | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=JavaRegression JavaRegression] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 291: | Line 298: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCoreCxx-TestScatterPlotMatrix vtkChartsCoreCxx-TestScatterPlotMatrix] | ||
| 1 | | 1 | ||
| Unknown | | Unknown | ||
Line 297: | Line 304: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometryMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometryMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 303: | Line 310: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingCorePython-TestOpacity2 vtkRenderingCorePython-TestOpacity2] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 309: | Line 316: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeCxx-TestProjectedHexahedra vtkRenderingVolumeCxx-TestProjectedHexahedra] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 315: | Line 322: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersSelectionCxx-TestLinearSelector3D vtkFiltersSelectionCxx-TestLinearSelector3D] | ||
| 2 | | 2 | ||
| | | incorrect cardinality | ||
| | | Dave Demarle | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHybridTcl-3DMorph vtkFiltersHybridTcl-3DMorph] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 327: | Line 334: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCut vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCut] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 333: | Line 340: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructured vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructured] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 339: | Line 346: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DClip vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DClip] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 345: | Line 352: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumePython-volTM2DRotateClip vtkRenderingVolumePython-volTM2DRotateClip] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 351: | Line 358: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernarySphereMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernarySphereMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 357: | Line 364: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestGaussianBlurPass vtkRenderingOpenGLCxx-TestGaussianBlurPass] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 363: | Line 370: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometry vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometry] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 369: | Line 376: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContourMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContourMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 375: | Line 382: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructuredMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructuredMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
| | | | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersGeneralCxx-TestDensifyPolyData vtkFiltersGeneralCxx-TestDensifyPolyData] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 387: | Line 394: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingCoreTcl-TestOpacity2 vtkRenderingCoreTcl-TestOpacity2] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 393: | Line 400: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOMPIParallelCxx-TestPWindBladeReader vtkIOMPIParallelCxx-TestPWindBladeReader] | ||
| 2 | | 2 | ||
| | | Bigendian defect | ||
| Unassigned | | Unassigned | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkGUISupportQtCxx-TestQtDebugLeaksView vtkGUISupportQtCxx-TestQtDebugLeaksView] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 405: | Line 412: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DCut vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DCut] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 411: | Line 418: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTranslucentLUTTextureDepthPeeling vtkRenderingOpenGLCxx-TestTranslucentLUTTextureDepthPeeling] | ||
| 2 | | 2 | ||
| | | Disabled for ATI's | ||
| | | Sean | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCutMaterial vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCutMaterial] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 423: | Line 430: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHybridPython-3DMorph vtkFiltersHybridPython-3DMorph] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 429: | Line 436: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingCoreTcl-CamBlur vtkRenderingCoreTcl-CamBlur] | ||
| 2 | | 2 | ||
| | | Started failing after tcl changes | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingVolumeTcl-TestFixedPointRayCasterLinearCropped vtkRenderingVolumeTcl-TestFixedPointRayCasterLinearCropped] | ||
| 2 | | 2 | ||
| | | Threading | ||
| | | Bill | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeelingPass vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeelingPass] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 447: | Line 454: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersFlowPathsCxx-TestBSPTree vtkFiltersFlowPathsCxx-TestBSPTree] | ||
| 2 | | 2 | ||
| Unknown | | Unknown | ||
Line 453: | Line 460: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeeling vtkRenderingOpenGLCxx-TestTranslucentLUTDepthPeeling] | ||
| 3 | | 3 | ||
| Unknown | | Unknown | ||
Line 459: | Line 466: | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCoreCxx-TestLinePlot3D vtkChartsCoreCxx-TestLinePlot3D] | ||
| 3 | | 3 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkChartsCoreCxx-TestLinePlot3D Regression defects] | ||
| | | Marcus [http://review.source.kitware.com/#/t/2230/ Gerrit topic] | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG] | ||
| 3 | | 3 | ||
| | | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG Regression defects] that differ in various machines | ||
| | volume rendering | ||
| Dave L. [http://review.source.kitware.com/#/t/2242/ Gerrit] | |||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContour vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContour] | ||
| 4 | | 4 | ||
| Unknown | | Unknown | ||
| | | Berk | ||
|- | |- | ||
| | | | ||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02- | [http://open.cdash.org/testSummary.php?project=11&date=2013-02-27&name=vtkCommonCoreTcl-TestSetGet vtkCommonCoreTcl-TestSetGet] | ||
| 5 | | 5 | ||
| | | Timeout | ||
| Unassigned | | Unassigned | ||
|} | |||
==Improve== | ==Improve== | ||
The following Gerrit reviews addressed the defects. | The following Gerrit reviews addressed the defects. | ||
{| class="wikitable sortable" border="1" cellpadding="5" cellspacing="0" | |||
|- | |||
| Test | |||
| Gerrit patch | |||
| Summary | |||
|- | |||
| | |||
[http://open.cdash.org/testSummary.php?project=11&date=2013-02-23&name=vtkCommonCoreTcl-TestSetGet vtkCommonCoreTcl-TestSetGet] | |||
| [http://review.source.kitware.com/#/t/2197/ ENH: Reduce the output of TestSetGet.tcl] | |||
| TestSetGet.tcl produces over 6 meg of output. This patch reduces that to 50k. | |||
|} | |||
==Control== | ==Control== | ||
Once reduced to 0, developer diligence is needed to keep the defects to 0. | Once reduced to 0, developer diligence is needed to keep the defects to 0. |
Latest revision as of 16:37, 2 March 2013
The VTK Nightly Expected builds show the status of VTK on VTK supported platforms at a fixed time each day. Although the Gerrit Review Process and Continuous Builds attempt to catch build defects early, it is the Nightly Expected builds that show the health of VTK on a broader collection of systems. Recurring nightly failures make it difficult for a developer to see if her changes have affected the spectrum of platforms.
This experiment uses the DMAIC methodology of the Six Sigma management process to "Define", "Measure", "Analyze", "Improve" and "Control" to resolve these issues.
The basic methodology (from Wikipedia) consists of the following five steps:
- Define process goals that are consistent with customer demands and VTK's strategy.
- Measure key aspects of the current process and collect relevant data.
- Analyze the data to verify cause-and-effect relationships. Determine what the relationships are, and attempt to ensure that all factors have been considered.
- Improve or optimize the process.
- Control to ensure that any deviations from target are corrected before they result in defects. Set up pilot runs to establish software quality, move on to production, set up control mechanisms and continuously monitor the process.
Define
Keep the number of VTK Nightly Expected recurring test failures(defects) to 0. When the defects are above 0, developers find it difficult to notice that their changes introduce new defects.
Measure
Recent summaries:
Analyze
Test | Failing | Defect | Assigned To |
vtkFiltersParallelStatisticsCxx-MPI-TestRandomPMomentStatisticsMPI |
1 | Memory Leak | Unassigned |
1 | Failing since Feb 4 | Unassigned | |
1 | AIX only | Unassigned | |
1 | Regression defect, small | Unassigned | |
1 | Regression defect AIX only | Unassigned | |
1 | Python syntax | Unassigned Existing gerrit topic | |
vtkRenderingVolumePython-TestFixedPointRayCasterNearestCropped |
1 | Regression defect
AIX exit |
Bill |
1 | Failed to connect | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect, major | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | Regression defect Intermittent | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
vtkRenderingVolumePython-TestFixedPointRayCasterLinearCropped |
1 | Threading issues | Bill |
1 | DASH23 X server issue. | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Bigendian defect | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Threading | Bill | |
1 | Unknown | Unassigned | |
1 | CubeAxesActor error, used wrong buffer in GL2PS rasterization | David L. -- Baselines updated, Gerrit patch pushed | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Threading | ||
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | DASH23 X server issue | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
1 | Regression defect AIX and OSMesa only | Unassigned | |
1 | Unknown | Unassigned | |
1 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DGeometryMaterial |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
2 | incorrect cardinality | Dave Demarle | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructured |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernarySphereMaterial |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DContourMaterial |
2 | Unknown | Unassigned |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DUnstructuredMaterial |
2 | Unknown | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
2 | Bigendian defect | Unassigned | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
2 | Disabled for ATI's | Sean | |
vtkFiltersHyperTreeCxx-TestHyperTreeGridTernary3DAxisCutMaterial |
2 | Unknown | Unassigned |
2 | Unknown | Unassigned | |
2 | Started failing after tcl changes | Bill | |
2 | Threading | Bill | |
2 | Unknown | Unassigned | |
2 | Unknown | Unassigned | |
3 | Unknown | Unassigned | |
3 | Regression defects | Marcus Gerrit topic | |
vtkIOExportCxx-TestGL2PSExporterVolumeRaster-VerifyRasterizedPNG |
3 | Regression defects that differ in various machines
volume rendering |
Dave L. Gerrit |
4 | Unknown | Berk | |
5 | Timeout | Unassigned |
Improve
The following Gerrit reviews addressed the defects.
Test | Gerrit patch | Summary |
ENH: Reduce the output of TestSetGet.tcl | TestSetGet.tcl produces over 6 meg of output. This patch reduces that to 50k. |
Control
Once reduced to 0, developer diligence is needed to keep the defects to 0.