[IGSTK-Developers] Regression tests problem

[Patrick Cheng]

Hi Luis,

I found some problems with the regression tests.

First, when the testing image is different from baseline image, the 
comparison program will generate a "Debug Assertion Failed" error 
(Crash3.png) under debug mode (When click on 'Abort' the test will show 
as 'Failed') and "Visual Studio Just-In-Time Debugger" (Crash4.png) 
under release mode (when click on 'No' the test will show as 'Passed'), 
which both cause the testing program to halt. But when the image matches 
with baseline, everything is fine. I am not sure where is the problem 
coming from, but this definitely has to be fixed to really see the 
testing result.

Second, the screen capture is unreliable especially when the test has 
some dynamic contents. For instance if I keep running these two tests 
the results will vary depending on the timing

C:\Patrick\Research\IGSTK\VS80Debug>ctest -C debug -R VisibilityTest
Start processing tests
Test project C:/Patrick/Research/IGSTK/VS80Debug
  64/ 79 Testing igstkSpatialObjectRepresentati***Failed
  65/ 79 Testing igstkSpatialObjectRepresentati***Failed

C:\Patrick\Research\IGSTK\VS80Debug>ctest -C debug -R VisibilityTest
Start processing tests
Test project C:/Patrick/Research/IGSTK/VS80Debug
  64/ 79 Testing igstkSpatialObjectRepresentati   Passed
  65/ 79 Testing igstkSpatialObjectRepresentati   Passed


Please take a look into this issue.

Thank you,

Patrick
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Crash3.PNG
Type: image/png
Size: 14950 bytes
Desc: not available
URL: <http://public.kitware.com/pipermail/igstk-developers/attachments/20070823/b51aec1a/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Crash4.PNG
Type: image/png
Size: 17380 bytes
Desc: not available
URL: <http://public.kitware.com/pipermail/igstk-developers/attachments/20070823/b51aec1a/attachment-0001.png>