[Insight-users] Microsoft & Reproducibility

[Luis Ibanez]

Microsoft if giving good example on how to report technical results,
by requiring users to disclose of all the information needed to reproduce
the results that they are reporting.



Extract from the Visual Studio 2008 End User License Agreement:


<quote>
8.    MICROSOFT .NET FRAMEWORK BENCHMARK TESTING.

The software includes the .NET Framework component of the Windows operating
systems (".NET Component").

You may conduct internal benchmark testing of the .NET Component.

You may disclose the results of any benchmark test of the .NET Component,
provided that you comply with the following terms:


   1. *You must disclose all the information necessary for replication of
   the tests*, including complete and accurate details of your benchmark
   testing methodology,  the test scripts/cases, *tuning parameters applied*,
   *hardware and software platforms* tested, the name and version number of
   any third party testing tool used to conduct the testing, and *complete
   source code for the benchmark suite/harness* that is developed by or for
   you and used to test both the .NET Component and the competing
   implementation(s);

   2. You must disclose the date (s) that you conducted the benchmark tests,
   along with specific version information for all Microsoft software products
   tested, including the .NET Component;

   3. Your benchmark testing was performed using all performance tuning and
   best practice guidance set forth in the product documentation and/or on
   Microsoft's support web sites, and uses the latest updates, patches and
   fixes available for the .NET Component and the relevant Microsoft operating
   system;

   4. It shall be sufficient if you make the disclosures provided for above
   at a publicly available location such as a website, so long as every public
   disclosure of the results of your benchmark test expressly identifies the
   public site containing all required disclosures; and

   5. Nothing in this provision shall be deemed to waive any other right
   that you may have to conduct benchmark testing.  The foregoing obligations
   shall not apply to your disclosure of the results of any customized
   benchmark test of the .NET Component, whereby such disclosure is made under
   confidentiality in conjunction with a bid request by a prospective customer,
   such customer's application(s) are specifically tested and the results are
   only disclosed to such specific customer.  Notwithstanding any other
   agreement you may have with Microsoft, if you disclose such benchmark test
   results, Microsoft shall have the right to disclose the results of benchmark
   tests it conducts of your products that compete with the .NET Component,
   provided it complies with the same conditions above.

</quote>

-------


One practice in which we can fully agree with a Microsoft,


      Luis
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.itk.org/pipermail/insight-users/attachments/20080521/0ff78805/attachment.htm>