[Insight-users] Multimodality Image Fusion.

Dan Mueller dan.muel at gmail.com
Mon Oct 15 15:59:30 EDT 2012


Hi Ashwath,

Thank you for further explaining your objective -- this makes it
easier for the mailing list to offer you advice.

The steps you suggest seem correct. The only advice I may offer is
that with the ITK registration framework, registration and resampling
are one and the same step (i.e. the output of the registration process
is a resampled moving image):
1. Registration and resampling
2. Image fusion
3. Fused image display

You are correct that ITK can perform 1 and 2, and VTK (plus a chosen
GUI framework, like QT) can perform 3.

For step one, please read the ITK Software Guide (chapter 8, pages 315-501):
    http://www.itk.org/ItkSoftwareGuide.pdf

Also, you can find many relevant registration examples with the ITK
source code or on the wiki:
    http://www.itk.org/Wiki/ITK/Examples/Included/Registration

For step two, you have many options. The following links may help:
    http://www.imagefusion.org/
    http://www.imagefusion.org/publications/reports/piella-TR-PNA-R0211.pdf
    http://www.insight-journal.org/browse/publication/103

For step three, you can find some examples here:
    http://public.kitware.com/cgi-bin/viewcvs.cgi/Examples/GUI/Qt/
    http://www.thihaoo.com/eng/?p=45

Hope this helps.

Regards, Dan

On 15 October 2012 20:17, Ashwath Hegde, ERS-HCLTech <Ashwathh at hcl.com> wrote:
> Hi Dan,
>
> Thanks for your reply.
> I am very new to image fusion understanding.
> I will let you know briefly what my objective is:
> I have a CT and MRI image of the same organ.
> I want to fuse them and produce a new image which can show the soft tissues of MRI scan as well as bones structure of CT scan.
> I am not aware of different methods of fusion.Please let me know different methods of image fusion if  you are aware.
> I read in a article in internet that following are the steps for image fusion:
>
> 1.)Image registration
> 2.)Image resampling
> 3.)Image fusion by pixel averaging
> 4.)Fused image display
>
> Did I miss something. please let me know.
>
> I believe that first 3 steps I can do in ITK and 4th step in VTK.
> Am I  right about this.Please let me know.
>
> Regards,
> Ashwath
>
> -----Original Message-----
> From: Dan Mueller [mailto:dan.muel at gmail.com]
> Sent: Saturday, October 13, 2012 3:20 AM
> To: Ashwath Hegde, ERS-HCLTech
> Cc: Insight Users
> Subject: Re: [Insight-users] Multimodality Image Fusion.
>
> Hi Ashwath,
>
> (I have re-added the ITK mailing list to cc as this is good practice.)
>
> I guess it depends on what you mean by "fusion". Can you please explain exactly what you mean by this term?
>
> The Insight Journal article I pointed you to is 100% ITK. As the article explains, it implements multi-resolution fusion of multi-modal images.
>
> Perhaps you interested in overlay fusion methods, such as those in the VV fusion viewer:
>     http://www.midasjournal.org/browse/publication/617
>
> VV fusion viewer is a ITK + VTK + QT application which you may give some ideas on how to get started building your own app.
>
> Hope this helps.
>
> Regards, Dan
>
> On 12 October 2012 20:17, Ashwath Hegde, ERS-HCLTech <Ashwathh at hcl.com> wrote:
>> Hi Dan,
>>
>> Thanks for your suggestion.But I want to develop a Multimodality Image Fusion application using ITK,VTK and QT only.
>> Could you please give me the steps for image fusion.
>> It would be a great help to me.
>>
>> Thanking you in advance,
>> Ashwath.
>>
>> -----Original Message-----
>> From: insight-users-bounces at itk.org
>> [mailto:insight-users-bounces at itk.org] On Behalf Of Dan Mueller
>> Sent: Friday, October 12, 2012 11:56 AM
>> To: Ashwath Hegde, ERS-HCLTech
>> Cc: insight-users at itk.org
>> Subject: Re: [Insight-users] Multimodality Image Fusion.
>>
>> Hi Ashwath,
>>
>> You might be interested in the "Generalised Image Fusion Toolkit"
>> (GIFT) which was submitted to the Insight Journal some years back:
>>    http://www.insight-journal.org/browse/publication/103
>>
>> I'm not sure it will compile out-of-the-box with the latest ITK, but only minimal changes would be required if not.
>>
>> If you are interested in the registration (i.e. spatial alignment) of such images before actual fusion, then please consult the Insight Software Guide "Registration" section:
>>     http://www.itk.org/ItkSoftwareGuide.pdf
>>
>> HTH
>>
>> Cheers, Dan
>>
>> On 12 October 2012 15:47, Ashwath Hegde, ERS-HCLTech <Ashwathh at hcl.com> wrote:
>>> Hi All,
>>>
>>>
>>>
>>> Please let me know if there is example on Multimodality Image
>>> Fusion(fusing CT and MRI images) in ITK.
>>>
>>> Your help would be highly appreciated.
>>>
>>>
>>>
>>> Thanks in advance,
>>>
>>> Regards,
>>>
>>> Ashwath.
>>>
>>>
>>>
>>> ::DISCLAIMER::
>>> ---------------------------------------------------------------------
>>> -
>>> ---------------------------------------------------------------------
>>> -
>>> --------
>>>
>>> The contents of this e-mail and any attachment(s) are confidential
>>> and intended for the named recipient(s) only.
>>> E-mail transmission is not guaranteed to be secure or error-free as
>>> information could be intercepted, corrupted, lost, destroyed, arrive
>>> late or incomplete, or may contain viruses in transmission. The e
>>> mail and its contents (with or without referred errors) shall
>>> therefore not attach any liability on the originator or HCL or its affiliates.
>>> Views or opinions, if any, presented in this email are solely those
>>> of the author and may not necessarily reflect the views or opinions
>>> of HCL or its affiliates. Any form of reproduction, dissemination,
>>> copying, disclosure, modification, distribution and / or publication
>>> of this message without the prior written consent of authorized
>>> representative of HCL is strictly prohibited. If you have received
>>> this email in error please delete it and notify the sender
>>> immediately.
>>> Before opening any email and/or attachments, please check them for
>>> viruses and other defects.
>>>
>>> ---------------------------------------------------------------------
>>> -
>>> ---------------------------------------------------------------------
>>> -
>>> --------
>>>
>>>
>>> _____________________________________
>>> Powered by www.kitware.com
>>>
>>> Visit other Kitware open-source projects at
>>> http://www.kitware.com/opensource/opensource.html
>>>
>>> Kitware offers ITK Training Courses, for more information visit:
>>> http://www.kitware.com/products/protraining.php
>>>
>>> Please keep messages on-topic and check the ITK FAQ at:
>>> http://www.itk.org/Wiki/ITK_FAQ
>>>
>>> Follow this link to subscribe/unsubscribe:
>>> http://www.itk.org/mailman/listinfo/insight-users
>>>
>> _____________________________________
>> Powered by www.kitware.com
>>
>> Visit other Kitware open-source projects at
>> http://www.kitware.com/opensource/opensource.html
>>
>> Kitware offers ITK Training Courses, for more information visit:
>> http://www.kitware.com/products/protraining.php
>>
>> Please keep messages on-topic and check the ITK FAQ at:
>> http://www.itk.org/Wiki/ITK_FAQ
>>
>> Follow this link to subscribe/unsubscribe:
>> http://www.itk.org/mailman/listinfo/insight-users


More information about the Insight-users mailing list