[Insight-users] deformation of cardiac MR images

Luis Ibanez luis.ibanez at kitware.com
Tue, 17 Feb 2004 02:12:39 -0500


Hi Jason,

1) The suggestion was to load the heart
    data for a time t. So just a 3D volume
    for one instant of the beating cycle.

2) FEM could be fine for registering two
    volumes, You could also try Demons,
    and the BSpline transform.
    For Demons you could initialize the
    deformation field by following the
    example LandmarkWarping2.cxx

3) You can have three alternatives for
    registration:

    Image to Image  ----> FEM, Demons, BSplines
    Image to Model  ----> SpatialObjecs
    Model to Model  ---->  ICP

4) A deformable registration will provide
    you with displacement fields. They will
    tell how much a pixel displaces from one
    time snapshot to the next. You could assume
    that these displacements are actually the
    result of the muscular force of the beating
    heart and therefore attempt to include them
    as part of your FEM modeling.  However, the
    will not necessarily represent the physical
    process that is actually happening in the
    heart.

5) I'll suggest you to segment the volume at
    t0 and then deformably register this one
    to the volume t1. In this way you can use
    the deformation field in order to map the
    t0 segmentation into the t1 volume. No need
    for segmenting all the time snapshots.
    ( but again, this is only one among multiple
      possible approaches).

6) So the steps come down to

    a- Segment volume at t0
    b- Extract a mesh from the segmented region
    c- Deformably register volume t0 to t1
    d- Use deformation field for mapping
       segmentation of t0 into t1.
    e- Deformably register volume t1 to t2
    f- Use deformation field for mapping
       segmentation of t1 into t2
    g- Deformably register volume t2 to t3...etc

    h- Use deformation field (t0->t1) for mapping
       the mesh from the t0 segmentation into
       the t1 space.
    i- Use deformation field (t1->t2) for mapping
       the mesh from the t1 space into the t2 space.


7) For visualizing the mesh you can use VTK
    or the open source visualization application
    ParaView (which is build on top of VTK).
    http://www.paraview.org/HTML/Index.html

    Note that ParaView is extensively used as
    a visualization platform for the output
    of simulations. It supports time series
    an a good number of interactive visualization
    filters.



Regards,


     Luis



----------------
s y wrote:

> Hi Luis and all,
>  
> i'm new to itk and image processing, so do bear with me as i'm still a 
> little confused, and i hope to get the framework correct
> so should i load the volume for short axis and long axis separately or 
> process the whole (both short axis and long axis) volume?
>  
> Luis wrote:
>  >Notice that the FEM framework is used for
> modeling the *image* as an elastic material,
> and applying forces on it in order to deform
> it and achieve registration. >
>  
> in that case what should i use for registration?
>  
> you mentioned deformable registration between 2 volumes..did you mean 
> performing registration on the images (not the construted models) and 
> obtain deformation field (did you mean that the result of the 
> registration can produce dx, dy, dz.....or they are just for the sole 
> purpose of image registration with no physical information for later use 
> for strain calculations)
>  
> you also mentioned the need to segment and mesh the MR images to study 
> the deformations...should i perform segmentation at time t0 or all the 
> frames (what abt meshing, just for t0 or all frames)?
>  
> is this what i should do: 1) load volumetric images 2) enhance images 3) 
> perform registration for image at time t(i) with t(i+1) 4) segment the 
> volumetric image at t0 5) mesh the segmented volumetric image 6) 
> use deformation field from registration part and apply to the the meshed 
> model 7) write a c++ program to calculate strain
>  
> can you kindly list the steps (tools to consider and examples for each 
> step)  that i should adhere to for studying and visualizing this 
> deformation, i really appreciate your help
>  
>  
> Best Regards
> jason
>  
>  
>  
>  
>  
>  
> 
> 
> 
>  
>  
>  
> 
> */Luis Ibanez <luis.ibanez at kitware.com>/* wrote:
> 
> 
>     Hi Jason,
> 
>     Yes, you probably want to load the full volume
>     corresponding to time t0 from the DICOM files.
>     Then load the volume corresponding to time t1,
>     perform deformable registration between these
>     two volumes, and obtain a deformation field.
> 
>     Then you could take image for t1 and register it
>     with image for time t2, and in general register
>     image at time t(i) with the one at time t(i+1).
> 
>     Notice that the FEM framework is used for
>     modeling the *image* as an elastic material,
>     and applying forces on it in order to deform
>     it and achieve registration. The deformations
>     produced are totaly artificial and lack any
>     physical meaning.
> 
>     If you actually want to model the heart, you
>     could still use the FEM classes in ITK but
>     not in the sense of registration. You will
>     have to generate a mesh on the cardiac muscle
>     and then study the deformations. For meshing
>     the heart you probably need to segment it
>     from the MR images first.
> 
> 
> 
>     Regards,
> 
> 
>     Luis
> 
> 
>     -----------------
>     s y wrote:
> 
>      > Hi Luis,
>      >
>      > did you mean i should first load dicom slices as a single volume
>     for the
>      > start of the cardiac cycle (t0) using the Dicom series reader,
>     perform
>      > image enhancement, segmentation, FEM/landmarks/Bsplines etc. in 3D,
>      > then do registration for the rest of the volumetric images at
>     different
>      > time instances like this:
>      >
>      > registrate the construted model for time t1 with volumetric
>     images at
>      > time t2, then with that information, registrate with images at
>     time t3,
>      > and so on...
>      >
>      > in the end, i would like to perform strain analysis, and calculate
>      > rotations of the left ventricular points during the cardiac
>     cycle, so is
>      > FEM-based the best choice?
>      >
>      > Thanks fo r your help
>      >
>      > Best regards
>      > jason
>      >
>      >
>      >
>      > */Luis Ibanez /* wrote:
>      >
>      > Hi Jason,
>      >
>      >
>      > First you may want to get familiar with
>      > the process of loading DICOM slices as
>      > a single volume.
>      >
>      > For example look at
>      >
>      > Insight/Examples/IO/
>      > DicomSeriesReadImageWrite.cxx
>      >
>      >
>      > Then, you may want to look at the following
>      > options for deformable registration:
>      >
>      >
>      > 1) Demons, with landmarks initialization
>      > 2) BSplines transforms
>      > 3) FEM-Based.
>      >
>      > For (1) you may look first at getting familiar
>      > with the Landmark Warping example in
>      >
>      > Insight/Examples/Registration/
>      > LandmarkWarping2.cxx
>      >
>      > Since the MR tags will give you a natural
>      > framework for setting landmarks that can
>      > be used for initializing a deformation
>      > field.
>      >
>      > This deformation field can be use as input
>      > for any of the two the Demons registration
>      > filters.
>      >
>      > For Visualization,
>      > you certainly want to use VTK. A good way
>      > to p! rototype the visualization pipeline is
>      > to use ParaView (a free and open source tool).
>      >
>      > You can download ParaView from
>      >
>      > http://www.paraview.org/HTML/Index.html
>      >
>      > It can be used for visualizing your images
>      > and the deformation fields produced by the
>      > registration algorithms.
>      >
>      > Once you identify a convenient visualization
>      > pipeline, you can export it as a batch script
>      > and use it as such or translate it into C++.
>      >
>      >
>      > ParaView also offers functionalities for
>      > running animations of data sets.
>      >
>      >
>      > Note that if you want to see a surface model
>      > you will have to perform segmentation in
>      > at lea st one of the datasets. The segmentation
>      > can then be mapped into the other datasets
>      > using the corresponding deformation fields.
>      >
>      >
>      >
>      > Regards,
>      >
>      >
>      > Luis
>      >
>      >
>      >
>      >
>      > ----------------
>      > s y wrote:
>      >
>      > > Hi to all,
>      > >
>      > > i have a dataset of cardiac MR images in dicom format (with MR
>      > tagging)
>      > > which co! nsists of short and long axis slices for the whole of the
>      > > cardiac cycle
>      > > my objective is to reconstruct the volume of the heart (or a FEM
>      > model
>      > > of it) so as to view and analyse the deformation of the heart
>      > during the
>      > > cycle.
>      > >
>      > > i've built vtk, itk and fltk. However, i'm not sure what are the
>      > tools
>      > > to use and how to go about it.
>      > >
>      > > should i use itk to segment and registrate the images slice by
>      > ; slice for
>      > > each instance first, then use vtk to render it, or are there any
>      > better
>      > > ways to do it with vtk and itk? also, is it possible to create an
>      > > animation of the deformation of the model during the cycle?
>      > >
>      > > any suggestions are welcome
>      > > Thanks
>      > >
>      > > regards
>      > > jason
>      > >
>      >
>      >
>      >
>      > _______________________________________________
>      > Insight-users mailing list
>      > Insight-users at itk.org
>      > http://www.itk.org/mailman/listinfo/insight-users
>      >
>      > / *Y! Asia presents Lavalife*
>      >
>      > - Get clicking with thousands of local singles today! /
>      >
> 
> 
> 
>     _______________________________________________
>     Insight-users mailing list
>     Insight-users at itk.org
>     http://www.itk.org/mailman/listinfo/insight-users
> 
> *Y! Asia presents Lavalife* 
> <http://sg.rd.yahoo.com/mail/tagline/?http://asia.yahoo.com/lavalife>
> - Get clicking with thousands of local singles today!
>