Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Nonrigid Registration Regularized by Shape Information: Application to Atlas Construction of Cardiac CT Images

  • Yunfei Zha,

    Affiliation Department of Radiology, Renmin Hospital of Wuhan University, Wuhan 430060, P. R. China

  • Xuesong Lu,

    Affiliation College of Biomedical Engineering, South-Central University for Nationalities, Wuhan 430074, P. R. China

  • Li Wang,

    Affiliation Department of Infection Control, Renmin Hospital of Wuhan University, Wuhan 430060, P. R. China

  • Rongqian Yang ,

    bmeyrq@gmail.com (RY); dfwang@cuhk.edu.hk (DW)

    Affiliation School of Materials Science and Engineering, South China University of Technology, Guangzhou 510006, P. R. China

  • Shanxing Ou,

    Affiliation Radiology Department, Guangzhou General Hospital of Guangzhou Military Area Command, Guangzhou 510010, P. R. China

  • Dong Xing,

    Affiliation Department of Radiology, Renmin Hospital of Wuhan University, Wuhan 430060, P. R. China

  • Defeng Wang

    bmeyrq@gmail.com (RY); dfwang@cuhk.edu.hk (DW)

    Affiliations Research Center for Medical Image Computing, Department of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China, Shenzhen Research Institute, The Chinese University of Hong Kong, Shenzhen, China

Nonrigid Registration Regularized by Shape Information: Application to Atlas Construction of Cardiac CT Images

  • Yunfei Zha, 
  • Xuesong Lu, 
  • Li Wang, 
  • Rongqian Yang, 
  • Shanxing Ou, 
  • Dong Xing, 
  • Defeng Wang
PLOS
x

Abstract

Cardiac atlases play an important role in the computer-aided diagnosis of cardiovascular diseases, in particular they need to deal with large and highly variable image datasets. In this paper, we propose a new nonrigid registration algorithm incorporating shape information, to produce comprehensive atlases. For one thing, the multiscale gradient orientation features of images are combined to form the construction of multifeature mutual information. Additionally, the shape information of multiple-objects in images is incorporated into the cost function for registration. We demonstrate the merits of the new registration algorithm on the 3D data sets of 15 patients. The experimental results show that the new registration algorithm can outperform the conventional intensity-based registration method. The obtained atlas can represent the cardiac structures more accurately.

Introduction

Cardiovascular diseases are now the most significant cause of death in China [1]. Their early diagnosis and treatment is crucial in order to reduce mortality and to improve patients’ quality of life. In recent years, some non-invasive imaging modalities are establishing the importance of high resolution imaging of the cardiovascular system. Among them, Computed Tomography(CT) has been widely used in not only the acquisition of 3D images which describe the cardiac anatomy but also the acquisition of 3D+time image sequences which describe the cardiac anatomy as well as function [2]. Both the multislice CT(MSCT) and dual-source CT(DSCT) have a demonstrated high sensitivity and specificity in diagnoses [3, 4].

Cardiac atlases play an important role in computer-aided diagnoses of angiocardiopathy [5]. Their abilities mainly focus on three profiles: First of all, the patient-specific biomarkers can be automatically extracted. Secondly, the multi-modal data can be integrated into a unified space for visualization purposes. Thirdly, the patient-specific models can be generated for individualized simulations of alternative treatment scenarios.

Recently, some approaches using the image registration technique have been developed for the volumetric-based modeling of the heart [6]. Frangi et al. proposed a novel method for the generation of 3D shape landmarks, in order to construct statistical shape models of the heart [7]. It can treat multiple-part structures and requires less restrictive assumptions on the structure’s topology. Perperidis used voxel-based atlases of images to generate surface-based training data for a 3D+time statistical model [8]. Another 3D+time statistical model of the cardiac shape was based on a direct bilinear decomposition of the surfaces in a training set, using higher order singular value decomposition [9]. A construction method for a 4D atlas of the human heart using cardiac MR imaging was proposed [10]. The probabilistic atlas captures the cardiac anatomy and function of a healthy heart. A construction framework of a detailed atlas based on a spatial-temporal statistical model of the human heart was presented [11]. It uses spatial normalization based on a non-rigid image registration to synthesize a population mean image and establish the spatial relationships between the mean and the subjects in the population.

However, it is possible for largely variable image datasets to achieve a superior atlas without the statistical shape models of organs. In this paper, we propose a novel nonrigid registration algorithm for cardiac atlas construction. Multifeature mutual information incorporating multiscale gradient orientation features is employed as a similarity metric. The shape information of the object instead of the statistical shape model is incorporated into the cost function of registration as a regularization term. The experiments performed on the 3D+time cardiac data set of DSCT show that the new algorithm can achieve high registration accuracy. The synthetic mean atlas can represent the anatomical variety of cardiac structures more accurately.

Materials and Methods

Ethics Statement

This study was reviewed and approved by the ethics committee of Guangzhou General Hospital of Guangzhou Military Area Command. Informed written consents have been obtained from the participants.

2.1 Transformation Model

The goal of image registration in cardiac CT is to find the optimal transformation T:(x,y,z)↦(x′,y′,z′), which maps any point in the moving images I:(x,y,z) into its corresponding point in the reference image I(x′,y′,z′). In this work, we adopt a combined transformation T: (1)

The global transformation Tglobal is affine model, and the local transformation Tlocal is a free-form deformation(FFD) model based on B-splines [12]. The affine registration result is considered as the initial parameters for registration using the FFD model.

2.2 Multifeature Mutual Information

Normalized mutual information(MI) is generally calculated on the image intensities only, whereas multifeature mutual information(α-MI) can measure higher-dimensional signals through graph theory [13]. The fixed image is denoted as F and the moving image M. The aim of registration is to search the optimal parameter μ of transformation Tμ(x) between F and M. Let zf(xi) be the feature vector of F at a point xi, and zm(Tμ(xi)) that of M at the transformed point Tμ(xi). Let zfm(xi,Tμ(xi)) be the concatenation of the two feature vectors: [zf(xi),zm(Tμ(xi))]. Three k-nearest neighbor(KNN) graphs , , and are respectively constructed by the total distance of a feature vector z to its k nearest neighbors: (2) (3) (4)

So α-MI is defined as: (5) with γ = d(1-α), and 0<α<1. zf(xip), zm(Tμ(xip)), and zfm(xip,Tμ(xip)) are the pth nearest neighbor of zf(xi), zm(Tμ(xi)), and zfm(xi,Tμ(xi)), respectively. N is the number of sample points.

It is crucial to select representative features for registration using an α-MI. A Cartesian image set with 15 features was chosen for nonrigid registration by cervical MRI [14]. These features consist of L, gTg, gTHg, gTHHg, tr(H), tr(HH), and tr(HHH). Here, L is the image intensity, g = ∂L/∂xg the spatial derivative, H is the Hessian of L, and tr(·) denotes the matrix trace. They are all computed using Gaussian derivatives at scale σ. In fact, the boundaries of some substructures in medical images often carry significant information. Although the gradient of the boundaries might not have the same magnitude in some cases, the gradient orientation should be the same [15, 16]. In this paper, we combine multiscale gradient orientation features with Cartesian features to compute the α-MI. Assuming that the gradient vector for each voxel is defined as (v1,v2,v3), the orientation described by two angles θ and φ is given by: (6)

Finally, these features consist of the original intensity image, Cartesian features at scales σ = 1,2, and a corresponding gradient orientation at scales σ = 1,2. They are normalized to have a zero mean and unit variance.

2.3 Cost Function

In atlas construction, some methods involve the statistical shape model. In some cases, an accurate registration could perform better than the existing statistical shape models. In this section we incorporate shape information into nonrigid registration. The cost function comprises two competing goals, followed by: (7)

The first term is the α-MI, while the second term CP represents the cost related to the consistency of shape points. A weighting factor ω(0.01≤ω≤0.1) is used to balance the two terms.

The extraction of corresponding shape points is very similar to [7]. Firstly, the marching cubes [17] algorithm is applied to generate a dense triangulation of the boundary isosurfaces in binary fixed image. Then the decimation process can be implemented in order to reduce the amount of triangular nodes. We use the method by Schroeder et al. [18], and specify a target decimation rate (96%) with respect to the original mesh. These nodes in the decimated triangulation will form the landmarks of the shape. Finally, the shape points of the fixed image can be propagated to the moving image through a volumetric registration of the two binary images using a kappa statistics metric [19].

A parametric representation of N shape point pairs is denoted as {(pfi,pmi):i = 1,2,…,N}, where pfi = [xfi,yfi,zfi] in the fixed image and pmi = [xmi,ymi,zmi] in the moving image. So the penalty term CP is defined as: (8) where Tμ(·) is the transformation and ||·|| is the Euclidean distance. For speed and efficiency, most of free-form registration methods based on B-splines use gradient-based optimizers. Consequently, the derivatives of the penalty term with respect to the transform parameters are required. The derivative of CP reads: (9)

2.4 Atlas Construction

Atlas construction is a different and complicated topic outside the scope of image registration. In this work, we construct a simple atlas to test the performance of the proposed registration approach. Similar to Ref. [20], this simple atlas can be built without a statistical shape model, because it is assumed that a nonrigid registration incorporating shape information could perform better when applied to highly variable cardiac datasets. This atlas can be produced from a selected reference space such as the mean of a group of cardiac CT images.

In practice, a reference space is initially selected from a population of images. The other images are then registered to this reference space. A mean intensity image, referred to as the atlas intensity image, can be computed from this set of registered images. The labeling of each anatomical region of the reference space has the corresponding segmentation information of the atlas, referred to as the atlas label image. The process is outlined in Fig 1.

Experiments

The nonrigid registration as described above was implemented in Elastix version 4.6 [21]. The extraction algorithm of shape points is based on the Visualization Toolkit(VTK) [22]. All programs were run on a Windows computer with an Intel Dual Core 3.40 GHz CPU and 16.0 GB memory. The running time for each registration is about 2 hours.

3.1 Data

The cardiac data was acquired with a dual source CT scanner (Siemens Somatom Definition, Germany). Fifteen patients were scanned. Each patient was scanned at twenty-one time phases. Fig 2 shows the sequence image of a patient at ten time phases. As the goal of this work is to test the performance of the proposed approach, the first time phase occurring during the diastole of all patients was used in the experiment. The image dimensions were 512×512×254 voxels of size 0.348×0.348×0.5mm. All the data are publicly available through http://figshare.com/articles/cardiac_ct_data_15sets/1379059.

Manual segmentations of AO(Aorta), LV(Left Ventricle), LVM(Left Ventricle Myocardium), LA(Left Atrium), RV(Right Ventricle), and RA(Right Atrium) were available for each image. They were either used to extract shape points or considered as the gold standard. The manual segmentation was completed by either a clinician or a research associate with an expert knowledge of heart anatomy. Some of them are displayed in Fig 3. The baseline of the experiment is a traditional mutual information method.

3.2 Evaluation Method

To evaluate the registration quality, automatic segmentation results of the fixed images were created by transforming the manual segmentation of the moving images, with transformation of the registration results. The Dice Similarity Coefficient (DSC) [23] as a measure of overlap, was calculated between the automatic segmentations and manual segmentations of the fixed image. DSC = 0 indicates no overlap while DSC = 1 indicates perfect agreement. The DSCs are presented in box-and-whisker plots.

To compare registration results of the two algorithms, two-sided Wilcoxon tests [24] were carried out on the corresponding DSC values. A value of p<0.05 was regarded as a statistically significant difference.

3.3 Choice of Parameters

In order to validate the new algorithm, we randomly selected the image of the fourth patient as the fixed image, and images of the other patients as the moving images. An affine initial registration using the MI of intensities, only was performed before the nonrigid registration, to get a rough alignment. For the nonrigid registration of traditional MI and α-MI, a multiresolution scheme with five levels was employed. Gaussian smoothing was applied with scales σ = 16,8,4,2,1, but no downsampling to more accurately interpolate the moving image. As for the B-spline control points, the grid spacing of 80, 40, 20, 10, and 5 mm was applied to the five resolution levels, respectively. For the optimization procedure, A = 50, τ = 0.6, and a = 2000 were set. 1000 iterations were used. The number of samples was set to N = 5000.

For the α-MI, the KD trees; a standard splitting rule; a bucket size of 50; and an error bounding value of 10 was selected. The(k = 5) nearest neighbors were set while α = 0.99 was set. About 1500 shape point pairs were extracted from five surfaces(including AO, LVM, LA, RV, and RA) in manual segmentations. The balance coefficient ω = 0.05 was found to yield the best registration result.

Results

In this section, the registration accuracy of traditional MI and our method was compared. Fig 4 shows the DSC results of registration for AO, LV, LVM, LA, RV, and RA. The improvement of the average DSC for AO, LVM, LA, RV, and RA are found to be significant. For LV, the improvement of accuracy is minor. The overall mean and standard deviation of the DSCs in the experiments are summarized in Table 1.

thumbnail
Fig 4. The comparison of registration accuracy using traditional MI and our method.

A star indicates a statistical significant difference of the median DSC of the two methods.

https://doi.org/10.1371/journal.pone.0130730.g004

In Fig 5, a typical example of the registration result using MI (c) and our method (d) is illustrated. The LA and LVM of the fixed (a) and moving (b) image are very different. It can be observed that our method can achieve better alignment with the reference image than using the MI method. Fig 6 shows two views of the atlas mesh, corresponding to the synthesized mean image by registration. They can clearly display the six structures of cardiac images.

thumbnail
Fig 5. Example of the registration result: the red contour surround LA region, the blue contour surround LVM region.

(a) The fixed image. (b) The moving image. (c) The deformed moving image using MI. (d) The deformed moving image using our method.

https://doi.org/10.1371/journal.pone.0130730.g005

thumbnail
Fig 6. Two views of atlas mesh corresponding to the synthesized mean image.

Different colors indicate different structures.

https://doi.org/10.1371/journal.pone.0130730.g006

Discussion

In this paper, we set out to improve the accuracy of a nonrigid registration for cardiac atlas construction. Multiscale gradient orientation features of images are extracted to construct multifeature mutual information. Additionally, the shape information of multiple-objects in images is incorporated into the cost function of registration. We have demonstrated the atlas construction using this method over a population of 15 subjects. We validated the atlas through a measure of registration accuracy. It was shown that the proposed method outperforms traditional MI.

There are some limitations in this work. Firstly, the computational burden of this method needs to be decreased for use in the clinic, although the dimensionality of features is not high. In this case it might be possible to parallelize the important parts of the algorithm making use of multiple processors. Secondly, the number of structures in the atlas needs to be expanded. The registration accuracy probably depends on the shape points of cardiac structures. The improvement of AO and LV structures is less than that for other structures. Ascertaining the reason for this provides an additional direction for future research. Finally, the subjects used in our experiments may not be enough to represent the cardiac atlas with sufficient diversity. More cases would make it more probable to display a wide diversity of morphologies and pathologies.

In future work, compensative techniques will be considered to deal with these limitations. The parallel computation such as using graphic processing units will be used to accelerate the registration process. We will also investigate the stability of the algorithm with cardiac structures in clinical practice.

Author Contributions

Conceived and designed the experiments: YZ LW XL RY SO DX DW. Performed the experiments: YZ DX. Analyzed the data: LW XL RY. Contributed reagents/materials/analysis tools: RY. Wrote the paper: YZ XL RY SO DW.

References

  1. 1. Hu SS, Kong LZ. Report on cardiovascular diseases in China. Encyclopedia of China Publishing House, Beijing, 2010.
  2. 2. Guo YK, Gao HL, Zhang XC. Accuracy and reproducibility of assessing right ventricular function with 64-section multi-detector row CT: comparison with magnetic resonace imaging. Int J Cardiol, 139(3): 254–262, 2010. pmid:19028401
  3. 3. Marwan M, Pflederer T, Schepis T. Accuracy of dual-source computed tomography to identify significant coronary artery disease in patients with atrial fibrillation: comparison with coronary angiography. Eur Heart J, 31(18): 2230–2237, 2010. pmid:20624768
  4. 4. Marwan M, Pflederer T, Schepis T. Accuracy of dual-source CT to identify significant coronary artery disease in patients with uncontrolled hypertension presenting with chest pain: comparison with coronary angiography. Int J Cardiovas Imag, 28(5):1173–1180, 2012. pmid:21688136
  5. 5. Kirisli HA, Schaap M, Klein S, Papadopoulou SL, Bonardi M, Chen CH, et al. Evaluation of a multi-atlas based method for segmentation of cardiac CTA data: a large-scale, multicenter, and multivendor study. Medical Physics, 37(12): 6279–6291, 2010. pmid:21302784
  6. 6. Craene MD, Sukno FM, Gomez CT. Atlas construction and image analysis using statistical cardiac models. STACOM-CESC, LNCS 6364: 1–13, 2010.
  7. 7. Frangi F, Rueckert D, Schnabel JA, Niessen WJ. Automatic construction of multiple-object three-dimensional statistical shape models: application to cardiac modeling. IEEE Transactions on Medical Imaging, 21(9): 1151–1166, 2002. pmid:12564883
  8. 8. Perperidis D, Mohiaddin R, Rueckert D. Construction of a 4D statistical atlas of the cardiac anatomy and its use in classification. in Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), 3750: 402–410, 2005.
  9. 9. Hoogendooorn C, Sukno FM, Ordas S, Frangi AF. Bilinear models for spatio-temporal point distribution analysis: Application to extrapolation of left ventricular, biventricular and whole heart cardiac dynamics. Int. J. Comput. Vis., 85(3): 237–252, 2009.
  10. 10. Perperidis D, Lorenzo-Valdes M, Chandrashekara R, Rao A, Mohiaddin R, Sanchez-Ortiz GI, et al. Building a 4D atlas of the cardiac anatomy and motion using MR imaging. In Proc. Of Medical Image Understanding and Analysis ‘04, pages 9–12, 2004.
  11. 11. Hogendoorn C, Duchateau N, Quintana DS, Whitmarsh T, Sukno FM, Craene MD, et al. A high-resolution atlas and statistical model of the human heart from multislice CT. IEEE Transaction on Medical Imaging, 32(1): 28–44, 2013. pmid:23204277
  12. 12. Rueckert D, Sonoda LI, Hayes C, Hill DLG, Leach MO, Hawkes DJ. Nonrigid registration using free-form deformations: application to breast MR images. IEEE Transactions on Medical Imaging, 18(8): 712–721, 1999. pmid:10534053
  13. 13. Neemuchwala H, Hero A, Carson P. Image matching using alpha-entropy measures and entropic graphs. Signal Processing, 85(2): 277–296, 2005.
  14. 14. Staring M, Heide UA, Klein S, Viergever MA, Pluim JPW. Registration of cervical MRI using multifeature mutual information. IEEE Transactions on Medical Imaging, 28(9): 1412–1421, 2009. pmid:19278929
  15. 15. Nigris DD, Collins DL, Arbel T. Multi-modal image registration based on gradient orientations of minimal uncertainty. IEEE Transactions on Medical Imaging, 31(12): 2343–2354, 2012. pmid:22987509
  16. 16. Heinrich MP, Jenkinson M, Gleeson FV, Brady SM, Schnabel JA. Deformable multimodal registration with gradient orientation based on structure tensors. Annals of the BMVA, 2011(2): 1–11, 2011.
  17. 17. Lorensen WE, Cline HE. Marching cubes: a high resolution 3D surface reconstruction algorithm. in Proc. Computer Graphics: SIGGRAPH’87 Conf., 21: 163–169, 1987.
  18. 18. Schroeder WJ, Zarge JA, Lorensen WE. Decimation of triangle meshes. Conference Proceedings of SIGGRAPH, 65–70, 1992.
  19. 19. Zijdenbos AP, Dawant BM, Margolin RA, Palmer AC. Morphometric analysis of white matter lesions in MR images: method and validation. IEEE Transactions on Medical Imaging, 13(4): 716–724, 1994. pmid:18218550
  20. 20. Zhuang XH, Rhode KS, Razavi RS, Hawkes DJ, Ourselin S. A registration-based propagation framework for automatic whole heart segmentation of cardiac MRI. IEEE Transactions on Medical Imaging, 29(9): 1612–1625, 2010. pmid:20378466
  21. 21. Klein S, Staring M, Murphy K, Viergever MA, Pluim JPW. Elastix: a toolbox for intensity-based medical image registration. IEEE Transactions on Medical Imaging, 29(1):196–205, 2010. pmid:19923044
  22. 22. http://www.vtk.org.
  23. 23. Dice LR. Measures of the amount of ecologic association between species. Ecology, 26(3): 297–302, 1945.
  24. 24. Wilcoxon F. Individual comparisons by ranking methods. Biometrics, 1:80–83, 1945.