Figures
Abstract
Purpose
Lymphedema, a swelling of the extremity, is a debilitating morbidity of cancer treatment. Current clinical evaluation of lymphedema is often based on medical history and physical examinations, which is subjective. In this paper, the authors report an objective, quantitative 2D strain imaging approach using a hybrid deformable registration to measure soft-tissue stiffness and assess the severity of lymphedema.
Methods
The authors have developed a new 2D strain imaging method using registration of pre- and post-compression ultrasound B-mode images, which combines the statistical intensity- and structure-based similarity measures using normalized mutual information (NMI) metric and normalized sum-of-squared-differences (NSSD), with an affine-based global and B-spline-based local transformation model. This 2D strain method was tested through a series of experiments using elastography phantom under various pressures. Clinical feasibility was tested with four participants: two patients with arm lymphedema following breast-cancer radiotherapy and two healthy volunteers.
Results
The phantom experiments have shown that the proposed registration-based strain method significantly increased the signal-to-noise and contrast-to-noise ratio under various pressures as compared with the commonly used cross-correlation-based elastography method. In the pilot study, the strain images were successfully generated for all participants. The averaged strain values of the lymphedema affected arms were much higher than those of the normal arms.
Citation: Yang X, Torres M, Kirkpatrick S, Curran WJ, Liu T (2017) Ultrasound 2D strain measurement for arm lymphedema using deformable registration: A feasibility study. PLoS ONE 12(8): e0181250. https://doi.org/10.1371/journal.pone.0181250
Editor: Qinghui Zhang, North Shore Long Island Jewish Health System, UNITED STATES
Received: January 11, 2017; Accepted: June 28, 2017; Published: August 30, 2017
Copyright: © 2017 Yang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and in Figshare at the following link: https://figshare.com/articles/Ultrasound_1/5164843.
Funding: This research was supported in part by DOD PCRP Award W81XWH-13-1-0269, Dunwoody Golf Club Prostate Cancer Research Award, a philanthropic award provided by the Winship Cancer Institute of Emory University, and Susan Komen for the Cure foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Lymphedema, a swelling of the extremity, is a common long-term toxicity of cancer treatment. Lymphedema is the accumulation of lymph in the interstitial spaces, principally in the subcutaneous fatty tissues. For instance, arm lymphedema is a debilitating morbidity affecting approximately 25% of breast-cancer survivors [1–3]. Severe lymphedema can limit range of motion, cause pain or weakness, and may result in stiffness of the affected extremity. Currently, lymphedema is clinically diagnosed by medical history and physical examination that includes the circumferential or volume measurement of the affected arm [1–3]. Studies have shown a lack of consistency and rigor in these methods of measurement [4]. There is a clinical need for noninvasive and accurate diagnosis of lymphedema, particularly for early detection and accurate grading. If the lymphedema is diagnosed early (≤ Stage 1), successful intervention can reverse its development [5–7]. Moreover, many approaches have been attempted to treat lymphedema, including medications, physiotherapy and surgery. These treatments depend on the severity of the disease, which make accurate grading of lymphedema critical. This study’s objective is to develop a 2D strain technology to evaluate lymphedema. Lymphedema is marked by edema and chronic inflammation; therefore 2D strain value may be a parameter which can be used to characterize the severity of lymphedema.
Ultrasound (US) elastography is a technique for noninvasive characterization of tissue mechanical properties [8, 9]. Elasticity imaging, or strain imaging, describes the compressibility of biological tissues [9, 10]. In strain imaging, the displacement or deformation of tissue are estimated using pre- and post-compression image data [11, 12]. The axial strain is usually retrieved in two steps: displacement estimation, by matching pre-deformation RF data windows with post-deformation windows, and strain estimation, by differentiating the displacement field [13–16].
The quality of the elasticity image could be compromised by decorrelation between the pre- and post-compression ultrasound signals [17]. The main causes of this decorrelation are the changes of speckle patterns due to the complex scatter motion and out-of-plane motion of the probe [18]. Most elastography techniques estimate local displacements of tissue based on amplitude correlation [19, 20] or phase correlation of the radio-frequency (RF) signals [21, 22]. Cross-correlation (CC) method is commonly used estimator of distance (or similarity) beam between echo fields, and is capable of tracking small variations even when very low strains (less than 2%) are involved. However, elastograms remain degraded by decorrelation noise, especially when large and out of plane motion [23], non-uniformity of the ultrasound field and non-rigid tissue deformation [24] are present. In fact, incoherent motion and variations in the signal from scatters at high compression lead to displacement estimation errors [25] and ambiguities in the determination of the motion vectors [26]. Attempts have been made to adapt the correlation algorithm to provide subsample accuracy and estimation stability. These approaches proved to be valuable, however the displacement is estimated in sub-windows where it is supposed to be linear [27] or constant [23], and the continuity of the displacement field in the whole domain is not used. When the continuity assumption is violated, a tracking algorithm might not only fail to find the correct displacement at any particular point, but also propagate this incorrect estimate into other parts of the image, producing so-called drop-outs [28]. To guard against this, incorrect displacement estimates can be detected and replaced by values interpolated from nearby points, before they get a chance to propagate [29–31].
Another limiting factor of most current displacement tracking strategies is that the propagation direction is constrained to up–down, left–right or diagonal [28]. Most tissues exhibit anisotropic mechanical and functional properties, compressibility and viscoelastic behavior so that tissue motion and deformation are not limited to a single dimension [32, 33]. Hence, the necessity for measuring 2D and even 3D strain is evident. In this paper, we proposed a novel 2D strain imaging using registration of pre- and post-compression ultrasound B-mode images, which combines the statistical intensity- and structure-based similarity measures using normalized mutual information (NMI) metric and normalized sum-of-squared-differences (NSSD), with an affine-based global and B-spline-based local transformation model. The proposed method is not constrained to any particular set of directions, and is an alternative approach towards 2D or 3D strain estimation based on non-rigid registration of US images or volumes.
A part of this method was reported in SPIE Medical Imaging 2014 [34]. In this paper, we improved upon the previous intensity-based NMI similarity measurement and proposed a hybrid similarity measurement combined structure-based NSSD and intensity-based NMI to deal with the low contrast and signal-noise-rate (SNR) problem in ultrasound image. In addition, we expanded the phantom study. We showed 2D stain comparison and axial and lateral profile comparison through lesion for the CC-based and our registration-based method, and displayed 2D stain difference in 3D. We also investigated strain changes at different frames. And we also conducted initial clinical study to test its clinical feasibility.
Methods
In registration-based strain imaging, the registration process is equivalent to finding the corresponding point before and after compression for each point in the ultrasound images, so it is similar as the displacement reconstruction in ultrasound elastography. For registration, an optimal deformation field is determined through spatially transforming an image (the post-pressure floating image) to achieve the best match between the deformed floating image and a second image (the pre-pressure reference image). In this work, a combined transformation model is used to parameterize the spatial transformation field. The global deformation of the tissue is modeled by an affine transformation, while the local tissue deformation is described by a B-spline transformation. Hybrid metric based on NMI and NSSD is used to combine the voxel- and structure-based similarity measure which is insensitive to the local intensity and contrast changes induced by pressure. Registration is achieved by minimizing a cost function, which represents a combination of the cost associated with the smoothness of the transformation and the cost associated with the image similarity.
Let Ipre and Ipost represent the two images acquired before and after compression (Fig 1). We will need to determine the two matrices A and L where the (i,j) component of A(ai,j) and L(li,j) are the axial and lateral deformation of the pixel (i,j) of Ipre. The axial and lateral strains are calculated by spatially differentiating A in the axial direction and L in the lateral direction, respectively. The two matrices A and L can be determined using deformable image registration assuming there is no the out-of-plane motion [17].
The coordinate system is attached to the ultrasound probe. The sample (i,j) moved by (ai,j,li,j). ai,j and li,j are, respectively, axial and lateral displacements.
Registration-based displacement estimation
Transformation model.
The transformation field T maps each position in the reference pre-compression image Ipre to an anatomically corresponding location in the floating post-compression image Ipost. In the context of displacement estimation, the overall transformation T(x,y) combining a global and local transformation is applied here:
(1)
The first step to estimate tissue deformation under compression is to estimate the large overall motion, also called global displacement. For the global displacement, we used a rigid transformation model - 2D affine transformation, which is a linear transform, composed of the following geometric transformations: translation, rotation, shearing, and scaling. A 2D affine transformation Tglobal(x,y) can be parameterized as:
(2)
where the coefficients U parameterize the 6 degrees of freedom of the transformation.
The affine transformation captures only the global motion of deformation. An additional transformation is required, which models the local deformation of the tissue. For local displacement, we used a B-spline deformation model, which deforms an object by manipulating an underlying mesh of control points. The resulting deformation controls the shape of the object and produces a smooth and continuous transformation. The local transformation is defined as the B-spline weighted average of the control point ϕij,
(3)
Here, the function βi represents the ith basis function of the B-spline β0(u) = (1−u)3/6, β1(u) = (3u3−6u2+4)/6, β2(u) = (−3u3+3u2+3u+1)/6, and β3(u) = u3/6, where 0 ≤ u ≤ 1. ϕij = (xij,yij), i,j = 0,1,2,3 are the 4×4 control points that determine local transformation. In this paper, we used the smallest grid space i × j = 3 × 3 to achieve high resolution of the displacement [35].
Similarity measure.
The similarity measure expresses the quality of the match between the transformed post-compression floating ultrasound image and the pre-compression reference image as a function of the transformation T. Since the local intensity and contrast of the ultrasound images could change after compression, we combined a voxel- and structure-based similarity measure. This hybrid metric is a combination of the popular normalized mutual information (NMI) metric and normalized sum-of-squared-differences (NSSD) metric:
(4)
where Ipre denotes the pre-compression reference and Ipost denotes the post-compression floating image; H(Ipre) and H(Ipost) denote the marginal entropies Ipre and Ipost. The H(Ipre,Ipost) denotes the joint entropy, which is calculated from the joint histogram of Ipre and Ipost.
denotes the local intensity mean.
denotes the local intensity variation of image Ipre. The same denotations are used for Ipost. Gs denotes a Gaussian filter with kernel size s. In order to improve the robust of registration algorithm, we selected the kernel size s of Gaussian filter as 3 times the image voxel size of the displacement because it is usually selected as 2–3 times the image voxel size for NSSD to get more accurate local intensity and variation [36]. This hybrid similarity measure provides a better image alignment than using the NMI metric alone since the NSSD-term is an edge-based alignment metric, and it is not sensitive to the local image contrast changes [36].
Smoothness constraint.
The B-spline interpolation of the displacement vectors imposes a certain degree of smoothness on the deformation field. However, this inherent smoothness is not controllable and is not always sufficient in preventing nonphysical deformations such as folding or large local stretching or shrinking. Therefore, a penalty term is used to constrain the deformation field, which is based on the bending energy of a thin plate of metal that is subjected to bending deformations [37]. The penalty term is composed of second-order derivatives of the deformation:
(5)
where Ω denotes the volume of the image domain. This quantity is the 2D equivalent of the bending energy of a thin-plate of metal and defines a cost function which is associated with the smoothness of the transformation. The regularization term penalizes only non-affine transformations.
Optimization.
To find the optimal transformation, we minimize a cost function associated with the global transformation parameters U, as well as the local transformation parameters Φ. The cost function comprises two competing goals. A user-defined weighting factor τ(0 < τ < 1) controls the relative influence of Esimilarity and Esmooth, combining both into the overall cost function Etotal as follows:
(6)
Here, τ is the weighting parameter, which defines the tradeoff between the alignment of the two images and the smoothness of the transformation. We used τ = 0.01 that it has been proven such parameter was best to optimize the joint cost function [35, 36]. Finding the parameters of the nonrigid transformation that optimize the joint cost function Etotal requires an efficient and robust optimization algorithm. The optimization proceeds include two stages. During the first stage, the affine transformation parameters U are optimized using an iterative multi-resolution search strategy [38]. Since the smoothness term of the cost function is zero for any affine transformation, this step is equivalent to maximizing the image similarity measure. During the subsequent stage, the nonrigid transformation parameters Φ are optimized as a function of the cost function in Eq (6). In each stage we are using an iterative gradient descent technique, which steps in the direction of the gradient vector with a certain step size [39]. The gradient can be estimated very efficiently due to the local effect of the control point positions. This procedure is repeated until the cost function cannot be improved any further. We aim to improve the robustness and efficiency of the algorithm by employing a multi-resolution approach, starting with a coarse spacing that is successively refined using a B-spline subdivision algorithm [35].
Strain calculation
Strain is defined as the deformation of an object, normalized to its original shape.[37, 40] In this study, the deformation of the object is caused by external compression and the relaxation of the tissue. A linear array transducer was used, and the ultrasound beam direction was taken as the x-axis, while the y-axis denoted the orthogonal direction within the imaging plane (Fig 1). The point in space is observed using an ultrasound transducer. The medium at this point undergoes an actual displacement, specified by vector . The displacement vector
contains two orthogonal components dx and dy. The strains are obtained from the gradient of the displacement at that point.
Experiments and results
Phantom study
An elastography phantom (CIRS Model 059) was used to test the performance of the proposed registration-based strain technology. A dense mass (8 mm in diameter) inside the phantom was scanned and an elastic modulus of this the mass was 20 kPa ± 5kPa, which is at least two times greater than the elasticity of the background. The ultrasound scan was carried out with a clinical scanner (SonixTouch, Ultrasonix, British Columbia, Canada) with a linear array transducer (L14-5/38). The scan setting was the following: 10 MHz center frequency, 2 cm focal length, 4 cm depth, 72% gain, and 80-dB dynamic range. The pixel size of B-mode image is 0.10×0.10 mm2. The B-mode images and RF data of the multiple frames were acquired simultaneously with a uniform compression applied to the phantom surface by the probe.
We compared the proposed registration-based method with the traditional CC-based elastography method. We calculated the contrast to noise ratio (CNR) and signal-to-noise ratio (SNR) to assess the performance of our method, and performed quantitative comparison. The CNR and SNR are defined as:
(7)
where mt and mb are the averaged spatial strain of the target and background,
and
are the strain variance of the target and background, and m and σ are the spatial average and variance of a window in the strain image, respectively.
Fig 2 shows the CC-based strain image results from the elastography phantom. We can see the block-match method based on the CC has many artifacts in axial strain image, and the lesion in the phantom appears almost invisible in lateral strain images. Fig 3 displays our registration-based strain image results. In this image, our proposed method can detect the lesion in both the axial and lateral strain images. In the displacement figures, the unit is pixel and red indicates larger deformation. In the strain figures, red indicates softer tissue with higher strain value.
(A) B-mode image of the elastography phantom; CC-based elastography results (B) axial displacement, (C) axial strain, and (D) axial strain and B-mode fused image; (E) lateral displacement, (F) lateral strain (G) lateral strain and B-mode fused image.
(A) B-mode image of the elastography phantom; our registration-based elastography results (B) axial displacement, (C) axial strain, and (D) axial strain and B-mode fused image; (E) lateral displacement, (F) lateral strain (G) lateral strain and B-mode fused image.
Fig 4 illustrates the 2D strain image comparison of the registration-based and CC-based methods. The 2D strain images were calculated by pixel-by-pixel summing the axial and lateral strain images. Fig 5 shows the profile comparison through the lesion region at the axial and lateral directions as shown in Fig 4(A). The shadowing regions in this figure show the corresponding axial and lateral directions of the lesion region. The lesion in the phantom has a high stiffness and should have a lower strain value than the background. This point can be clearly seen for both methods in Fig 5(B). In the background, the CC-based method has heavily oscillated artifacts, while the background almost remains the constant strain value in our registration-based method, which is consistent with the fact that backgrounds composed of the same material should have a constant strain value. Comparing the two profiles in Fig 5(C), the lesion in CC-based method has almost the same lateral strain value with the background, and cannot be separated from the background, while the lesion in our registration-based method has a drastically lower strain value than the background, and can be easily detected from the background. Fig 6 further demonstrates the 3D visual strain comparison of the two regions of interest (ROIs) as shown in Figs 4(B) and (C) 2D strain images.
(A) B-mode image of the elastography phantom; our registration-based elastography result (B) 2D strain image, and the CC-based elastography result (C) 2D strain image.
(A) Profile comparison of two methods through axial red dashed line in Fig 4 (A); (B) profile comparison of two methods through lateral yellow dotted line in Fig 4 (A).
(A) Strain visualization of ROI in Fig 4 (B) for our registration-based method; (B) strain visualization of ROI in Fig 4 (C) for CC-based method.
The CNR and SNR (Eq (7)) are used to quantitatively compare the registration-based and the CC-based strain methods. Ninety frames of B-mode images and RF data were acquired under probe-induced compression. The first frame was used as the reference frame, and every 10th frame (10th, 20th 30th, 40th, 50th, 60th, 70th, 80th and 90th) was used as the floating frames to compare the CNR and SNR under various pressures. Figs 7 and 8 show the CNR and SNR in the axial and lateral strains under various pressure of the two methods. While the CNR and SNR in the axial strain are higher than the lateral strain for both methods, the CNR and SNR of our method are higher than the CC-based method. For both axial and lateral strains, the CNRs increased with pressure at lower stress and decreased with pressure at higher stress, while the SNRs increased with pressure. Fig 9 shows the 2D strain curve of the lesion at various pressures. The average lesion strain increased with pressure. In this elastography phantom, the stiffness of the lesion was greater than the background. When we started to compress the phantom, the background showed greater shrinkage than the lesion. With the increase of pressure, the background shrank to some limit around the 50th frame, so that it became difficult to shrink (e.g. strain hardening) under the increased compression. And then the lesion became “soft” as the compressed background and displayed similar strain values as the compressed background. So the lesion cannot be easily separated from the background with the increase of pressure, which is demonstrated though the decreasing axial and lateral CNRs as shown in Fig 7. The average strain value of the lesion remained low and constant during the first 50 frames and then increased greatly after the 50th frame as shown in Fig 9, which is consistent with our above analysis. The increased 2D strain curve closely conformed to an exponential curve. The R2 = 0.91 demonstrated excellent curve fitting.
This is the axial and lateral CNR from the two methods. The ROI 1 in Fig 3 was seen as a target and ROI 2 was viewed as the background. ROI 1 and 2 were used to calculate the CNR in the axial strain images of both methods, while ROI 1 and 3 were used to calculate CNR in lateral strain images of both methods.
This is the SNR calculated from the axial and lateral strain images obtained from the two methods. The ROI 1 in Fig 3 was seen as a target and ROI 1 was used to calculate the SNR of both methods in both directions.
Clinical study
We conducted a pilot study to test clinical feasibility of the registration-based 2D strain method under Emory Institutional Review Board approval. The inclusion criteria are 1) healthy volunteers over age 18 who serve as the control group, and 2) patients over age 18 who have developed arm lymphedema after breast surgery or radiotherapy. We enrolled 4 participants in this feasibility study: 2 healthy women (age: 38 and 48) and two patients (age: 50 and 52) who had developed arm lymphedema post breast-cancer radiotherapy (all participants have already signed the informed consent forms) between January, 2012 and December, 2013. Lymphedema clinical evaluation of these two patients was conducted by a certified lymphedema specialist with over 10-year experiences (S.K., DPT). The severity of lymphedema was graded on a 4-point system ranging from normal to severe lymphedema using CTC v. 2.0 lymphedema grade [41]. We designed an ultrasound elastography device that incorporates an ultrasound probe with an inflatable cuff attached to a manometer. The inflatable cuff provides an adjustable low pressure to compress the arm. This system provided accurate pressure control and reduce out-of-plane motion of the ultrasound probe. The subjects were scanned in the supine position and asked to remain silent during each acquisition, when the transducer was placed over the biceps. The in-vivo arm data was acquired using BPL9-5/55 probe with 256 elements under the following settings: 6.6 MHz center frequency, 2 cm focal length, 4 cm depth, 50% gain, and 80-dB dynamic range. The pixel size of B-mode image is 0.12×0.12 mm2.
Fig 10 shows the strain images of the control and the lymphedema-affected arms for a 50-year-old patient who was diagnosed with moderate (grade 2) lymphedema of the left arm. The strain images of the lymphedema-affected arms appear redder (higher value) than the two normal arms, which indicates that the arms with lymphedema appear softer than the control arms. To quantitatively evaluate the strain of arms, we calculated the averaged strain values inside the ROIs. Fig 11 displays a 2D strain comparison of the two volunteers and two patients. The average strain value of the lymphedema-affected arms was 1.5 times higher than those of the normal arms. The averaged strain value of arms with lymphedema is 2.8 times higher than those of two volunteers.
(A1) and (A2) are right and left arm B-mode images of a 50-year-old breast cancer patient with moderate degree lymphedema, 1 year post-radiotherapy. (B1) and (B2) are right and left axial displacement images. (C1) and (C2) are right and left lateral displacement images. (D1) and (D2) are right and left axial strain images. (E1) and (E2) are right and left lateral strain images.
Average 2D strain comparison of two volunteers (A) and two patients (B).
Discussion
We have developed a registration-based displacement estimation approach for ultrasonic strain imaging. It is an alternative approach towards 2D strain estimation based on non-rigid registration of the US images. The novelty of our approach is in the similarity measures of the deformable registration and its application in 2D strain imaging. In this approach, a combined affine and B-spline transformation model is used to represent the displacement of tissue between pre-compression and post-compression B-mode image sequences. The 2D displacement between the different image frames is optimized by maximizing the NMI and minimizing NSSD of corresponding voxel intensities and region structure, which is a statistical intensity- and structure-based similarity measure that is not sensitive to the local intensity and contrast changes between the pre- and post-compression tissue. The 2D strain is computed from the displacement by spatial differentiation. In contrast to the traditional speckle tracking methods, no regularizing post-processing step is required, as regularization of the displacement is embedded in the optimization through the B-spline interpolation and the penalty. Our method does not need an implicit tissue property assumption and any post-processing because the displacement field is continuous, is not constrained to any particular set of directions and can measure 2D strain. We have demonstrated the feasibility and reliability through the elastography phantom and in-vivo clinical study.
Although many studies have used registration methods for elastography, to the best of our knowledge, we are the first to apply a hybrid non-rigid registration to estimate the 2D ultrasound strain images of lymphedema tissue. A number of methods have been proposed to estimate 2D or 3D strain based on image registration [34, 42–49]. Different registration-based approaches have been investigated for strain imaging, such as the optical flow, elastic registration between subsequent image frames or diffeomorphic registration. Richards et. al. applied a non-rigid registration based on a bi-linear, finite element-based displacement field to visualize the radial and circumferential component of strain within vascular tissue [42]. Liang et. al. employed an image registration based technique for intravascular ultrasound B-mode images of arteries [50]. Their technique used a free-form deformation model based on cubic B-splines, and only an intensity-based image similarity metric. Elen et. al. used an intensity-based spatio-temporal elastic registration of ultrasound images to measure cardiac strain tensor [51]. Chandrashekara et. al. presented a method based on nonrigid image registration using multilevel free-form deformations based on NMI for the analysis of myocardial strain using tagged MRI [52]. Ledesma-Carbayo et. al. used a semi-local spatio-temporal parametric model for deformation using splines to estimate the ultrasound cardiac strain [53]. De Craene et. al. presented a diffeomorphic registration algorithm, and applied it estimate motion and strain from 3D echocardiography images [44]. This approach enforced time consistency by representing the velocity field as the sum of continuous spatiotemporal B-Spline kernels. The sum of squared differences between the intensities of each frame and a reference one was used as the image similarity metric. Piella et. al. used a multi-view diffeomorphic registration strategy to estimate the transformation from the input multiple views rather than from a single view or a reconstructed compounded sequence [43]. Almost all of previously published registration-based methods were used to estimate the strain in the intravascular and cardiac US images. Although those methods worked well in intravascular and cardiac US images, they may not be suitable for the evaluation of lymphedematous tissues, which present completely different challenges. Lymphedema could affect various tissues including cutaneous, subcutaneous, fat, and possibly muscle layers. On the US images, the distinguishing layers are shown as high-contrast interfaces, which affect the performance of many CC-based strain measurements. However, the structure-based NSSD in our similarity measure uses the high-contrast interfaces between the tissue layers to calculate the displacement. Therefore, one of the strengths of the proposed registration-based method is to resolve the high-contrast interfaces.
The proposed registration-based strain method has the same solution as the B-mode images. Unlike the CC-based method, there is no trade-offs between resolution and noise level in this registration-based approach. In the CC-based method, the selection of the window length is a trade-off between the attainable resolution and noise level within the strain image [54]. Many methods have already been developed to improve this problem, such as using the filtering [55], multiscale estimation [23] and multi-compression average [56]. However, noise always is a challenging problem for the CC-based block matching method, especially due to the nonuniformity of the ultrasound field and non-rigid tissue deformation [24, 55]. In this study, a high SNR in the lateral direction was demonstrated in phantom study (Fig 8). One of a critical clinical need is early detection, because early detection leads to more successful intervention. Therefore, we focus on SNR and CNR because early detection means a technology to detect subtle changes. The SNR increased with pressure, which is consistent with the previous results that relatively large external deformations increase the SNR of displacement and strain images [23, 51, 56]. However, large deformations of soft tissues cannot be described with a linear elastic model [56–58]. In our phantom study, the strain curves in Fig 9 shows a nonlinear elastic model, which is also consistent with the previous study [58]. In this two-tissue (hard tissue enclosed by soft tissue) elastography phantom, the elastic modulus (stress/strain = λ) of the lesion remains constant (λ) at low stress and the lesion can be described as a linear elastic model. As the stress increases, the strain quickly increases and the elastic modulus (stress/strain<λ) of the lesion decreases as a function of strain (i.e., strain softening for the relatively hard lesion). The lesion cannot be described with a linear elastic model and, in our case, the increased 2D strain curve closely conformed to an increment exponential curve.
The proposed registration-based strain method uses global affine and local B-spines-based nonrigid transformations and copes well with large deformation. We identified several markers in ultrasound images to estimate the average deformation in axial and lateral directions. The average deformations at axial and lateral directions were up to 4.1% and 0.6% for the elastography phantom study, and 11.6% and 3.1% for the in-vivo patient study. Skovoroda et al applied their proposed method to reconstruct the strain image up to 16% axial deformation [58]. Deprez et al used a deformable model to the tissues and locally computed axial land lateral strains [59]. The method was reported to provide estimate up to 14% deformation for simulated data.
Recently, poroelastography has been developed to image the effective Poisson’s ratio (EPR) distribution in poroelastic materials under compression and its temporal behavior due to fluid flow [60, 61]. An EPR time constant (EPR-TC) elastogram can be generated from the time constant of the temporal decay of each pixel in the poroelastogram, and therefore may convey information about the underlying permeability distribution of the poroelastic material [62]. Righetti et al. applied a CC-based elastography based on poroelastic tissue model to estimate the strain of normal and lymphedematous tissue [63]. Even though the preliminary study showed early success in differentiating lymphedematous tissues in vivo, the authors pointed out high SNR and that only axial strain images were calculated. Even though this poroelastic tissue model might seem an attractive alternative, they are usually difficult to evaluate and verify. Moreover, the poroelastic properties of the lymphedema tissues may vary significantly across subjects and with age, which renders the application of such models difficult. In contrast to the poroelastic tissue model, the registration-based algorithm makes no assumptions about the poroelastic properties of the lymphedema tissue.
One of the limitations of this study is the small number of participants. We are conducting a clinical study with a large cohort to investigate EPR-TC curve using our method. We will further investigate the sensitivity of our method with a large cohort, and validate if our method could detect lymphedema at the very early stage and distinguish different stages of lymphedema well. All the experiments were conducted on an Intel Xeon 2.66-GHz CPU computer with MATLAB implementation.
Conclusion
Lymphedema is a frequent complication of breast cancer and its therapies, and can have long-term physical and psychosocial consequences for patients. We have proposed a novel registration-based method to estimate the 2D strain of lymphedema. The phantom study showed that tissue strains could be recovered with accuracy and regions with deformation could be determined from these estimated strains. For the in-vivo study strain difference is shown between the normal and lymphedema-affected arms. This 2D ultrasound strain imaging tool may be useful as we try to obtain information regarding the potential effectiveness of lymphatic treatments and monitor the progress of therapy or test the efficacy of new treatments.
Acknowledgments
This research is supported in part by the Department of Defense (DoD) Prostate Cancer Research Program (PCRP) Award W81XWH-13-1-0269 and Dunwoody Golf Club Prostate Cancer Research Award, a philanthropic award provided by the Winship Cancer Institute of Emory University.
References
- 1. Hayes SC, Janda M, Cornish B, Battistutta D, Newman B. Lymphedema after breast cancer: Incidence, risk factors, and effect on upper body function. J Clin Oncol. 2008;26(21):3536–42. pmid:18640935
- 2. Sagen A, Karesen R, Risberg MA. Physical activity for the affected limb and arm lymphedema after breast cancer surgery. A prospective, randomized controlled trial with two years follow-up. Acta Oncol. 2009;48(8):1102–10. pmid:19863217
- 3. Bar V, Cheville A, Solin LJ, Dutta P, Both S, Harris EER. Time Course of Mild Arm Lymphedema after Breast Conservation Treatment for Early-Stage Breast Cancer. Int J Radiat Oncol. 2010;76(1):85–90. pmid:19427748
- 4. Fu MR, Ridner SH, Armer J. Post-breast cancer. Lymphedema: part 1. Am J Nurs. 2009;109(7):48–54. Epub 2009/06/24. pmid:19546644.
- 5. Fu MR, Ridner SH, Armer J. Post-breast cancer lymphedema: part 2. Am J Nurs. 2009;109(8):34–41. Epub 2009/07/31. pmid:19641404.
- 6. Gergich NLS, Pfalzer LA, McGarvey C, Springer B, Gerber LH, Soballe P. Preoperative assessment enables the early diagnosis and successful treatment of lymphedema. Cancer. 2008;112(12):2809–19. pmid:18428212
- 7. Hayes S, Cornish B, Newman B. Preoperative Assessment Enables the Early Detection and Successful Treatment of Lymphedema. Cancer. 2010;116(1):259–. pmid:19877116
- 8. Wells PN, Liang HD, Young TP. Ultrasonic imaging technologies in perspective. J Med Eng Technol. 2011;35(6–7):289–99. Epub 2011/07/28. pmid:21790512.
- 9. Wells PNT, Liang HD. Medical ultrasound: imaging of soft tissue strain and elasticity. Journal of the Royal Society Interface. 2011;8(64):1521–49.
- 10. Parker KJ, Doyley MM, Rubens DJ. Imaging the elastic properties of tissue: the 20 year perspective. Phys Med Biol. 2011;56(1):R1–R29. Epub 2010/12/02. pmid:21119234.
- 11. Ophir J, Alam SK, Garra B, Kallel F, Konofagou E, Krouskop T, et al. Elastography: ultrasonic estimation and imaging of the elastic properties of tissues. Proceedings of the Institution of Mechanical Engineers Part H-Journal of Engineering in Medicine. 1999;213(H3):203–33.
- 12. Ophir J, Cespedes I, Ponnekanti H, Yazdi Y, Li X. Elastography—a Quantitative Method for Imaging the Elasticity of Biological Tissues. Ultrasonic Imaging. 1991;13(2):111–34. pmid:1858217
- 13. Hiltawsky KM, Kruger M, Starke C, Heuser L, Ermert H, Jensen A. Freehand ultrasound elastography of breast lesions: Clinical results. Ultrasound Med Biol. 2001;27(11):1461–9. pmid:11750744
- 14. Doyley MM, Bamber JC, Fuechsel F, Bush NL. A freehand elastographic imaging approach for clinical breast imaging: System development and performance evaluation. Ultrasound Med Biol. 2001;27(10):1347–57. pmid:11731048
- 15. Hall TJ, Zhu YN, Spalding CS. In vivo real-time freehand palpation imaging. Ultrasound Med Biol. 2003;29(3):427–35. pmid:12706194
- 16. Lindop JE, Graham MT, Gee AH, Prager RW. 3D elastography using freehand ultrasound. Ultrasound Med Biol. 2006;32(4):529–45. pmid:16616600
- 17. Rivaz H, Boctor EM, Choti MA, Hager GD. Real-Time Regularized Ultrasound Elastography. Ieee T Med Imaging. 2011;30(4):928–45.
- 18. Basarab A, Liebgott H, Morestin F, Lyshchik A, Higashi T, Asato R, et al. A method for vector displacement estimation with ultrasound imaging and its application for thyroid nodular disease. Med Image Anal. 2008;12(3):259–74. pmid:18065256
- 19. Viola F, Walker WF. A comparison of the performance of time-delay estimators in medical ultrasound. IEEE Trans Ultrason Ferroelectr Freq Control. 2003;50(4):392–401. Epub 2003/05/15. pmid:12744395.
- 20. Greenleaf JF, Fatemi M, Insana M. Selected methods for imaging elastic properties of biological tissues. Annual Review of Biomedical Engineering. 2003;5:57–78. pmid:12704084
- 21. Lindop JE, Treece GM, Gee AH, Prager RW. Phase-based ultrasonic deformation estimation. Ieee T Ultrason Ferr. 2008;55(1):94–111.
- 22. Pesavento A, Perrey C, Krueger M, Ermert H. A time-efficient and accurate strain estimation concept for ultrasonic elastography using iterative phase zero estimation. Ieee T Ultrason Ferr. 1999;46(5):1057–67.
- 23. Pellot-Barakat C, Frouin F, Insana MF, Herment A. Ultrasound elastography based on multiscale estimations of regularized displacement fields. Medical Imaging, IEEE Transactions on. 2004;23(2):153–63.
- 24. Yeung F, Levinson SF, Parker KJ. Multilevel and motion model-based ultrasonic speckle tracking algorithms. Ultrasound Med Biol. 1998;24(3):427–41. pmid:9587997
- 25. Insana MF, Cook LT, Chaturvedi P. Analytical study of bioelasticity ultrasound systems. Information Processing in Medical Imaging, Proceedings. 1999;1613:1–14.
- 26. Chaturvedi P, Insana MF, Hall TJ. Testing the limitations of 2-D companding for strain imaging using phantoms. Ultrasonics, Ferroelectrics and Frequency Control, IEEE Transactions on. 1998;45(4):1022–31.
- 27. Maurice RL, Bertrand M. Lagrangian speckle model and tissue-motion estimation—theory. IEEE Trans Med Imaging. 1999;18(7):593–603. Epub 1999/09/30. pmid:10504093.
- 28. Chen LJ, Treece GM, Lindop JE, Gee AH, Prager RW. A quality-guided displacement tracking algorithm for ultrasonic elasticity imaging. Med Image Anal. 2009;13(2):286–96. pmid:19081285
- 29. Jiang J, Hall TJ. A parallelizable real-time motion tracking algorithm with applications to ultrasonic strain imaging. Phys Med Biol. 2007;52(13):3773–90. pmid:17664576
- 30. Zhu YN, Hall TJ. A modified block matching method for real-time freehand strain imaging. Ultrasonic Imaging. 2002;24(3):161–76. pmid:12503771
- 31. Chen H, Shi HR, Varghese T. Improvement of elastographic displacement estimation using a two-step cross-correlation method. Ultrasound Med Biol. 2007;33(1):48–56. pmid:17189046
- 32. Doyley MM. Model-based elastography: a survey of approaches to the inverse elasticity problem. Phys Med Biol. 2012;57(3):R35–R73. pmid:22222839
- 33. Lopata RGP, Nillesen MM, Hansen HHG, Gerrits IH, Thijssen JM, de Korte CL. Performance Evaluation of Methods for Two-Dimensional Displacement and Strain Estimation Using Ultrasound Radio Frequency Data. Ultrasound Med Biol. 2009;35(5):796–812. pmid:19282094
- 34. Yang X, Torres M, Kirkpatrick S, Curran WJ, Liu T. Ultrasound 2D strain estimator based on image registration for ultrasound elastography. Proc SPIE 9040. 2014;9040:904018–10.
- 35. Rueckert D, Sonoda LI, Hayes C, Hill DLG, Leach MO, Hawkes DJ. Nonrigid registration using free-form deformations: Application to breast MR images. Ieee T Med Imaging. 1999;18(8):712–21. pmid:10534053
- 36. Yang X, Wu N, Cheng G, Zhou Z, Yu DS, Beitler JJ, et al. Automated Segmentation of the Parotid Gland Based on Atlas Registration and Machine Learning: A Longitudinal MRI Study in Head-and-Neck Radiation Therapy. Int J Radiat Oncol Biol Phys. 2014;90(5):1225–33. Epub 2014/12/03. pmid:25442347.
- 37. Lee S, Wolberg G, Shin SY. Scattered data interpolation with multilevel B-splines. Ieee Transactions on Visualization and Computer Graphics. 1997;3(3):228–44.
- 38. Bookstein FL. Principal Warps—Thin-Plate Splines and the Decomposition of Deformations. Ieee T Pattern Anal. 1989;11(6):567–85.
- 39. Studholme C, Hill DL, Hawkes DJ. Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. Med Phys. 1997;24(1):25–35. Epub 1997/01/01. pmid:9029539.
- 40.
Forsey DR, Bartels RH. Hierarchical B-spline refinement. Proceedings of the 15th annual conference on Computer graphics and interactive techniques. 378512: ACM; 1988. p. 205–12.
- 41. Arbuck SG, Ivy P, Setser A, Eisenhauer E, Wanders J, Comm CTCR. Common toxicity criteria (CTC) version 2.0: Highlights and tools. Ann Oncol. 1998;9:12–.
- 42. Richards MS, Doyley MM. Non-Rigid Image Registration Based Strain Estimator for Intravascular Ultrasound Elastography. Ultrasound Med Biol. 2013;39(3):515–33. pmid:23245827
- 43. Piella G, De Craene M, Butakoff C, Grau V, Yao C, Nedjati-Gilani S, et al. Multiview diffeomorphic registration: Application to motion and strain estimation from 3D echocardiography. Med Image Anal. 2013;17(3):348–64. pmid:23410512
- 44. De Craene M, Piella G, Camara O, Duchateau N, Silva E, Doltra A, et al. Temporal diffeomorphic free-form deformation: application to motion and strain estimation from 3D echocardiography. Med Image Anal. 2012;16(2):427–50. Epub 2011/12/06. pmid:22137545.
- 45. Almeida NM, Slagmolen P, Barbosa D, Scheys L, Geukens L, Fukagawa S, et al. Tendon strain imaging using non-rigid image registration: a validation study. Proc Spie. 2012;8320.
- 46. Rappaport D, Adam D, Lysyansky P, Riesner S. Assessment of myocardial regional strain and strain rate by tissue tracking in B-mode echocardiograms. Ultrasound Med Biol. 2006;32(8):1181–92. pmid:16875953
- 47. Suhling M, Arigovindan M, Jansen C, Hunziker P, Unser M. Myocardial motion analysis from B-mode echocardiograms. Ieee T Image Process. 2005;14(4):525–36.
- 48.
Basarab A, Aoudi W, Liebgott H, Vray D, Delachartre P, editors. Parametric Deformable Block Matching for Ultrasound Imaging. Image Processing, 2007 ICIP 2007 IEEE International Conference on; 2007 Sept. 16 2007-Oct. 19 2007.
- 49. Zhu YN, Chaturvedi P, Insana MF. Strain imaging with a deformable mesh. Ultrasonic Imaging. 1999;21(2):127–46. pmid:10485566
- 50. Liang Y, Zhu H, Friedman MH. Measurement of the 3D arterial wall strain tensor using intravascular B-mode ultrasound images: a feasibility study. Phys Med Biol. 2010;55(21):6377–94. pmid:20938066
- 51. Elen A, Choi HF, Loeckx D, Gao H, Claus P, Suetens P, et al. Three-Dimensional Cardiac Strain Estimation Using Spatio-Temporal Elastic Registration of Ultrasound Images: A Feasibility Study. Ieee T Med Imaging. 2008;27(11):1580–91. pmid:18955174
- 52. Chandrashekara R, Mohiaddin RH, Rueckert D. Analysis of 3-D myocardial motion in tagged MR images using nonrigid image registration. Ieee T Med Imaging. 2004;23(10):1245–50. pmid:15493692
- 53. Ledesma-Carbayo MJ, Kybic J, Desco M, Santos A, Suhling M, Hunziker P, et al. Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation. Ieee T Med Imaging. 2005;24(9):1113–26. pmid:16156350
- 54. Varghese T, Ophir J. An analysis of elastographic contrast-to-noise ratio. Ultrasound Med Biol. 1998;24(6):915–24. pmid:9740393
- 55. Treece G, Lindop J, Chen LJ, Housden J, Prager R, Gee A. Real-time quasi-static ultrasound elastography. Interface Focus. 2011;1(4):540–52. pmid:22866230
- 56. Varghese T, Ophir J, Cespedes I. Noise reduction in elastograms using temporal stretching with multicompression averaging. Ultrasound Med Biol. 1996;22(8):1043–52. pmid:9004428
- 57. Odonnell M, Skovoroda AR, Shapo BM, Emelianov SY. Internal Displacement and Strain Imaging Using Ultrasonic Speckle Tracking. Ieee T Ultrason Ferr. 1994;41(3):314–25.
- 58. Skovoroda AR, Lubinski MA, Emelianov SY, O'Donnell M. Reconstructive elasticity imaging for large deformations. Ieee T Ultrason Ferr. 1999;46(3):523–35.
- 59. Deprez JF, Brusseau E, Basset O. 3D Strain Imaging Method Adapted to Large Deformations and Freehand Scanning. Ultrason. 2008:544–7.
- 60. Konofagou EE, Harrigan TP, Ophir J, Krouskop TA. Poroelastography: Imaging the poroelastic properties of tissues. Ultrasound Med Biol. 2001;27(10):1387–97. pmid:11731052
- 61.
Hennessy R, Koo C, Ton P, Han A, Righetti R, Maitland KC. Particle velocity measurements with macroscopic fluorescence imaging in lymph tissue mimicking microfluidic phantoms. Proc SPIE 7892, Multimodal Biomedical Imaging VI. 2011:78920R-R-7.
- 62. Righetti R, Ophir J, Srinivasan S, Krouskop TA. The feasibility of using elastography for imaging the Poisson's ratio in porous media. Ultrasound Med Biol. 2004;30(2):215–28. pmid:14998674
- 63. Righetti R, Garra BS, Mobbs LM, Kraemer-Chant CM, Ophir J, Krouskop TA. The feasibility of using poroelastographic techniques for distinguishing between normal and lymphedematous tissues in vivo. Phys Med Biol. 2007;52(21):6525–41. pmid:17951860