Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Contrast-enhanced ultrasound for the differential diagnosis of thyroid nodules: An updated meta-analysis with comprehensive heterogeneity analysis

  • Juanjuan Zhang ,

    Roles Investigation, Methodology, Writing – original draft

    ‡ JZ and XZ These authors are co-first author.

    Affiliation Department of Ultrasound, Huaihe Hospital of Henan University, Henan, China

  • Xiuting Zhang ,

    Roles Methodology, Software, Writing – original draft

    ‡ JZ and XZ These authors are co-first author.

    Affiliation Department of Ultrasound, First Affiliated Hospital of Zhengzhou University, Zhengzhou, China

  • Yanna Meng,

    Roles Data curation, Investigation, Methodology

    Affiliation Department of Ultrasound, Huaihe Hospital of Henan University, Henan, China

  • Yinghong Chen

    Roles Project administration, Writing – review & editing

    zc000zc@126.com

    Affiliation Department of Ultrasound, Huaihe Hospital of Henan University, Henan, China

Contrast-enhanced ultrasound for the differential diagnosis of thyroid nodules: An updated meta-analysis with comprehensive heterogeneity analysis

  • Juanjuan Zhang, 
  • Xiuting Zhang, 
  • Yanna Meng, 
  • Yinghong Chen
PLOS
x

Abstract

The diagnostic accuracy of contrast-enhanced ultrasound (CEUS) for distinguishing malignant thyroid nodules from benign thyroid nodules remains controversial. This meta-analysis was performed to evaluate the overall diagnostic value of CEUS for the characterization of thyroid nodules. Relevant studies were identified by searching PubMed, Embase and the Cochrane Library until August 1th 2019 to assess the overall diagnostic accuracy of CEUS. 37 eligible studies were included in the present meta-analysis. The pooled sensitivity, specificity, positive likelihood rate, negative likelihood rate and diagnostic odds ratio of CEUS were 0.87, 0.83, 5.38, 0.17 and 38.94, respectively, with the AUC of 0.9263. Subgroup analysis showed the heterogeneity was greatly reduced in small nodules group (≤ 1 cm) (I2 = 0.0%), while heterogeneity was still observed in the group of variable sizes group (I2 = 69.5%). However, meta-regression analysis revealed that only diagnostic criterion was the major source of heterogeneity (p = 0.0259). The risk of publication bias was negligible (p = 0.35). CEUS exhibited high accuracy for the identification of thyroid nodules and might provide additional perfusion information for the current US imaging reporting systems.

Introduction

A thyroid nodule, by definition, is a discrete lesion within the thyroid gland, which is radiographically distinct from the surrounding thyroid parenchyma [1]. With the increased utilization of diagnostic imaging (ultrasound (US), computed tomography (CT) or magnetic resonance imaging (MRI)) unrelated to the thyroid, the prevalence of thyroid incidentaloma has been significantly increased in the past twenty years [2,3]. For instance, the proportion of patients with thyroid nodules that clinicians now encounter is as high as 68% of the general population [4]. The major clinical issue in managing thyroid nodules is to maximize the detection of relevant thyroid cancer while reducing unnecessary overdiagnosis and overtreatment [5,6].

Several diagnostic tools have been used to identify nodules. Fine needle aspiration biopsy (FNAB) is widely adopted by clinicians as a simple way of diagnosing thyroid nodules [2]. However, this invasive technique may have false positive or negative outcomes, and about 10% to 20% of thyroid nodules could not be diagnosed [7]. Conventional US is the first-line diagnostic tool for initial cancer risk stratification of thyroid nodules [2,7]. Certain ultrasound features associated with malignancy include solid composition, hypoechogenicity, infiltrative or irregular margins, intranodular blood flow, microcalcification and “taller-than-wide” configuration [7,8]. However, one single ultrasound characteristic has inadequate sensitivity or specificity to identify or rule out malignant tumors. For example, microcalcification has the highest positive predictive value (PPV) among the above ultrasound features, but it has low sensitivity and only exists in 26% to 59% thyroid cancers [9]. In order to increase diagnosis confidence, the American Thyroid Association (ATA), American College of Radiologists (ACR) and other professional groups have proposed several systems to classify nodules by sonographic features and to recommend cutoffs for FNAB [2]. Among them, the thyroid imaging reporting and data system (TI-RADS) is a simple and practical reporting system created by ACR [10]. Horvath [11] and Kwak [12] indicated TI-RADS could be used to improve diagnostic accuracy, reduce unnecessary biopsies and follow-up scans, and ultimately improve management of patients with thyroid nodules. Despite TI-RADS has achieved great clinical value, it still suffers inherent flaws, such as dependence on experience, poor repeatability and high heterogeneity among sonographers [7].

Advances in US technology may facilitate better characterization of benign and malignant thyroid nodules. Contrast-enhanced ultrasound (CEUS) is currently the focus of medical US research, because it can show microvascular blood flow clearly and assess tumor perfusion and vascular distribution in real time after intravenous injection of microbubble contrast agent (CA) [13]. It is well known that the thyroid gland is rich in microvessels, thus the parenchyma of normal thyroid exhibits rapid uniform enhancement after injection of CA [14]. However, the vascular structures of nodules differ from normal tissues, which enhance their differences from normal tissues [14]. Several studies [15,16] revealed specific CEUS enhancement patterns (such as heterogeneous or low enhancement) were related to malignant thyroid nodules (Fig 1). Unfortunately, not all studies confirmed these results [17]. Furthermore, CEUS presents some limitations: the examination is expensive, only one nodule can be evaluated for each injection of CA, and there was no established criterion for the patterns of enhancement and classification of thyroid nodules, resulting in the inability to be widely-used worldwide [14]. Besides, the current thyroid nodule imaging reporting systems, including the widely-used TI-RADS, do not contain CEUS enhancement patterns as the evaluation item [2], making it controversial in clinical practice. Therefore, the present comprehensive meta-analysis was conducted to investigate the value of CEUS for distinguishing malignant thyroid nodules from benign ones, hoping to provide evidence for the new TI-RADS classification system including CEUS features.

thumbnail
Fig 1.

(A~C) A 35-year -old man was found to have a solid nodule in the left lobe of his thyroid. (A) The conventional two-dimensional image showed the nodule had three malignant indicators (solid, markedly hypoechoic, and microcalcifications). (B) CEUS image showed high enhancement of the nodule, indicating that the nodule was benign. (C) The pathological result revealed this lesion was a nodular goiter. (D~F) A 42-year-old woman was found to have a solid nodule in her left thyroid lobe. (D) The conventional two-dimensional image showed the nodule had two malignant indicators (solid and irregular margin). (E) CEUS image showed low enhancement of the nodule, indicating that the nodule was malignant. (F) The pathological result revealed this lesion was a thyroid papillary carcinoma [15]. From Zhang et al. (2017) Usefulness of combined use of contrast-enhanced ultrasound and TI-RADS classification for the differentiation of benign from malignant lesions of thyroid nodules. Eur Radiol 27: 1527–1536. doi: 10.1007/s00330-016-4508-y.

https://doi.org/10.1371/journal.pone.0231775.g001

Methods

This present meta-analysis was conducted following the PRISMA statement. No institutional review board approval is required, as our study was a systematic review and meta-analysis, thus obtaining consent was exempted for this study.

Literature search

A comprehensive search was undertaken to identify suitable articles from electronic databases (the PubMed, Embase, and Cochrane Library) without an upper-limit date until August 1th, 2019. Searches were performed using the following MeSH heading and key words: “thyroid” and “CEUS or contrast-enhanced ultrasound or contrast-enhanced US or contrast-enhance Doppler ultrasonography or contrast-enhanced ultrasonography”. Additionally, manual retrieval was also performed on references of related reviews.

Eligibility and exclusion criteria

After removing duplicate studies, two authors independently reviewed the titles and abstracts based on the following inclusion and exclusion criteria. (A) inclusion criteria: (1) related to the diagnostic value of CEUS for thyroid nodules; (2) all patients were diagnosed with histopathology as the gold standard; (3) reported data were sufficient to calculate the true-positive (TP), false-negative (FN), false-positive (FP) and true-negative (TN). (B) exclusion criteria: (1) studies not published in English; (2) duplicated publications or incomplete data; (3) reviews, letters, case reports and editorials; (4) studies not performed on human subjects. When two authors’ opinions differed, the disagreements would be resolved by consensus.

Data extraction and quality evaluation

Full texts of eligible studies were screened and data were extracted using a standardized form for the final meta-analysis. The detailed information including first author, publication year, country, specimen, sample size (both lesions and patients), gold standard, diagnostic criterion, type and dosage of contrast agent, TP, FP, TN, FN and any other additional information required for quality evaluation.

The methodological quality of eligible studies was assessed by the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) criteria, which are recommended for diagnostic systematic reviews based on sources of bias and variation.

Statistical analysis

The statistical softwares Meta-Disc (version 1.4, XI Cochrane Colloquium, Barcelona, Spain) and STATA (version 11.0, Stata Corporation, College Station, TX, USA) were used in this meta-analysis. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and their corresponding 95% confidence intervals (CI) were calculated by certain formulae composed of TP, FP, TN and FN. Besides, the summary receiver operating characteristic (SROC) curve and areas under curve (AUC) were also constructed. The heterogeneity of included studies was investigated using I2 and Q tests. The random-effects model (DerSimonian-Laird method) was used because the heterogeneity was significant in this meta-analysis. Spearman correlation coefficient was calculated to analyze the diagnostic threshold. Subgroup analysis and meta-regression analysis were subsequently performed to assess the variabilities attributed to heterogeneity. Publication bias was investigated by Deeks’ funnel plot analysis. Two-sided statistical tests were performed, with a p value < 0.05 representing statistically significant.

Results

Study selection

Initial electronic search identified 701 records, 311 from PubMed, 381 from Embase and 9 from Cochrane. After automatically and manually removing the duplicates, 448 studies were left for initial screening. Depending on the inclusion and exclusion criteria, 384 studies were excluded. Full texts of the remaining 64 studies were left for further reviewing. Finally, 37 [1416, 1851] studies were identified as eligible studies. The search and selection process for this meta-analysis was shown in Fig 2.

Characteristics and quality assessment of the included studies

The basic characteristics of the included 37 studies were summarized in Table 1. The publication year of studies ranged from 2010 to 2019. These studies were from 4 countries, most of them (29 studies) were done in Asia (all from China), the rest 8 were from Europe (5 from Italy, 2 from Germany and 1 from Austria). The average age of all included patients was under 60. The number of lesions varied from 20 to 432, and the number of patients varied from 20 to 370. Most of the malignant lesions were papillary carcinomas, and most of the benign lesions were nodular goiters and adenomas. Most of contrast agents used in the studies were Sonovue, except for two studies that did not mention the specific brand. The dosages of contrast agent ranged from 1 to 5 mL. QUADAS scores were also summarized in Table 1.

thumbnail
Table 1. Basic characteristics and quality assessment of the eligible studies included in this meta-analysis.

https://doi.org/10.1371/journal.pone.0231775.t001

The overall diagnostic accuracy

Analysis of CEUS for characterizing thyroid nodules showed that the pooled sensitivity was 0.87 (95%CI: 0.86–0.88), and specificity was 0.83 (95%CI: 0.82–0.85) (Fig 3). The pooled PLR, NLR and DOR were 5.38 (95%CI: 4.28–6.76) and 0.17 (95%CI: 0.14–0.20), 38.94 (95%CI: 27.69–54.75), respectively (S1 Fig). Fig 4 illustrated the SROC curve with AUC to be 0.9263, which was close to 1, indicating CEUS as a useful diagnostic tool to distinguish malignant from benign thyroid nodules. As seen in the forest plots (Fig 3 and S1 Fig), all indices of diagnostic accuracy denoted heterogeneity of the included studies. There was no threshold effect by calculating spearman correlation coefficient (r = -0.093, p = 0.585).

thumbnail
Fig 3.

Sensitivity (A) and specificity (B) of CEUS for characterizing thyroid nodules.

https://doi.org/10.1371/journal.pone.0231775.g003

Subgroup analysis and meta-regression analysis

Because the DOR is a single estimate which combines the data from sensitivity and specificity, the pooled DOR was calculated to present the diagnostic accuracy. Several potential factors were explored to show their abilities in affecting the diagnostic accuracy. As the results listed in Table 2, region, number of lesions, size of nodules and CA dosage greatly influenced the diagnostic accuracy. DOR of Asian country (all from China) was improved than it from Western countries (45.85 vs. 16.31). Similarly, the higher the number of lesions, the higher the diagnostic efficiency (46.52 vs. 26.65). And DOR of low CA dosage group was higher than them of high CA dosage group and variable dosage group (50.96 vs. 34.71 vs. 34.71). However, great heterogeneity was observed in all above groups (I2 all > 50%). Besides, size of nodules also greatly affected the diagnostic accuracy of included studies (Fig 5). DOR of variable sizes group was higher than small nodules group (41.48 vs. 21.42). However, the heterogeneity was greatly reduced in small nodules group (≤ 1 cm) (I2 = 0.0%), while great heterogeneity was observed in the group of variable sizes of nodules (I2 = 69.5%). Diagnostic accuracy was equivalent according to different diagnostic criterion. When Sonographers characterized the thyroid nodules by visual features (such as heterogeneous enhancement was identified as malignancy), its overall diagnostic accuracy was the same as when using quantitative or semi-quantitative parameters (both DOR were 53.46). However, great heterogeneity was observed in both above groups (both I2 were 64.4%).

thumbnail
Fig 5.

Subgroup analysis of DOR for small nodules (A) and variable sizes of nodules (B) in characterization of thyroid nodules.

https://doi.org/10.1371/journal.pone.0231775.g005

thumbnail
Table 2. Subgroup analysis of DOR of CEUS for the diagnostic performance of thyroid nodules.

https://doi.org/10.1371/journal.pone.0231775.t002

Meta-regression analysis was also performed to take all the above factors into account. As seen in Table 3, diagnostic criterion was the major source of heterogeneity (p = 0.0259). However, size of nodules was not the source of heterogeneity (p = 0.1084).

thumbnail
Table 3. Meta-regression analysis of potential sources of heterogeneity.

https://doi.org/10.1371/journal.pone.0231775.t003

Publication bias

A Deeks’ funnel plot was generated to assess the publication bias of the 37 eligible studies. As seen in Fig 6, the plot was symmetric, indicating that there was no potential publication bias for the included studies (p = 0.35).

Discussion

The diagnostic accuracy of CEUS

Early diagnosis and correct identification of thyroid cancer has great importance for clinical treatment regimens and may improve the prognosis [32]. However, differentiating malignancy from benign thyroid nodules remains the challenging dilemma. The combination of several suspicious US characteristics can further improve the diagnostic accuracy than one single US characteristic. A large number of studies have used TI-RADS system to predict malignant thyroid nodules [12,13]. But this system is still limited to different US criterion and inevitable inter-observer variability, making its sensitivity and specificity compromised. CEUS promises to bring additional diagnostic power to this conventional imaging modality with its high sensitivity for detecting the microvascularization of thyroid carcinomas [15]. Zhang [15] and Zhao [18] implied CEUS had complementary effects to the TI-RADS system, which improved the differential diagnosis of thyroid nodules. Jiang [38] also demonstrated CEUS could even provide a basis for determining which nodules should undergo fine needle aspiration (FNA). Whereas, Friedrich-Rust [52] indicated that CEUS did not improve the characterization of thyroid nodules in their preliminary study. Because of these conflicting studies, clinicians are often confused when they choose imaging techniques. Therefore, a comprehensive meta-analysis is in an urgent need to summarize all current results to determine the role of CEUS for characterizing thyroid nodules. Despite Liu et al [53] (search date was May 2018) and Ma et al [54] (search date was December 2013) had published their meta-analyses on this topic, we noticed there were repeated studies included in both researches, which compromised the diagnostic performance. Additionally, significant heterogeneity existed in both studies, but neither of them pursued its source. However, heterogeneity analysis is very important, it is an essential part of systematic review, and it can provide a basis for assessment of diagnostic research. For these reasons, an updated meta-analysis was performed, including more preliminary studies and comprehensive heterogeneity analysis to assess the performance of CEUS in identifying benign and malignant thyroid nodules.

Our results showed that CEUS had high pooled sensitivity and specificity (0.87 and 0.83) with AUC of 0.9263, indicating it could be a considerable tool in the diagnosis of thyroid nodules. Moreover, funnel plot analysis revealed absence of publication bias, which strengthened the validity of the study. However, there was great heterogeneity of included studies, which might compromise the credibility. Thus, subgroup and meta-regression analyses were conducted to reveal potential sources of heterogeneity.

Heterogeneity analysis of this meta-analysis

Subgroup analysis showed great heterogeneity in the variable-sized nodule group (I2 = 69.5%), while the small nodule group (≤1 cm) was significantly reduced (I2 = 0.0%). Unfortunately, meta-regression analysis did not show that nodular size was a source of heterogeneity. Several studies reported that CEUS features were closely related to nodule size [31, 39]. Yuan et al [39] implied in thyroid cancers less than 1 cm in diameter, the hypoenhancement was more common than thyroid cancers with diameters greater than 2 cm. Ma’s [31] research showed that heterogeneous enhancement was an independent predictor for predicting papillary thyroid microcarcinoma (PTMC). In all eligible studies, there were three studies [31, 39, 42] focused on the diagnosis of PTMC from small nodules (≤ 1 cm). Among them, two studies [31, 42] used heterogeneous enhancement as the diagnostic criterion for PTMC, the remaining one [39] considered inhomogeneous perfusion and whole course low enhancement as the diagnostic indicators for PTMC. Due to similar diagnostic criterion, the heterogeneity was greatly reduced in this group (I2 = 0.0%), while great heterogeneity was still observed in the group of variable sizes of nodules (I2 = 64.5%). However, Li [39] demonstrated that CEUS had no significant advantage in characterizing PTMC for the following reasons: firstly, there were overlapped CEUS perfusion features in small malignant and benign nodules; secondly, small malignant tumors might not exhibit typical characteristics of malignancies; thirdly, the instrument sensitivity, adjustments and parameters employed during the process of imaging might fail to meet diagnostic level at present. Similar to the above hypotheses, our subgroup analysis showed relatively lower diagnostic accuracy for small nodules group than variable sizes group (DOR: 24.42 vs. 41.48).

Meta-regression analysis revealed diagnostic criterion was the major factor which contributed to the great heterogeneity. All diagnostic criteria of included studies could be divided into two categories: visual features and quantitative or semi-quantitative parameters. Most of the studies (24 studies) used visual features (perfusion characteristics observed by sonographer observed during the procedure) to differentiate thyroid nodules, which were usually low or weak enhancement pattern, heterogeneous enhancement pattern and ill-defined enhancement border. Because papillary thyroid cancers (PTC) account for the vast majority of thyroid cancers, their characteristics contributed to the main diagnostic criterion. According to these studies, most thyroid cancers showed hypoenhancement due to insufficient blood supply in PTC [8]. The necrosis inside the cancer, blocked blood vessels by cancer embolus, intensive interstitial fibrosis and thyroid peripheral calcification may all lead to the hypoenhancement feature of CEUS in thyroid cancers [27]. While benign nodules (such as nodular goiters and adenomas) usually have enhanced perfusion, homogeneous enhancement and no perfusion defects because of their rich blood supply [30]. Our meta-analysis results showed visual features had favorable ability to identify malignant nodules with DOR of 53.46, however, the heterogeneity of this group was still considerable (I2 = 64.4%). With the introduction of ultrasound software and computer-aided diagnosis (CAD) technology, quantitative or semi-quantitative parameters derived from series of CEUS images are believed to provide more valuable information for blood flow observation than visualization [27]. Commonly used parameters are derived from the time-intensity curve. Zhou [26] showed the nodule-to-perinodule peak intensity ratio had the best diagnostic efficiency for identifying malignant thyroid nodules. Jin [27] utilized the image heterogeneity calculation equation to calculate the heterogeneity values (HVs) and heterogeneity ratios (HRs), which were quantifications of nodular heterogeneity enhancement. And their results revealed the heterogeneity quantifications had lower sensitivity (0.72 vs. 0.83), but higher specificity (0.83 vs. 0.66) and diagnostic accuracy (0.78 vs. 0.74) than visual assessment. Whereas, the parameters used in their studies were quite different from one by one, which might lead to great heterogeneity (I2 = 64.4%) in this group (quantitative or semi-quantitative parameters). Therefore, diagnostic criterion would need further investigation and standardization. Especially, standardized diagnostic parameters need to be determined and validated in the future.

Conclusion

In conclusion, CEUS might be a promising method for identifying the malignancy from benign thyroid nodules. Yet, there is still insufficient evidence that CEUS features can improve the diagnostic accuracy of US imaging reporting systems (such as TI-RADS) at present, our meta-analysis provided the potential for forward-looking, multi-center and large-scale CEUS studies in the future.

Supporting information

S1 Fig.

PLR (A), NLR (B) and DOR (C) of CEUS for characterizing thyroid nodules.

https://doi.org/10.1371/journal.pone.0231775.s002

(TIF)

Acknowledgments

We sincerely thank Mr. Lunshou Wei from the Huaihe Hospital of Henan University (Kaifeng, China), for his support with respect to the drafting of the manuscript.

References

  1. 1. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016; 26: 1–133. pmid:26462967
  2. 2. Durante C, Grani G, Lamartina L, Filetti S, Mandel SJ, Cooper D. The Diagnosis and Management of Thyroid Nodules: A Review. JAMA. 2018; 319:914–924. pmid:29509871
  3. 3. Li Q, Lin X, Shao Y, Xiang F, Samir AE. Imaging and Screening of Thyroid Cancer. Radiol Clin North Am. 2017; 55: 1261–1271. pmid:28991565
  4. 4. Guth S, Theune U, Aberle J, Galach A, Bamberger CM. Very high prevalence of thyroid nodules detected by high frequency (13 MHz) ultrasound examination. Eur J Clin Invest. 2009; 39: 699–706. pmid:19601965
  5. 5. Tamhane S, Gharib H. Thyroid nodule update on diagnosis and management. Clin Diabetes Endocrinol. 2016; 2: 17. pmid:28702251
  6. 6. Ozolins A, Narbuts Z, Strumfa I, Volanska G, Gardovskis J. Diagnostic utility of immunohistochemical panel in various thyroid pathologies. Langenbecks Arch Surg. 2010; 395: 885–891. pmid:20640858
  7. 7. Melany M, Chen S. Thyroid Cancer: Ultrasound Imaging and Fine-Needle Aspiration Biopsy. Endocrinol Metab Clin North Am. 2017; 46: 691–711. pmid:28760234
  8. 8. Moon HJ, Sung JM, Kim EK, Yoon JH, Youk JH, Kwak JY. Diagnostic performance of gray-scale US and elastography in solid thyroid nodules. Radiology. 2012; 262: 1002–1013. pmid:22357900
  9. 9. Bastin S, Bolland MJ, Croxson MS. Role of ultrasound in the assessment of nodular thyroid disease. J Med Imaging Radiat Oncol. 2009; 53: 177–187. pmid:19527364
  10. 10. Tessler FN, Middleton WD, Grant EG, Hoang JK, Berland LL, Teefey SA, et al. ACR Thyroid Imaging, Reporting and Data System (TI-RADS): White Paper of the ACR TI-RADS Committee. J Am Coll Radiol. 2017; 14: 587–595. pmid:28372962
  11. 11. Horvath E, Majlis S, Rossi R, Franco C, Niedmann JP, Castro A, et al. An ultrasonogram reporting system for thyroid nodules stratifying cancer risk for clinical management. J Clin Endocrinol Metab. 2009; 94: 1748–1751. pmid:19276237
  12. 12. Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH, et al. Thyroid imaging reporting and data system for US features of nodules: a step in establishing better stratification of cancer risk. Radiology. 2011; 260: 892–989. pmid:21771959
  13. 13. Greis C. Quantitative evaluation of microvascular blood flow by contrast-enhanced ultrasound (CEUS). Clin Hemorheol Microcirc. 2011; 49: 137–149. pmid:22214685
  14. 14. Giusti M, Orlandi D, Melle G, Massa B, Silvestri E, Minuto F, et al. Is there a real diagnostic impact of elastosonography and contrast-enhanced ultrasonography in the management of thyroid nodules? J Zhejiang Univ Sci B. 2013; 14: 195–206. pmid:23463762
  15. 15. Zhang Y, Zhou P, Tian SM, Zhao YF, Li JL, Li L. Usefulness of combined use of contrast-enhanced ultrasound and TI-RADS classification for the differentiation of benign from malignant lesions of thyroid nodules. Eur Radiol. 2017; 27: 1527–1536. pmid:27525973
  16. 16. Wang Y, Nie F, Liu T, Yang D, Li Q, Li J, et al. Revised Value of Contrast-Enhanced Ultrasound for Solid Hypo-Echoic Thyroid Nodules Graded with the Thyroid Imaging Reporting and Data System. Ultrasound Med Biol. 2018; 44: 930–940. pmid:29472113
  17. 17. Hu Y, Li P, Jiang S, Li F. Quantitative analysis of suspicious thyroid nodules by contrast-enhanced ultrasonography. Int J Clin Exp Med. 2015; 8: 11786–11793. pmid:26380019
  18. 18. Zhao H, Liu X, Lei B, Cheng P, Li J, Wu Y, et al. Diagnostic performance of thyroid imaging reporting and data system (TI-RADS) alone and in combination with contrast-enhanced ultrasonography for the characterization of thyroid nodules. Clin Hemorheol Microcirc. 2019; 72: 95–106. pmid:30320563
  19. 19. Xu Y, Qi X, Zhao X, Ren W, Ding W. Clinical diagnostic value of contrast-enhanced ultrasound and TI-RADS classification for benign and malignant thyroid tumors: One comparative cohort study. Medicine (Baltimore). 2019; 98: e14051.
  20. 20. He Y, Wang XY, Hu Q, Chen XX, Ling B, Wei HM. Value of Contrast-Enhanced Ultrasound and Acoustic Radiation Force Impulse Imaging for the Differential Diagnosis of Benign and Malignant Thyroid Nodules. Front Pharmacol. 2018; 9: 1363. pmid:30542283
  21. 21. Tian Q, Zhu H, Li H. Significance of contrast-enhanced ultrasonography in differential diagnosis of thyroid nodules. Medicine (Baltimore). 2018; 97: e12688.
  22. 22. Wang Y, Nie F, Liu T, Yang D, Li Q, Li J, et al. Revised Value of Contrast-Enhanced Ultrasound for Solid Hypo-Echoic Thyroid Nodules Graded with the Thyroid Imaging Reporting and Data System. Ultrasound Med Biol. 2018; 44: 930–940. pmid:29472113
  23. 23. Zhang Y, Zhang MB, Luo YK, Li J, Wang ZL, Tang J. The Value of Peripheral Enhancement Pattern for Diagnosing Thyroid Cancer Using Contrast-Enhanced Ultrasound. Int J Endocrinol 2018; 2018: 1625958. pmid:30627155
  24. 24. Zhao RN, Zhang B, Jiang YX, Yang X, Lai XJ, Zhu SL, et al. Ultrasonographic Multimodality Diagnostic Model of Thyroid Nodules. Ultrason Imaging. 2018; 26: 161734618815070.
  25. 25. Caresio C, Caballo M, Deandrea M, Garberoglio R, Mormile A, Rossetto R, et al. Quantitative analysis of thyroid tumors vascularity: A comparison between 3-D contrast-enhanced ultrasound and 3-D Power Doppler on benign and malignant thyroid nodules. Med Phys. 2018; 45: 3173–3184. pmid:29763966
  26. 26. Zhou X, Zhou P, Hu Z, Tian SM, Zhao Y, Liu W, et al. Diagnostic Efficiency of Quantitative Contrast-Enhanced Ultrasound Indicators for Discriminating Benign From Malignant Solid Thyroid Nodules. J Ultrasound Med. 2018; 37: 425–437. pmid:28880412
  27. 27. Jin L, Xu C, Xie X, Li F, Lv X, Du L. An Algorithm of Image Heterogeneity with Contrast-Enhanced Ultrasound in Differential Diagnosis of Solid Thyroid Nodules. Ultrasound Med Biol. 2017; 43: 104–110. pmid:28029495
  28. 28. Diao X, Zhan J, Chen L, Chen Y, Liu Y. Quantification of solid hypo-echoic thyroid nodule enhancement with contrast-enhanced ultrasound. Transl Cancer Res. 2017; 6: 1078–1087.
  29. 29. Li F, Wang Y, Bai B, Wang S, Liu S. Advantages of Routine Ultrasound Combined With Contrast-Enhanced Ultrasound in Diagnosing Papillary Thyroid Carcinoma. Ultrasound Q. 2017; 33: 213–218. pmid:28832401
  30. 30. Liu MJ, Men YM, Zhang YL, Zhang YX, Liu H. Improvement of diagnostic efficiency in distinguishing the benign and malignant thyroid nodules via conventional ultrasound combined with ultrasound contrast and elastography. Oncol Lett. 2017; 14: 867–871. pmid:28693244
  31. 31. Ma HJ, Yang JC, Leng ZP, Chang Y, Kang H, Teng LH. Preoperative prediction of papillary thyroid microcarcinoma via multiparameter ultrasound. Acta Radiol. 2017; 58: 1303–1311. pmid:28194993
  32. 32. Chen M, Zhang KQ, Xu YF, Zhang SM, Cao Y, Sun WQ. Shear wave elastography and contrast-enhanced ultrasonography in the diagnosis of thyroid malignant nodules. Mol Clin Oncol. 2016; 5: 724–730. pmid:28101352
  33. 33. Zhang Y, Luo YK, Zhang MB, Li J, Li J, Tang J. Diagnostic Accuracy of Contrast-Enhanced Ultrasound Enhancement Patterns for Thyroid Nodules. Med Sci Monit. 2016; 22:4755–4764. pmid:27916971
  34. 34. Sui X, Liu HJ, Jia HL, Fang QM. Contrast-enhanced ultrasound and real-time elastography in the differential diagnosis of malignant and benign thyroid nodules. Exp Ther Med. 2016; 12: 783–791. pmid:27446276
  35. 35. Wendl CM, Janke M, Jung W, Stroszczysnski C, Jung EM. Contrast-enhanced ultrasound with perfusion analysis for the identification of malignant and benign tumours of the thyroid gland. Clin Hemorheol Microcirc. 2015; 63: 113–121. pmid:26519225
  36. 36. Wu Q, Wang Y, Li Y, Hu B, He ZY. Diagnostic value of contrast-enhanced ultrasound in solid thyroid nodules with and without enhancement. Endocrine. 2016; 53: 480–488. pmid:26732040
  37. 37. Zhang YZ, Xu T, Gong HY, Li CY, Ye XH, Lin HJ, et al. Application of high-resolution ultrasound, real-time elastography, and contrast-enhanced ultrasound in differentiating solid thyroid nodules. Medicine (Baltimore). 2016; 95: e5329.
  38. 38. Jiang J, Shang X, Wang H, Xu YB, Gao Y, Zhou Q. Diagnostic value of contrast-enhanced ultrasound in thyroid nodules with calcification. Kaohsiung J Med Sci. 2015; 31:138–144. pmid:25744236
  39. 39. Li F, Zhang J, Wang Y, Liu L. Clinical value of elasticity imaging and contrast-enhanced ultrasound in the diagnosis of papillary thyroid microcarcinoma. Oncol Lett. 2015; 10:1371–1377. pmid:26622676
  40. 40. Yuan Z, Quan J, Yunxiao Z, Jian C, Zhu H. Contrast-enhanced ultrasound in the diagnosis of solitary thyroid nodules. J Cancer Res Ther. 2015; 11: 41–45. pmid:25879334
  41. 41. Schleder S, Janke M, Agha A, Schacherer D, Hornung M, Schlitt HJ, et al. Preoperative differentiation of thyroid adenomas and thyroid carcinomas using high resolution contrast-enhanced ultrasound (CEUS). Clin Hemorheol Microcirc. 2015; 61:13–22. pmid:24898562
  42. 42. Zhao RN, Zhang B, Yang X, Jiang YX, Lai XJ, Zhang XY. Logistic Regression Analysis of Contrast-Enhanced Ultrasound and Conventional Ultrasound Characteristics of Sub-centimeter Thyroid Nodules. Ultrasound Med Biol. 2015; 41: 3102–3108. pmid:26423183
  43. 43. Liang XN, Guo RJ, Li S, Zheng ZM, Liang HD. Binary logistic regression analysis of solid thyroid nodules imaged by high-frequency ultrasonography, acoustic radiation force impulse, and contrast-enhanced ultrasonography. Eur Rev Med Pharmacol Sci. 2014; 18: 3601–3610. pmid:25535129
  44. 44. Giusti M, Campomenosi C, Gay S, Massa B, Silvestri E, Monti E, et al. The use of semi-quantitative ultrasound elastosonography in combination with conventional ultrasonography and contrast-enhanced ultrasonography in the assessment of malignancy risk of thyroid nodules with indeterminate cytology. Thyroid Res. 2014; 7: 9. pmid:25506397
  45. 45. Jiang J, Shang X, Zhang H, Ma W, Xu Y, Zhou Q, et al. Correlation between maximum intensity and microvessel density for differentiation of malignant from benign thyroid nodules on contrast-enhanced sonography. J Ultrasound Med. 2014; 33: 1257–1263. pmid:24958412
  46. 46. Deng J, Zhou P, Tian SM, Zhang L, Li JL, Qian Y. Comparison of diagnostic efficacy of contrast-enhanced ultrasound, acoustic radiation force impulse imaging, and their combined use in differentiating focal solid thyroid nodules. PLoS One. 2014; 9:e90674. pmid:24594879
  47. 47. Ma JJ, Ding H, Xu BH, Xu C, Song LJ, Huang BJ, et al. Diagnostic performances of various gray-scale, color Doppler, and contrast-enhanced ultrasonography findings in predicting malignant thyroid nodules. Thyroid. 2014; 24: 355–363. pmid:23978252
  48. 48. Cantisani V, Consorti F, Guerrisi A, Guerrisi I, Ricci P, Di Segni M, et al. Prospective comparative evaluation of quantitative-elastosonography (Q-elastography) and contrast-enhanced ultrasound for the evaluation of thyroid nodules: preliminary experience. Eur J Radiol. 2013; 82: 1892–1898. pmid:23928231
  49. 49. Acharya UR, Vinitha Sree S, Krishnan MM, Molinari F, Garberoglio R, Suri JS. Non-invasive automated 3D thyroid lesion classification in ultrasound: a class of ThyroScan systems. Ultrasonics. 2012; 52:508–520. pmid:22154208
  50. 50. Nemec U, Nemec SF, Novotny C, Weber M, Czerny C, Krestan CR. Quantitative evaluation of contrast-enhanced ultrasound after intravenous administration of a microbubble contrast agent for differentiation of benign and malignant thyroid nodules: assessment of diagnostic accuracy. Eur Radiol. 2012; 22: 1357–1365. pmid:22322310
  51. 51. Zhang B, Jiang YX, Liu JB, Yang M, Dai Q, Zhu QL, et al. Utility of contrast-enhanced ultrasound for evaluation of thyroid nodules. Thyroid. 2010; 20:51–57. pmid:20067379
  52. 52. Friedrich-Rust M, Sperber A, Holzer K, Diener J, Grünwald F, Badenhoop K, et al. Real-time elastography and contrast-enhanced ultrasound for the assessment of thyroid nodules. Exp Clin Endocrinol Diabetes. 2010; 118: 602–609. pmid:19856256
  53. 53. Liu Q, Cheng J, Li J, Gao X, Li H. The diagnostic accuracy of contrast-enhanced ultrasound for the differentiation of benign and malignant thyroid nodules: A PRISMA compliant meta-analysis. Medicine (Baltimore). 2018; 97: e13325.
  54. 54. Ma X, Zhang B, Ling W, Liu R, Jia H, Zhu F, et al. Contrast-enhanced sonography for the identification of benign and malignant thyroid nodules: Systematic review and meta-analysis. J Clin Ultrasound. 2016; 44:199–209. pmid:26402325