http://orcid.org/0000-0002-3368-5013
Figures
Abstract
Background
There is controversy about the accuracy of the fine-needle aspiration (FNA) cytology results in large sized thyroid nodules. Our aim was to evaluate the false-negative rate of FNA for large thyroid nodules and the usefulness of the Thyroid Imaging Reporting and Data System (TIRADS) in predicting false-negative cytology for large thyroid nodules with benign cytology.
Methods
632 thyroid nodules larger than or equal to 3cm in size with subsequent benign cytology on US-guided FNA were included. US features of internal composition, echogenicity, margin, calcifications, and shape were evaluated, and nodules were classified according to TIRADS. TIRADS category 3 included nodules without any of the following suspicious features:solidity, hypoechogenicity or marked hypoechogenicity, microlobulated or irregular margins, microcalcifications, and taller-than-wide shape. Category 4a, 4b, 4c, and 5 were assigned to nodules showing one, two, three or four, or five suspicious US features, respectively. US features associated with malignancy for these lesions were analyzed and malignancy risk according to TIRADS was calculated.
Results
Of the 632 lesions, 23 lesions(3.6%) were malignant and 609(96.4%) were benign, suggesting a 3.6% false-negative rate for FNA cytology. Of the 23 malignant lesions, final pathology was mainly follicular carcinoma minimally invasive(65.2%, 15/23) and the follicular variant of papillary carcinoma(26.1%, 6/23). The malignancy risks of categories 3, 4a, 4b, and 4c nodules were 0.9%, 4.6%, 10.0%, and 11.8%, respectively.
Citation: Nam SJ, Kwak JY, Moon HJ, Yoon JH, Kim E-K, Koo JS (2017) Large (≥3cm) thyroid nodules with benign cytology: Can Thyroid Imaging Reporting and Data System (TIRADS) help predict false-negative cytology? PLoS ONE 12(10): e0186242. https://doi.org/10.1371/journal.pone.0186242
Editor: Fernando Schmitt, University of Toronto, CANADA
Received: May 10, 2017; Accepted: September 27, 2017; Published: October 12, 2017
Copyright: © 2017 Nam et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Fine-needle aspiration (FNA) has long been accepted as the most accurate method for evaluating thyroid nodules and selecting patients for thyroid surgery. The decision to perform FNA or clinical follow-up is based on clinical and ultrasonography (US) features and lesion size, according to current guidelines [1–4]. After FNA, patients with benign cytology are usually followed by clinical evaluation or US without repeated FNA, because there is a low possibility of malignancy (0–3%) [5]. However, for nodules with suspicious US features or increase in size during follow-up, even after benign cytology, repeat FNA is recommended to prevent delayed diagnosis of malignancy from possible false-negative FNA results [6,7]. Meanwhile, for large lesions, until now, the relationship between size and false-negative cytology remains controversial [8–13] and US features have yet to have an established role in predicting false-negative cytology for these large lesions.
The Thyroid Imaging Reporting and Data System (TIRADS) was first introduced by Horvath et al. for better communication between radiologists and physicians through a standardized reporting format [14] and originated from the Breast Imaging Reporting and Data System. Since its first introduction, several versions of TIRADS have been reported. The TIRADS by Kwak et al., which is based on the number of suspicious US features, is accurate for risk stratification and is very simple to use. Several recent studies reported that this TIRADS can help accurately stratify malignancy risk of thyroid nodules after FNA and can be easily applied in clinical practice owing to its simplicity [15–17]. However, this reporting system has not been applied to only large thyroid nodules with benign cytology, even when it could have been used in the continuous risk stratification of these nodules. Therefore, the purpose of this study was to figure out the false-negative cytology rate of large thyroid lesions and the criteria for selecting those for further work-up according to TIRADS.
Materials and methods
The Institutional Review Board of Yonsei University College of Medicine, Severance Hospital, Seoul, Korea approved this retrospective study, and the requirement for informed consent was waived. Signed informed consent was obtained from all patients prior to biopsy or surgical procedures.
Study population
By searching the FNA database of our institution from January 2010 to August 2014, we collected lesions larger than or equal to 3cm in size which were subsequently proven benign on US-guided FNA. Out of a total 1403 cases, those with the following conditions were included (n = 632): 1) lesions which underwent surgery (n = 164), 2) lesions that did not undergo surgery (n = 468; additionally diagnosed as benign or malignant at follow-up US-guided FNA (n = 97) or core needle biopsy (n = 1), alcohol injection along with shrinkage on follow-up US (n = 36), and with more than 1 year of follow-up US without change or with size decrease (n = 334). The mean follow-up period of 334 nodules was 764.7 ± 340.9 days (range, 365–1573 days). Those with the following conditions were excluded as the lesions were not precisely diagnosed (n = 771): 1) nondiagnostic or atypia on prior (n = 34) or follow-up US-guided FNA (n = 14) without surgery, 2) no more than 1 year of follow-up US (n = 723). Finally, a total 632 nodules in 632 patients were included in this study. The mean age of the patients was 49.5±14.0 years (range, 13–85 years). The mean size of the 632 nodules was 4.0±0.91 cm (range, 3–10 cm).
US examination
During the study period, US examinations were performed by 10 radiologists with 1–16 years of experience, using a 5–12-MHz linear array transducer (iU22; Philips Medical Systems). Since 2006, our institutional registry has prospectively collected data on all patients with thyroid nodules who undergo US-guided FNAs at our institution. Nodule size was defined according to the largest diameter on US. Interpretation of the US features of all thyroid lesions was prospectively recorded according to internal composition, echogenicity, margin, calcifications and shape by the radiologist who performed thyroid US at the time of US-guided FNA.The internal composition was classified as solid or mixed, which included predominantly cystic (cystic portion >50%) or predominantly solid (cystic portion ≤50%) composition. Echogenicity was classified as hyper-, iso- or hypoechogenicity (when a nodule was hyper-, iso-, or hypoechoic compared with a normal thyroid gland), or marked hypoechogenicity (when a nodule was relatively hypoechoic compared with the surrounding strap muscle). Margins were classified as well-defined or not well-defined, which included microlobulated or irregular margins. Calcifications were classified as microcalcification (≤1mm in diameter; tiny, punctuate, hyperechoic foci, either with or without acoustic shadows) or no microcalcification which included macrocalcification or no calcification. Shape was classified as wider-than-tall or taller-than-wide (greater in the anteroposterior dimension than in the transverse dimension). A TIRADS category was assigned to each nodule based on the number of suspicious US features: solidity, hypoechogenicity or marked hypoechogenicity, microlobulated or irregular margins, microcalcifications, and taller-than-wide shape [15]. Thyroid nodules without suspicious features were classified as TIRADS category 3. Thyroid nodules with one, two, three or four, or five suspicious US features were classified as category 4a, 4b, 4c, or 5, respectively.
US- guided fine-needle aspiration
US-guided FNA was performed by the same radiologist who performed real-time US. Free-hand US-guided FNA was performed with a 23-gauge needle attached to a 2-mL disposable plastic syringe. Each lesion was aspirated at least twice with a range of two to five passes. Samples obtained from the first passage were expelled on glass slides, smeared, and placed immediately in 95% alcohol for Papanicolaou staining. The remaining material in the syringe was rinsed in saline for cell-block processing. Cytopathologists were not present during biopsies. Cytopathologists specializing in thyroid pathology interpreted the slides obtained from US-guided FNA. The Bethesda System for reporting thyroid cytopathology was used in the classification of cytology reports [5].
Standard reference
Thyroid nodules with malignant results at surgery or core needle biopsy were classified as malignant. Thyroid nodules with benign results at surgery, those with subsequent benign cytology and the ones with no change, or that decreased in size with subsequent benign cytology at follow-up US-guided FNA, and with no change or decrease in size during at least 12 months of follow-up US after benign results on US-guided FNA were classified as benign. For the cases with surgical pathology of follicular variant of papillary thyroid carcinoma (FVPTC) in study period, the pathology slide was reviewed retrospectively. And noninvasive encapsulated follicular variant of papillary thyroid carcinoma which has recently been reclassified to noninvasive follicular thyroid neoplasm with papillary-like nuclear features (NIFTP) was regarded as benign [18].
Statistical analysis
The patient age and lesion size were compared between benign and malignant nodules using independent t-test. Gender (M/F ratio), US characteristics and TIRADS categories were compared between benign and malignant nodules using the Chi square or Fisher’s exact test. The malignancy risks of the thyroid nodules according to TIRADS were calculated and presented with percentages. According to the TIRADS category, the number of nodules recommended for surgery because of cytology-image discordance and diagnostic performances were assessed for all thyroid nodules and for nodules which underwent surgery respectively. Statistical analysis was performed with SPSS for Windows, version 20.0 (IBM Corporation, Armonk, NY, USA). A statistical difference was defined with a two-sided P value <0.05.
Results
The frequency and distribution of cytological diagnosis in our institutions can be found in our previous study [16]. The outcome of the 632 thyroid nodules of this study and the corresponding diagnostic procedure is described in Table 1.
Of a total 632 lesions, 609 (96.4%) were benign and 23 (3.6%) were malignant suggesting a false-negative cytology of 3.6%. Of the 164 resected lesions, 142 (86.6%) were benign and 22 (13.4%) were malignant suggesting a false-negative cytology of 13.4%.
Surgery was indicated (n = 164) for the following conditions; increase in size during follow-up (n = 35), abnormality on follow-up FNA or core needle biopsy (n = 17), FDG uptake on PET-CT (n = 1), suspicious lateral neck lymph node on US (n = 1), toxic nodule (n = 3), patient request due to cosmetic issues (n = 47), compressive symptoms (n = 36), a concurrent malignant thyroid nodule (n = 18), suspicious physical examination results (n = 2), and concurrent surgery performed for another part of the neck (n = 4). Of 23 malignancies, 22 (95.7%) underwent surgery; 15 were follicular carcinoma minimally invasive, 6 were the follicular variant of papillary carcinoma, and 1 was a conventional papillary carcinoma. One case was a malignant lymphoma which was confirmed with core needle biopsy and treated with chemotherapy and radiation therapy. Of 609 benign nodules, 142 (23.3%) underwent surgery; 125 were adenomatous hyperplasia, 12 were follicular adenoma, 3 were NIFTP which reported FVPTC originally, 1 was granulomatous thyroiditis, and 1 was Hurthle cell adenoma.
When comparing US features of the 609 benign and 23 malignant lesions, solid composition (P<0.001), hypo- or marked hypoechogenicity (P = 0.001), and higher TIRADS category (P<0.001) were more frequently seen in malignant nodules than benign nodules. The malignancy risk increased as the TIRADS category increased. The malignancy risks of category 3, 4a, 4b and 4c were 0.9%, 4.6%, 10.0% and 11.8%, respectively. For the 164 cases with surgery, solid composition (P = 0.003), hypo- or marked hypoechogenicity (P = 0.003), and higher TIRADS category (P = 0.003) were more frequently seen in malignant nodule, same as all 632 lesions. The malignancy risks of category 3,4a,4b and 4c were 3.8, 18.9, 25.8 and 50.0%, respectively (Table 2). Representative examples are shown in Figs 1–3.
On US (A: transverse image, B: longitudinal image), the lesion was well-defined, mixed isoechoic, predominantly solid, and wider-than tall without microcalcifications, suggesting TIRADS 3. FNA was performed due to its large size and the result was Bethesda class 2, benign. The patient underwent surgery due to contralateral thyroid malignancy and the final pathology was adenomatous hyperplasia.
On US (A: transverse image, B: longitudinal image), the lesion was well-defined, solid, isoechoic, and wider-than-tall without microcalcifications, suggesting TIRADS 4a. FNA was performed and the result was benign. The patient underwent surgery due to patients’ request and the final pathology was minimally invasive follicular carcinoma.
On US (A: transverse image, B: longitudinal image), the lesion was well-defined, solid, marked hypoechoic, and wider-than-tall without microcalcifications, suggesting TIRADS category 4b. The FNA result was Bethesda class 2, benign. The patient underwent surgery due to contralateral thyroid malignancy and the final pathology was the follicular variant of papillary thyroid carcinoma.
The number of nodules recommended for surgery because of cytology-image discordance and the diagnostic performances including sensitivity and positive predictive value (PPV) according to TIRADS category for all and surgery cases are shown in Table 3. If all large thyroid nodules with benign cytology had been recommended for surgery, no thyroid malignancies would have been missed, suggesting a sensitivity of 100% and a PPV of 3.6%. For nodules with TIRADS scores greater than or equal to 4a, the number of lesions recommended for surgery would have decreased to less than half (49.5%, 313 of 632), while the three malignancies (13.0%, three of 23) would have been missed, suggesting a sensitivity of 87.0% and a PPV of 6.4%. For only surgery cases, the false-negative rate and sensitivity were not different although the PPV increases increased.
Discussion
Regarding the accuracy of benign cytology of large thyroid nodules, there has been no consensus on whether large size is a risk factor for false-negative FNA and on how to subsequently manage these lesions [8–13, 19–26]. The reason for this dissensus is due to conflicting data and recommendations from prior studies. We reviewed the data of nodules with histologic evaluation from 14 previous studies published in English-language literature [8–13, 19–26]. to allow accurate comparisons, and the range and interpretation of these nodules remained quite broad (Table 4). Six studies recommended surgery [9–11,13,19,25] or repeat FNA [10] for large thyroid nodules even after benign FNA results because of a high false-negative rate (FNR) of 7.7–25.0%. In contrast to those studies, the remainder studies mentioned that large size itself should not be an indication for surgery because the FNR was within an acceptable range of 0.7–3.6% [20, 22, 24, 26] or not different from that of smaller nodules despite having a high FNR of 4.3–15.0% [8, 12, 21, 23]. In the present study, the FNR of large thyroid nodules with benign cytology was 3.6% (23 of all 632 nodules including follow-up nodules) to 13.4% (22 of 164 resected nodules) which was higher than the Bethesda recommendation of 0–3%. Therefore, our result supported the claim that benign cytology results of large thyroid nodules can be inaccurate, and consequently, that US follow-up is insufficient for these large lesions.
In analyzing the pathologic outcomes of these false-negative cytology lesions of large thyroid nodules, we were able to observe that thyroid malignancy with follicular morphologic features including FVPTC accounted for the majority (91.3%, 21 of 23) of malignancies in our study, even after 3 FVPTC are recategorization as NIFTP according to the recent nomenclature revision. [18]. This observation was not surprising. Follicular carcinomas containing the macrofollicular pattern with abundant background colloid are known to be easily mistaken as benign adenomatoid colloid nodules on cytology which may be the part of the cause for false-negative results [27]. The FVPTC also has been described as the most common histologic malignancy diagnosed after cytologically benign FNA [8, 12, 28], and when the pathognomonic nuclear features of the FVPTC are only focally present, the diagnosis can easily be missed. Our study result corresponds with these prior concepts.
We evaluated whether sonographic features can help predict false-negative cytology for the large thyroid lesions with benign cytology, focusing on the TIRADS classification. The TIRADS developed by Kwak et al [15] enables stratification of thyroid nodules according to malignancy risk. TIRADS category 3 is assigned to thyroid nodules without suspicious features, and categories 4a, 4b, 4c, and 5 are assigned to nodules with one, two, three or four, or five suspicious features, respectively [15]. Recently, Moon et al. reported on the malignancy risks of nodules with benign cytology according to the TIRADS classification and the malignancy risks of TIRADS 3, 4a, 4b, 4c and 5 were 0.7%, 1.2%, 0.7%, 9.8% and 22.2% respectively [16]. Moon et al. concluded that benign nodules with more than 3 suspicious US features (TIRADS 4c and 5) should undergo repeat FNA [16]. In our study population of large (≥3cm) thyroid nodules with benign cytology, the malignancy risks of categories 3, 4a, 4b, and 4c nodules were much higher at 0.9%, 4.6%, 10.0%, and 11.8%, respectively. The 0.9% malignancy risk of category 3 was within the 0%-3% range, which is the risk range for recommending clinical follow-up in benign nodules with the Bethesda system [5]. Thus, US follow-up can be sufficient for large nodules with benign cytology if the nodules have no suspicious US features. However, for lesions with TIRADS scores greater than or equal to 4a, further work-up should be performed due to the high risk of malignancy. In this study, the malignancy risk for each category was higher for operated cases than all nodules and this discrepancy also arose because surgery was performed more selectively on nodules with suspicious physical examinations, repeat cytology abnormalities, or growing lesions.
Wharry et al. recently insisted on thyroid lobectomy for all nodules ≥4cm while reporting a high malignancy rate of 22% and a high false-negative rate of benign cytology of 10.4% [25]. However, as in our results shown in Table 3, if all large benign lesions were recommended for surgery, unnecessary surgeries would be performed although no malignancies would be missed. For nodules with TIRADS scores greater than or equal to 4a regarded as cytology-image discordance, the number of lesions recommended for surgery would have decreased to less than half the entire cases (49.5%, 313 of 632), while the three malignancies (13.0%, three of 23) would have been missed.
There is controversy on how to manage large thyroid nodules with benign cytology. Repeat FNA is usually chosen as the next diagnostic method for possible false-negative cytologic lesions, but might not be adequate for the management for large benign thyroid nodules because the majority of pathology in this category is follicular carcinoma or the FVPTC which is often mistaken by FNA [8, 12, 27, 28]. Thyroid core needle biopsy is emerging as a diagnostic method for thyroid disease and has been increasingly used when making conclusive diagnoses for nodules with nondiagnostic, or indeterminate cytologic results [29, 30] and in the diagnosis of follicular neoplasms [31, 32]. However, there is still lack of evidence on whether core needle biopsy is more advantageous in predicting malignancy in the preoperative differential diagnosis of follicular neoplasm, especially considering the major pathology of false-negative FNA in large thyroid nodules [33]. The role of core needle biopsy for this disease group should be established with further study.
Recently, Lee et al. published a study on the cost-effectiveness of diagnostic lobectomy versus observation of thyroid nodules >4cm with benign cytology after FNA. Lee et al. concluded that thyroid lobectomy is associated with improved outcomes at an acceptable cost in the management of large benign thyroid nodules [34]. Even though diagnostic lobectomy is cost-effective, routine surgery should be performed carefully for select patients due to possible thyroidectomy-related complications such as recurrent laryngeal nerve injury, postoperative bleeding, infection, and cosmetic problems such as skin scars. According to our results, US features with the TIRADS classification should be predominantly considered to select which patients should undergo diagnostic lobectomy. US features of follicular carcinoma or FVPTC are known to be underestimated when analyzed with published sonographic criteria because follicular carcinoma and FVPTC show a more benign appearance such as regular solid iso- or mild hypoechoic nodules rather than the classic suspicious features of markedly hypoechogenicity or microcalcifications [35, 36]. The majority of these lesions show an average large size and mainly solid echogenicity [36, 37]. In this context, we suggest that, the TIRADS classification system by Kwak et al. which includes ‘solidity’ as a suspicious feature can be used to stratify the malignancy risk of these large benign thyroid nodules.
The limitations of our study are as follows. First, due to the retrospective nature of our study, a patient selection bias might have occurred. Particularly, during the study period, more than 50% (771/1403) of the large nodules obtained benign results on FNA were excluded from the analysis because the lesions were not precisely identified. Although possible concern for selection bias, for the more reliable results, we think it would be more appropriate to exclude them from the analysis and hope that further study will be possible through a longer follow-up period for these lesions. Second, although our study was a single center study, 10 board-certified radiologists performed the US examinations and US-guided FNAs. Thus, intra- and interobserver variabilities in interpreting the US results exist. However, previous published data from our institution revealed more than a moderate degree of agreement in US assessment of thyroid nodules among experienced radiologists [38] and other studies have also shown that the diagnostic performances of malignant stratification using TIRADS categories are comparable regardless of the performer’s level of experience [39, 40]. These results support our opinion that any bias due to having 10 different US operators participate in the present study did not significantly affect our study results nor their interpretation. Third, a large portion of the benign thyroid nodules that did not undergo surgery were assumed to be benign, but the possibility of malignancy cannot be completely excluded even with repeat benign cytology. Thus, this might affect an underestimation of the malignancy rate in this study.
In conclusion, large thyroid nodules with benign cytology results had a relatively high false-negative risk of 3.6% and TIRADS was helpful in predicting false-negative cytology. If large thyroid nodules with benign cytology have any suspicious US features, additional work-up such as surgery should be recommended.
References
- 1. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016;26(1):1–133. pmid:26462967.
- 2. Gharib H, Papini E, Garber JR, Duick DS, Harrell RM, Hegedus L, et al. American Association of Clinical Endocrinologists, American College of Endocrinology, and Associazione Medici Endocrinologi Medical Guidelines for Clinical Practice for the Diagnosis and Management of Thyroid Nodules—2016 Update. Endocr Pract. 2016;22(5):622–39. pmid:27167915.
- 3. Frates MC, Benson CB, Charboneau JW, Cibas ES, Clark OH, Coleman BG, et al. Management of thyroid nodules detected at US: Society of Radiologists in Ultrasound consensus conference statement. Radiology. 2005;237(3):794–800. pmid:16304103.
- 4. Shin JH, Baek JH, Chung J, Ha EJ, Kim JH, Lee YH, et al. Ultrasonography Diagnosis and Imaging-Based Management of Thyroid Nodules: Revised Korean Society of Thyroid Radiology Consensus Statement and Recommendations. Korean J Radiol. 2016;17(3):370–95. pmid:27134526.
- 5. Cibas ES, Ali SZ. The Bethesda system for reporting thyroid cytopathology. American journal of clinical pathology. 2009;132(5):658–65. pmid:19846805
- 6. Kwak JY, Koo H, Youk JH, Kim MJ, Moon HJ, Son EJ, et al. Value of US correlation of a thyroid nodule with initially benign cytologic results. Radiology. 2010;254(1):292–300. pmid:20019136.
- 7. Choi YJ, Jung I, Min SJ, Kim HJ, Kim JH, Kim S, et al. Thyroid nodule with benign cytology: is clinical follow-up enough? PLoS One. 2013;8(5):e63834. pmid:23717495.
- 8. Albuja-Cruz MB, Goldfarb M, Gondek SS, Allan BJ, Lew JI. Reliability of fine-needle aspiration for thyroid nodules greater than or equal to 4 cm. J Surg Res. 2013;181(1):6–10. pmid:23428179.
- 9. Pinchot SN, Al-Wagih H, Schaefer S, Sippel R, Chen H. Accuracy of fine-needle aspiration biopsy for predicting neoplasm or carcinoma in thyroid nodules 4 cm or larger. Arch Surg. 2009;144(7):649–55. pmid:19620545.
- 10. Carrillo JF, Frias-Mendivil M, Ochoa-Carrillo FJ, Ibarra M. Accuracy of fine-needle aspiration biopsy of the thyroid combined with an evaluation of clinical and radiologic factors. Otolaryngol Head Neck Surg. 2000;122(6):917–21. pmid:10828810.
- 11. McCoy KL, Jabbour N, Ogilvie JB, Ohori NP, Carty SE, Yim JH. The incidence of cancer and rate of false-negative cytology in thyroid nodules greater than or equal to 4 cm in size. Surgery. 2007;142(6):837–44; discussion 44 e1-3. pmid:18063065.
- 12. Mehanna R, Murphy M, McCarthy J, O'Leary G, Tuthill A, Murphy MS, et al. False negatives in thyroid cytology: impact of large nodule size and follicular variant of papillary carcinoma. Laryngoscope. 2013;123(5):1305–9. pmid:23293053.
- 13. Giles WH, Maclellan RA, Gawande AA, Ruan DT, Alexander EK, Moore FD Jr., et al. False negative cytology in large thyroid nodules. Ann Surg Oncol. 2015;22(1):152–7. pmid:25074665.
- 14. Horvath E, Majlis S, Rossi R, Franco C, Niedmann JP, Castro A, et al. An ultrasonogram reporting system for thyroid nodules stratifying cancer risk for clinical management. J Clin Endocrinol Metab. 2009;94(5):1748–51. pmid:19276237.
- 15. Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH, et al. Thyroid imaging reporting and data system for US features of nodules: a step in establishing better stratification of cancer risk. Radiology. 2011;260(3):892–9. pmid:21771959.
- 16. Moon HJ, Kim EK, Kwak JY. Malignancy risk stratification in thyroid nodules with benign results on cytology: combination of thyroid imaging reporting and data system and Bethesda system. Ann Surg Oncol. 2014;21(6):1898–903. pmid:24558069.
- 17. Moon HJ, Kim EK, Yoon JH, Kwak JY. Malignancy risk stratification in thyroid nodules with nondiagnostic results at cytologic examination: combination of thyroid imaging reporting and data system and the Bethesda System. Radiology. 2015;274(1):287–95. pmid:25133852.
- 18. Nikiforov YE, Seethala RR, Tallini G, Baloch ZW, Basolo F, Thompson LD, et al. Nomenclature Revision for Encapsulated Follicular Variant of Papillary Thyroid Carcinoma: A Paradigm Shift to Reduce Overtreatment of Indolent Tumors. JAMA Oncol. 2016;1;2(8):1023–9. pmid:27078145.
- 19. Meko JB, Norton JA. Large cystic/solid thyroid nodules: a potential false-negative fine-needle aspiration. Surgery. 1995;118(6):996–1003; discussion -4. pmid:7491545.
- 20. Rosario PW, Salles DS, Bessa B, Purisch S. Low false-negative rate of cytology in thyroid nodules> 4 cm. Arquivos Brasileiros de Endocrinologia & Metabologia. 2009;53(9):1143–5.
- 21. Kuru B, Gulcelik NE, Gulcelik MA, Dincer H. The false-negative rate of fine-needle aspiration cytology for diagnosing thyroid carcinoma in thyroid nodules. Langenbecks Arch Surg. 2010;395(2):127–32. pmid:19296123.
- 22. Porterfield JR Jr., Grant CS, Dean DS, Thompson GB, Farley DR, Richards ML, et al. Reliability of benign fine needle aspiration cytology of large thyroid nodules. Surgery. 2008;144(6):963–8; discussion 8–9. pmid:19041004.
- 23. Shrestha M, Crothers BA, Burch HB. The impact of thyroid nodule size on the risk of malignancy and accuracy of fine-needle aspiration: a 10-year study from a single institution. Thyroid. 2012;22(12):1251–6. pmid:22962940.
- 24. Raj MD, Grodski S, Woodruff S, Yeung M, Paul E, Serpell JW. Diagnostic lobectomy is not routinely required to exclude malignancy in thyroid nodules greater than four centimetres. ANZ J Surg. 2012;82(1–2):73–7. pmid:22507501.
- 25. Wharry LI, McCoy KL, Stang MT, Armstrong MJ, LeBeau SO, Tublin ME, et al. Thyroid nodules (≥ 4 cm): can ultrasound and cytology reliably exclude cancer? World journal of surgery. 2014;38(3):614–21. pmid:24081539
- 26. Yoon JH, Kwak JY, Moon HJ, Kim MJ, Kim EK. The diagnostic accuracy of ultrasound-guided fine-needle aspiration biopsy and the sonographic differences between benign and malignant thyroid nodules 3 cm or larger. Thyroid. 2011;21(9):993–1000. pmid:21834673.
- 27. Sclabas GM, Staerkel GA, Shapiro SE, Fornage BD, Sherman SI, Vassillopoulou-Sellin R, et al. Fine-needle aspiration of the thyroid and correlation with histopathology in a contemporary series of 240 patients. Am J Surg. 2003;186(6):702–9; discussion 9–10. pmid:14672783.
- 28. Jean-Gilles J, Fischer AH, Luu MH, Owens CL. Clinical and pathologic features and clinical impact of false negative thyroid fine-needle aspirations. Cancer Cytopathol. 2012;120(5):326–33. pmid:22528560.
- 29. Na DG, Kim JH, Sung JY, Baek JH, Jung KC, Lee H, et al. Core-needle biopsy is more useful than repeat fine-needle aspiration in thyroid nodules read as nondiagnostic or atypia of undetermined significance by the Bethesda system for reporting thyroid cytopathology. Thyroid. 2012;22(5):468–75. pmid:22304417.
- 30. Choi SH, Baek JH, Lee JH, Choi YJ, Hong MJ, Song DE, et al. Thyroid nodules with initially non-diagnostic, fine-needle aspiration results: comparison of core-needle biopsy and repeated fine-needle aspiration. Eur Radiol. 2014;24(11):2819–26. pmid:25038860.
- 31. Kim YH, Kwon HJ, Kim EK, Kwak JY, Moon HJ, Yoon JH. Applying Ultrasound-Guided Core Needle Biopsy for Diagnosis of Thyroid Masses: Preliminary Results From a Single Institution. J Ultrasound Med. 2015;34(10):1801–8. pmid:26324755.
- 32. Yoon RG, Baek JH, Lee JH, Choi YJ, Hong MJ, Song DE, et al. Diagnosis of thyroid follicular neoplasm: fine-needle aspiration versus core-needle biopsy. Thyroid. 2014;24(11):1612–7. pmid:25089716.
- 33. Min HS, Kim JH, Ryoo I, Jung SL, Jung CK. The role of core needle biopsy in the preoperative diagnosis of follicular neoplasm of the thyroid. APMIS. 2014;122(10):993–1000. pmid:24673498.
- 34. Lee L, Mitmaker EJ, Chabot JA, Lee JA, Kuo JH. Cost-Effectiveness of Diagnostic Lobectomy Versus Observation for Thyroid Nodules Greater than 4 cm. Thyroid. 2015. pmid:26715288.
- 35. Yoon JH, Kim EK, Hong SW, Kwak JY, Kim MJ. Sonographic features of the follicular variant of papillary thyroid carcinoma. J Ultrasound Med. 2008;27(10):1431–7. pmid:18809953.
- 36. Russ G. Risk stratification of thyroid nodules on ultrasonography with the French TI-RADS: description and reflections. Ultrasonography. 2016;35(1):25–38. pmid:26324117.
- 37. Yoon JH, Kwon HJ, Kim EK, Moon HJ, Kwak JY. The follicular variant of papillary thyroid carcinoma: characteristics of preoperative ultrasonography and cytology. Ultrasonography. 2016;35(1):47–54. pmid:26299354.
- 38. Choi SH, Kim EK, Kwak JY, Kim MJ, Son EJ. Interobserver and intraobserver variations in ultrasound assessment of thyroid nodules. Thyroid. 2010;20(2):167–72. pmid:19725777.
- 39. Ko SY, Lee HS, Kim EK, Kwak JY. Application of the Thyroid Imaging Reporting and Data System in thyroid ultrasonography interpretation by less experienced physicians. Ultrasonography. 2014;33(1):49–57. pmid:24936495.
- 40. Ko SY, Kim EK, Moon HJ, Yoon JH, Kim HY, Kwak JY. Application of Thyroid Imaging Reporting and Data System in the Ultrasound Assessment of Thyroid Nodules According to Physician Experience. Ultrasound Q. 2016;32(2):126–31. pmid:26280583.