Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Development and validation of a nomogram for predicting lymph node metastasis in ductal carcinoma in situ with microinvasion: A SEER population-based study

  • Kaijun Zhu ,

    Contributed equally to this work with: Kaijun Zhu, Yuan Sui

    Roles Data curation, Formal analysis, Methodology, Visualization, Writing – original draft

    Affiliation School of Medicine, Shaoxing University, Shaoxing, Zhejiang, P. R. China

  • Yuan Sui ,

    Contributed equally to this work with: Kaijun Zhu, Yuan Sui

    Roles Conceptualization, Data curation, Investigation, Software, Visualization, Writing – original draft

    Affiliation School of Medicine, Shaoxing University, Shaoxing, Zhejiang, P. R. China

  • Mingliao Zhu,

    Roles Formal analysis, Validation, Writing – review & editing

    Affiliation School of Medicine, Shaoxing University, Shaoxing, Zhejiang, P. R. China

  • Yuan Gao,

    Roles Methodology, Supervision, Writing – review & editing

    Affiliation Department of Breast and Thyroid Surgery, Shaoxing People’s Hospital, The First Affiliated Hospital of Shaoxing University, Shaoxing, Zhejiang Province, People’s Republic of China

  • Ying Yuan,

    Roles Methodology, Validation, Visualization

    Affiliation School of Medicine, Shaoxing University, Shaoxing, Zhejiang, P. R. China

  • Pujian Sun,

    Roles Methodology, Validation, Visualization

    Affiliation School of Medicine, Shaoxing University, Shaoxing, Zhejiang, P. R. China

  • Liwei Meng ,

    Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing – review & editing

    menglw@usx.edu.cn (LM); Woshilizhian@sina.com (ZL)

    Affiliation Department of Breast and Thyroid Surgery, Shaoxing People’s Hospital, The First Affiliated Hospital of Shaoxing University, Shaoxing, Zhejiang Province, People’s Republic of China

  • Jiangfeng Dai,

    Roles Investigation

    Affiliation Department of Oncological Surgery, Shaoxing Second Hospital, Shaoxing, Zhejiang, China

  • Zhian Li

    Roles Investigation, Project administration, Resources

    menglw@usx.edu.cn (LM); Woshilizhian@sina.com (ZL)

    Affiliation Department of Oncological Surgery, Shaoxing Second Hospital, Shaoxing, Zhejiang, China

Abstract

Background

Ductal carcinoma in situ with microinvasion (DCIS-MI) is a special type of breast cancer. It is an invasive lesion less than 1.0 mm in size related to simple ductal carcinoma in situ (DCIS). Lymph node metastasis (LNM) in DCIS-MI often indicates a poor prognosis. Therefore, the management of lymph nodes plays a vital role in the treatment strategy of DCIS-MI. Since DCIS-MI is often diagnosed by postoperative paraffin section and immunohistochemical detection, to obtain the best clinical benefits for such patients, we aim to establish and verify a nomogram to predict the possibility of lymph node metastasis in DCIS-MI patients and help preoperative or intraoperative clinical decision-making.

Methods

A retrospective analysis of patients with DCIS-MI in the Surveillance, Epidemiology, and End Results (SEER) database from 2010 to 2019 was performed. The study cohort was randomly divided into a training cohort and a validation cohort at a ratio of 7:3. The risk factors were determined by univariate and multivariate logistic regression analyses in the training cohort, and a nomogram was constructed. The receiver operating characteristic (ROC) curve, calibration curve, and decision curve analysis (DCA) were used to evaluate the nomogram in the training set and validation set. An independent data cohort was obtained from the Shanghai Jiao Tong University Breast Cancer Database (SJTU-BCDB) for external validation.

Results

This study included 3951 female patients from SEER with DCIS-MI, including 244 patients with regional lymph node metastasis, accounting for 6.18% of the total. An independent test set of 323 patients from SJTU-BCDB was used for external validation. According to the multifactorial logistic regression analysis results, age at diagnosis, ethnicity, grade, and surgical modality were included in the prediction model. The areas under the ROC curves (AUCs) were 0.739 (95% CI: 0.702~0.775), 0.732 (95% CI: 0.675~0.788), and 0.707 (95%CI: 0.607–0.807) in the training, validation and external test groups, suggesting that the column line graphs had excellent differentiation. The calibration curves slope was close to 1, and the model’s predicted values were in good agreement with the actual values. The DCA curves showed good clinical utility.

Conclusion

In this study, we constructed accurate and practical columnar maps with some clinical benefit to predict the likelihood of lymph node metastasis in patients with postoperatively diagnosed DCIS-MI and provide a reference value for specifying treatment strategies.

Introduction

Ductal carcinoma in situ with microinvasion (DCIS-MI) is a specific type of cancer that accounts for approximately 1% of new breast cancer cases and is growing at an annual rate of 2.1% [13]. In 1997, the American Joint Committee on Cancer (AJCC) introduced the concept of microinvasive carcinoma into the staging system for the first time, and in the 8th edition of the AJCC staging system, DCIS-MI was clearly defined as breast carcinoma with invasive tumor lesions less than 1.0 mm in maximum diameter [4].

Several studies have reported the clinical and pathological features of DCIS-MI and found that lymph node metastasis (LNM) can occur in this group of patients and is significantly associated with a poor prognosis, with one study noting a 2.1% lymph node metastasis rate in DCIS-MI patients and a significantly lower 5-year survival rate in lymph node-positive DCIS-MI patients than in the lymph node-negative subgroup [57]. Therefore, the management of regional lymph nodes is crucial in the treatment of DCIS-MI patients.

However, because the foci of infiltration in microinvasive breast cancer are microscopic and easily overlooked by preoperative puncture biopsy or intraoperative frozen section examination [8, 9], it is often diagnosed as DCIS before or during the operation. Nevertheless, after the operation, it is interpreted as DCIS-MI from a continuous section of the extracted mass. Because some patients with DCIS-MI do not undergo axillary dissection or sentinel lymph node biopsy during the operation, it is difficult to make clinical decisions on whether these patients need further axillary surgery. Therefore, this study used an extensive sample database to retrospectively analyze the risk factors for lymph node metastasis in patients with microinvasive breast cancer and established a practical, sensitive, and feasible prediction model to provide the most significant clinical benefits for such patients.

Materials and methods

Data collection and patient selection

Through the largest publicly available cancer database—the Surveillance, Epidemiology, and End Results (SEER) database (https://seer.cancer.gov/)—the data of patients with microinvasive breast cancer from 2010 to 2019 were obtained. The inclusion criteria were as follows: (1) female patients, (2) pathological diagnosis of microinvasive breast cancer (T1mic), and (3) breast cancer was the first and only primary tumor at the time of initial diagnosis after inclusion. We also used the following exclusion criteria;(1) patients with other cancerous diseases; (2) patients with preoperative neoadjuvant chemotherapy or preoperative radiotherapy; (3) patients with unknown estrogen receptor (ER) status; (4) patients with unknown progesterone receptor (PR) status; (5) patients with unknown human epidermal growth factor receptor 2 (HER-2) status; and (6) patients with unknown tumor grade information. Using the above criteria for screening, we finally included 3951 patients in this study. The flowchart of patients with DCIS-MI selection is shown in Fig 1.

thumbnail
Fig 1. The flowchart of the selection for patients with DCIS-MI in SEER database.

https://doi.org/10.1371/journal.pone.0301057.g001

An external test group of 323 patients diagnosed with DCIS-MI from the Shanghai Jiao Tong University Breast Cancer Database (SJTU-BCDB) was used to further validate the constructed nomogram. The inclusion and exclusion criteria were the same as the training set. We were granted permission to access relevant data in the SEER and SJTU-BCDB databases for this study and we have the right to access the information that could identify individual participants during or after data collection. This research was therefore exempted from review by the institutional review board of the First Affiliated Hospital of Shaoxing University.

Incorporate variables

The following clinicopathological factors obtained from the SEER and SJTU-BCDB databases were included in the study as variables, and the variables were grouped. The variables included age at diagnosis, race, grade, laterality, location, ER status, PR status, HER-2 status, surgical procedure, and regional lymph node status.

Statistical analysis

In this study, all the included patients from the SEER database were divided into a training set (70%) and a validation set (30%) by a random sampling method. An independent data group was used for external validation. Pearson’s chi-square or Fisher’s exact test showed no significant difference between the training and validation sets. Univariate and multivariate logistic regression were used to determine the factors related to lymph node metastasis in the training set. Variables with P < 0.05 were selected to construct a nomogram for prediction, and the data in the validation set were used for internal validation. The accuracy of the nomogram was evaluated by the receiver operating characteristic (ROC) curve, and the area under the curve (AUC) was calculated. The Hosmer‒Lemeshow goodness of fit was used to draw the calibration curve to illustrate the correlation between the probability of lymph node metastasis predicted by the nomogram and the actual probability. Decision curve analysis (DCA) was used to evaluate the clinical effectiveness of the prediction model. All statistical analyses in this study were performed using SPSS 24.0 (IBM Corp, Armonk, NY, USA) and R software (version 4.1.2, http://www.R-project.org). A P < 0.05 (both sides) was considered statistically significant.

Results

Basic characteristics of the research cohort

In this study, we included 3951 female DCIS-MI patients diagnosed from 2010 to 2019 and 244 patients who had regional lymph node metastasis, accounting for 6.18%. Table 1 summarized the clinicopathological features of 3951 patients in detail. In this study cohort, the median age of the patients was 59 years old, most of the primary sites were the outer upper quadrant (35.3%), and lesion differentiation grade IV only accounted for 0.9% of the total patients. The positive rate of ER was 76.7%, the positive rate of PR was 62.4%, and the positive rate of HER-2 was 30.3%. In terms of treatment, 58.9% of patients underwent breast-conserving surgery, 40.3% experienced a total mastectomy, and only 0.7% did not undergo surgery or the surgical method was unknown. In this study, patients were divided into a training set (n = 2765) and a validation set (n = 1186) by the random split sample method, and there was no significant difference between each variable in the training set and validation set. Meanwhile,323 patients were obtained from the SJTU-BCDB database as the external validation group, and the detailed clinicopathological features are presented in Table 2.

thumbnail
Table 1. Clinicopathological features of training and validation sets.

https://doi.org/10.1371/journal.pone.0301057.t001

thumbnail
Table 2. The clinicopathological characteristics in the SJTU-BCDB.

https://doi.org/10.1371/journal.pone.0301057.t002

Risk factors for regional lymph node metastasis in DCIS-MI patients

To determine the potential risk factors for lymph node metastasis, binary logistic regression analysis was performed on age at diagnosis, race, laterality, localization, histological grade, ER, PR, HER-2 status, and surgical procedure. Univariate logistic regression analysis showed that all included variables were significantly correlated with LNM (P < 0.0001). Therefore, these variables were added to the multivariate analysis. The results showed that age at diagnosis, race, grade, and surgical procedure were closely related to the occurrence of LNM. Among them, black race (OR = 2.516, 95% CI: 1.549~4.15, P < 0.0001), grade III (OR = 4.447, 95% CI: 2.808~7.241, P = 0.0011), total mastectomy (OR = 2.817, 95% CI: 2.092~3.822, P < 0.0001), and no surgery (OR = 7.431, 95% CI: 2.471~19.346, P < 0.0001) were independent risk factors (Table 3).

thumbnail
Table 3. Risk variables for LNM determined by univariate and multivariate logistic regression analyses.

https://doi.org/10.1371/journal.pone.0301057.t003

Development and verification of the nomogram

The multivariate binary logistic regression analysis results identified age at diagnosis, race, grade, and surgical method as risk factors. We included these four variables and constructed a nomogram (Fig 2). The AUCs of the training set (Fig 3A) and the validation set (Fig 3B) were 0.739 (95% CI: 0.702~0.775) and 0.732 (95% CI: 0.675~0.788), respectively, indicating that the nomogram has an excellent ability to predict lymph node metastasis. In addition, the slopes of the calibration curves of the training set (Fig 3D) and the validation set (Fig 3E) were close to 1, and the P values of the Hosmer‒Lemeshow test were 0.691 and 0.353, showed that the predicted values of the prediction model were in good agreement with the actual values. The evaluation effect of the external test cohort is essentially the same as the validation cohort (Fig 3C and 3F).

thumbnail
Fig 2. Nomogram predicting regional LNM in patients with DCIS-MI based on training set.

Note: The first row is the point assignment for each variable. Rows 2–5 indicate the variables included in the nomogram. For an individual patient, each variable is assigned a point value based on the histopathological characteristics. The points for each variable were summed and located on the total point line. And then, the bottom line shows the probability of the patient having regional LNM.

https://doi.org/10.1371/journal.pone.0301057.g002

thumbnail
Fig 3. Discrimination and validation of nomogram for predicting LNM in patients with DCIS-MI.

The ROC curves of the nomogram for predicting LNM in the training cohort (A), validation cohort (B) and test cohort (C). Calibration plots for the nomogram in the training cohort (D), validation cohort (E) and test cohort (F). (AUC, area under the curve; 95%CI, 95% confidence interval).

https://doi.org/10.1371/journal.pone.0301057.g003

Model benefit

The clinical benefit of the nomogram was evaluated by decision curve analysis (DCA). When the nomogram was used to asses the patient’s probability of LNM reaching the risk threshold probability, DCA results can be used to help initiate early intervention to benefit the patient. Fig 4 shows that the nomogram can maximize the net benefit compared with the prediction of LNM by age at diagnosis, race, grade, or surgical method alone, suggesting that this prediction model has good clinical efficacy.

thumbnail
Fig 4. Decision curve for prediction of regional LNM for DCIS-MI.

Black line: assume no patient will have regional LNM; gray line: assume all patients will have regional LNM; orange line: binary decision rule based on age alone; blue line: binary decision rule based on race alone; pink line: binary decision rule based on grade alone; brown line: binary decision rule based on surgery alone; red line: decision based on nomogram. The x-axis and the y-axis were the threshold probability and the net benefit, respectively.

https://doi.org/10.1371/journal.pone.0301057.g004

Discussion

DCIS-MI is a particular type of breast cancer between ductal carcinoma in situ (DCIS) and invasive ductal carcinoma (IDC), with an infiltration range of less than 1 mm. Studies have shown that DCIS, DCIS-MI, and IDC have the same gene expression [10]. The three may be a continuous process, and DCIS-MI is a transitional stage from DCIS to IDC [11, 12]. However, recent studies suggest differences in the expression of certain molecules among the three, and DCIS-MI can be regarded as an independent tumor with potential metastasis and invasion [1315]. The lymph node metastasis rate of DCIS-MI is currently believed to be 0%-20% [1621]. In this study, 4274 patients with DCIS-MI were included, of whom 258 had lymph node metastasis, and the metastasis rate was 6.03%, consistent with previous research results.

The diagnosis of DCIS-MI usually depends on postoperative routine pathological results. However, studies have shown that the sensitivity and specificity of intraoperative frozen section results were 45.8% and 64.7%, respectively [22]. Schueller et al reported 1352 cases of ultrasound-guided core needle biopsy, with a false-negative rate of 1.6% and an underestimation rate of 31.4% [8], but there was still missed diagnosis. Therefore, reoperation is usually required when DCIS-MI is not found before or during surgery and is diagnosed after surgery. Breast-conserving surgery or mastectomy is generally selected, and lymph node treatment is controversial. LNM is considered an important adverse prognostic factor, and the 5-year survival rate of lymph node-positive DCIS-MI patients is significantly lower than that of lymph node-negative DCIS-MI patients [5]. Therefore, lymph node management is crucial for the treatment decision of DCIS-MI patients.

In this study, based on a large number of cases in the SEER database, four risk factors for age, race, grade, and surgical type were determined by univariate and multivariate logistic regression analysis. A prediction model was constructed and verified by ROC, DCA, and calibration curves. The AUC of the training set, the validation set, and the external test set were greater than 0.7, and the slope of the calibration curve was close to 1, indicating that the prediction model had good discrimination and calibration [23, 24]. At the same time, the DCA curve shows that this model has greater clinical benefits. Therefore, the combined model of this study may be applied to the prediction of LNM in clinical microinvasive breast cancer.

In our study, age, race, grade, and surgical procedure were found to be essential factors in predicting regional lymph node metastasis in patients with DCIS-MI. Previous studies have shown that the median age of diagnosis of DCIS-MI patients with LNM is 54 [25]. The median age of diagnosis of this group of patients in this study cohort is 59 years old, and all are older than 50 years old. In addition, patients younger than 50 have a higher risk of LNM. At the same time, we found that black people are more likely to have LNM than Asians and white people, consistent with previous studies. In addition, several studies have shown that regional lymph node status is closely related to grade, and the higher the pathological grade is, the higher the positive rate of regional lymph nodes [26, 27]. A higher histological grade means a lower degree of tumor differentiation and generally a higher degree of malignancy. However, this study showed that the risk of grade III was the highest, and the risk of grade IV was only higher than that of grade I. Previous studies have not found this result. Due to the small number of patients with grade IV (only 34 patients), there may be data bias, and more results are needed for verification. This study also found a correlation between surgical methods and LNM. The risk of lymph node metastasis in patients undergoing total mastectomy was higher than that of breast-conserving surgery, suggesting that lymph node metastasis was closely related to the size of the lesion (DCIS) and the multifocal lesions because patients with larger masses and multifocal lesions were often not suitable for breast-conserving surgery. However, the size of the primary tumor and the number of infiltrating lesions in patients with DCIS-MI cannot be obtained from the SEER database. Finally, for example, ER and other variables have been found to be associated with LNM, but our study did not show a correlation with LNM.

There have been many reports on the analysis of risk factors for lymph node metastasis in microinvasive breast cancer, but there are few studies using similar risk factors to construct a nomogram. Ko et al. used 9635 DCIS-MI patients from Asan Medical Center to analyze the risk factors for axillary lymph node metastasis and identified ER-positive status and lymphatic invasion as independent predictors [28]. Chen et al. conducted 1:1 propensity score matching on patient data to eliminate potential bias and found that young age and high-grade lesions were independent risk factors [29]. Gooch et al. used the independent risk factors obtained from the analysis to construct a nomogram for predicting the occurrence of LNM in DCIS-MI, with a c-index of 0.71, but did not verify the calibration and clinical effectiveness of the model [25]. In our study, we constructed a predictive model for lymph node metastasis in patients with DCIS-MI and included the surgical procedure as a variable for the first time. At the same time, we effectively verified the constructed prediction model. The calibration and DCA curves confirmed that the model had good calibration and clinical benefits.

Although we have constructed an accurate and practical prediction model, some things could be improved. First, because the data of this study were obtained from the SEER database, some potentially influential factors were not included, such as nerve and vascular invasion, Ki-67, and other clinicopathological indicators. Secondly, this study is a retrospective study of big data, and there may be bias in data screening. For example, we excluded some patients with unknown information. Finally, although the external cohort from SJTU-BCDB may help avoid overfitting of the model, the data in the external validation set may have been insufficient and more cases from Eastern countries are needed.

Conclusion

In conclusion, through logistic analysis, we found that age at diagnosis, race, grade, and surgical procedure were risk factors for LNM in patients with DCIS-MI and provided an accurate, practical, and effective lymph node metastasis prediction model for DCIS-MI patients. By using four simple and easily available variables, the possibility of LNM can be predicted more accurately. This has good clinical value for the management of axillary lymph nodes in such patients.

Acknowledgments

The authors thank all patients, investigators and institutions involved in these studies, especially the SEER and SJTU-BCDB databases.

References

  1. 1. SINGLETARY SE, ALLRED C, ASHLEY P, et al. Revision of the American Joint Committee on Cancer staging system for breast cancer[J/OL]. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 2002, 20(17): 3628–3636. pmid:12202663
  2. 2. BIANCHI S, VEZZOSI V. Microinvasive carcinoma of the breast[J/OL]. Pathology oncology research: POR, 2008, 14(2): 105–111. pmid:18493870
  3. 3. THOMAS A, WEIGEL RJ, LYNCH CF, et al. Incidence, characteristics, and management of recently diagnosed, microscopically invasive breast cancer by receptor status: Iowa SEER 2000 to 2013[J/OL]. American Journal of Surgery, 2017, 214(2): 323–328. pmid:27692792
  4. 4. GIULIANO AE, CONNOLLY JL, EDGE SB, et al. Breast Cancer-Major changes in the American Joint Committee on Cancer eighth edition cancer staging manual: Updates to the AJCC Breast TNM Staging System: The 8th Edition[J/OL]. CA: A Cancer Journal for Clinicians, 2017, 67(4): 290–303. pmid:28294295
  5. 5. LI Y, ZHANG S, WEI X, et al. The clinical features and management of women with ductal carcinoma in situ with microinvasion: A retrospective Cohort study[J/OL]. International Journal of Surgery, 2015, 19: 91–94. pmid:26013173
  6. 6. FANG Y, WU J, WANG W, et al. Biologic behavior and long-term outcomes of breast ductal carcinoma in situ with microinvasion[J/OL]. Oncotarget, 2016, 7(39): 64182–64190. pmid:27577080
  7. 7. SHIINO S, QUINN C, BALL G, et al. Prognostic significance of microinvasion with ductal carcinoma in situ of the breast: a meta-analysis[J/OL]. Breast Cancer Research and Treatment, 2023, 197(2): 245–254. pmid:36427119
  8. 8. SCHUELLER G, JAROMI S, PONHOLD L, et al. US-guided 14-gauge core-needle breast biopsy: results of a validation study in 1352 cases[J/OL]. Radiology, 2008, 248(2): 406–413. pmid:18641246
  9. 9. DILLON MF, MCDERMOTT EW, QUINN CM, et al. Predictors of invasive disease in breast cancer when core biopsy demonstrates DCIS only[J/OL]. Journal of Surgical Oncology, 2006, 93(7): 559–563. pmid:16705731
  10. 10. MA XJ, SALUNGA R, TUGGLE JT, et al. Gene expression profiles of human breast cancer progression[J/OL]. Proceedings of the National Academy of Sciences of the United States of America, 2003, 100(10): 5974–5979. pmid:12714683
  11. 11. ZHANG W, GAO EL, ZHOU YL, et al. Different distribution of breast ductal carcinoma in situ, ductal carcinoma in situ with microinvasion, and invasion breast cancer[J/OL]. World Journal of Surgical Oncology, 2012, 10: 262. pmid:23216911
  12. 12. ADAMOVICH TL, SIMMONS RM. Ductal carcinoma in situ with microinvasion[J/OL]. American Journal of Surgery, 2003, 186(2): 112–116. pmid:12885600
  13. 13. OKUMURA Y, YAMAMOTO Y, ZHANG Z, et al. Identification of biomarkers in ductal carcinoma in situ of the breast with microinvasion[J/OL]. BMC cancer, 2008, 8: 287. pmid:18837981
  14. 14. SÄNGER N, ENGELS K, GRAF A, et al. Molecular Markers as Prognostic Factors in DCIS and Small Invasive Breast Cancers[J/OL]. Geburtshilfe Und Frauenheilkunde, 2014, 74(11): 1016–1022. pmid:25484376
  15. 15. ZAVAGNO G, BELARDINELLI V, MARCONATO R, et al. Sentinel lymph node metastasis from mammary ductal carcinoma in situ with microinvasion[J/OL]. The Breast, 2007, 16(2): 146–151. pmid:17046258
  16. 16. PU T, ZHONG X, DENG L, et al. Long term prognosis of ductal carcinoma in situ with microinvasion: a retrospective cohort study[J]. International Journal of Clinical and Experimental Pathology, 2018, 11(5): 2665–2674.
  17. 17. MURPHY CD, JONES JL, JAVID SH, et al. Do sentinel node micrometastases predict recurrence risk in ductal carcinoma in situ and ductal carcinoma in situ with microinvasion?[J/OL]. American Journal of Surgery, 2008, 196(4): 566–568. pmid:18760400
  18. 18. HANNA MG, JAFFER S, BLEIWEISS IJ, et al. Re-evaluating the role of sentinel lymph node biopsy in microinvasive breast carcinoma[J/OL]. Modern Pathology: An Official Journal of the United States and Canadian Academy of Pathology, Inc, 2014, 27(11): 1489–1498. pmid:24743214
  19. 19. KLAUBER-DEMORE N, TAN LK, LIBERMAN L, et al. Sentinel lymph node biopsy: is it indicated in patients with high-risk ductal carcinoma-in-situ and ductal carcinoma-in-situ with microinvasion?[J/OL]. Annals of Surgical Oncology, 2000, 7(9): 636–642. pmid:11034239
  20. 20. GOJON H, FAWUNMI D, VALACHIS A. Sentinel lymph node biopsy in patients with microinvasive breast cancer: a systematic review and meta-analysis[J/OL]. European Journal of Surgical Oncology: The Journal of the European Society of Surgical Oncology and the British Association of Surgical Oncology, 2014, 40(1): 5–11. pmid:24238761
  21. 21. MAGNONI F, MASSARI G, SANTOMAURO G, et al. Sentinel lymph node biopsy in microinvasive ductal carcinoma in situ[J/OL]. The British Journal of Surgery, 2019, 106(4): 375–383. pmid:30791092
  22. 22. WEI J, RUI S, YONG W, et al. Accuracy of preoperative puncture biopsy and intraoperative frozen section pathology for diagnosing breast ductal carcinoma in situ with microinvasion: a comparative study [J]. Guangxi Medical Journal, 2019, 41(22).
  23. 23. HUITZIL-MELENDEZ FD, CAPANU M, O’REILLY EM, et al. Advanced hepatocellular carcinoma: which staging systems best predict prognosis?[J/OL]. Journal of Clinical Oncology: Official Journal of the American Society of Clinical Oncology, 2010, 28(17): 2889–2895. pmid:20458042
  24. 24. ZHANG Y, ZHANG J, ZENG H, et al. Nomograms for predicting the overall and cancer-specific survival of patients with classical Hodgkin lymphoma: a SEER-based study[J/OL]. Oncotarget, 2017, 8(54): 92978–92988. pmid:29190971
  25. 25. GOOCH JC, SCHNABEL F, CHUN J, et al. A Nomogram to Predict Factors Associated with Lymph Node Metastasis in Ductal Carcinoma In Situ with Microinvasion[J/OL]. Annals of Surgical Oncology, 2019, 26(13): 4302–4309. pmid:31529311
  26. 26. CUTULI B, VELTEN M, MARTIN C. Assessment of axillary lymph node involvement in small breast cancer: analysis of 893 cases[J/OL]. Clinical Breast Cancer, 2001, 2(1): 59–65; discussion 66. pmid:11899384
  27. 27. KOLLIAS J, MURPHY CA, ELSTON CW, et al. The prognosis of small primary breast cancers[J/OL]. European Journal of Cancer (Oxford, England: 1990), 1999, 35(6): 908–912. pmid:10533470
  28. 28. KO BS, LIM WS, KIM HJ, et al. Risk Factor for Axillary Lymph Node Metastases in Microinvasive Breast Cancer [J/OL]. Annals of Surgical Oncology, 2012, 19(1): 212–216. pmid:21633867
  29. 29. CHEN C, HUANG S, HUANG A, et al. Risk factors for lymph node metastasis and the impact of adjuvant chemotherapy on ductal carcinoma in situ with microinvasion: a population-based study[J/OL]. OncoTargets and therapy, 2018, 11: 9071–9080. pmid:30588019