Figures
Abstract
Background
Ki67 labeling index (LI) is critical for treatment options and prognosis evaluation in breast cancer. Visual assessment (VA) is widely used to assess Ki67 LI, but has some limitations. In this study, we compared the consistency between VA and automated digital image analysis (DIA) of Ki67 LI in breast cancer, and to evaluate the application value of DIA in Ki67 LI assessment.
Methods
Ki67 immunostained slides of 155 cases of primary invasive breast cancer were eyeballing assessed by five breast pathologists and automated digital image analyzed by one breast pathologist respectively. Two score methods, hot-spot score and average score, were used to choose score areas. The intra-class correlation coefficient (ICC) was used to analyze the consistency between VA and DIA, and Wilcoxon signed-rank test was used to compare the median of paired-difference between VA and DIA values.
Results
(1) A perfect agreement was demonstrated between VA and DIA of Ki67 LI by ICC analysis (P<0.0001) in the whole cohort. A perfect agreement between VA and DIA of Ki67 LI was also showed in G2-G3, ER positive/HER2 negative cases. Average score and hot-spot score methods both demonstrated a perfect concordance between VA and DIA of Ki67 LI. (2) All cases were classified into three groups by VA values (≤10%, 11%-30% and >30% Ki67 LI). The concordance was relatively lower in intermediate Ki67 LI group (11%-30%) compared with high (>30%) Ki67 LI groups according to both methods. (3) All cases were classified into three groups by paired-difference (d) between VA values of hot-spot score and average score (d<5, 5≤d<10, d≥10) to evaluate the correlation between Ki67 staining distribution (heterogeneous or homogenous) and reproducibility of assessment. A perfect agreement was all demonstrated in three groups, and a slightly better Ki67 LI agreement between VA and DIA was indicated in homogenous staining slides than in heterogeneous staining ones. (4) VA values were relatively smaller than DIA values (average score: median of paired-difference -3.72; hot-spot score: median of paired-difference -9.12).
Conclusions
An excellent agreement between VA and DIA of Ki67 LI in breast cancer was demonstrated in the whole mixed cohort, suggesting that VA and DIA both could be used to assess Ki67 LI in clinical practice. Average score and hot-spot score methods both demonstrated a perfect concordance between VA and DIA of Ki67 LI. The almost perfect agreement between VA and DIA was observed in high Ki67 LI cases, displaying a homogenous staining pattern. The consistency between VA and DIA was relatively low in intermediate Ki67 LI group. The heterogeneity of tumors may slightly affect the concordance between VA and DIA of Ki67 LI. Assessment of VA provides lower Ki67 values than DIA, the biological importance of these values are not known at the moment.
Citation: Zhong F, Bi R, Yu B, Yang F, Yang W, Shui R (2016) A Comparison of Visual Assessment and Automated Digital Image Analysis of Ki67 Labeling Index in Breast Cancer. PLoS ONE 11(2): e0150505. https://doi.org/10.1371/journal.pone.0150505
Editor: Domenico Coppola, H. Lee Moffitt Cancer Center & Research Institute, UNITED STATES
Received: October 26, 2015; Accepted: February 14, 2016; Published: February 29, 2016
Copyright: © 2016 Zhong et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by Research Project of the Science and Technology Commission of Shanghai Municipality (15411965100). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Uncontrolled proliferation is a key hallmark of malignancy. Ki67 is a proliferation-associated marker for tumors as it is expressed in all phases of the cell cycle, except G0 [1]. Ki67 labeling index (LI) is used as a proliferation marker and a predictive marker for response to chemotherapy, and is associated with prognosis in breast cancer [2, 3]. In 2011 [4], the 12th St. Gallen Consensus Meeting suggested that the Ki67 LI was important for distinguishing between ‘‘luminal A” and ‘‘luminal B (HER2-negative)” breast cancer subtypes and advised adjuvant chemotherapy for luminal B but not for luminal A. Therefore, the standardization of the assessment of Ki67 LI is considered more important because of its impaction on clinical practice.
In 2011, the International Ki67 in Breast Cancer Working Group [5] published some recommendations for the assessment of Ki67 in breast cancer, aiming for better analysis, reporting, and use of Ki67. However, still no global guideline, with both reproducibility and objective standardization, has been established for Ki67 LI assessment in breast cancer. Visual assessment (VA) at a glance is now used to evaluate Ki67 LI in a considerable number of pathological institutions and laboratories, but there still are some limitations, for instance, the reproducibility of intermediate Ki67 LI and Ki67 LI in the moderately differentiated (G2) breast cancers in which Ki67 LI are crucial for making clinical decisions is relatively poor[6–10]. Automated digital image analysis (DIA) has been suggested as a potential method to improve the accuracy and inter-observer reproducibility in Ki67 assessment [11–12].
The aim of this study was to compare the consistency of VA and DIA of Ki67 LI in breast cancer, and to evaluate the application value of DIA in Ki67 LI assessment in clinical practice.
Materials and Methods
Case selection and Immunohistochemistry (IHC)
In our previous study [13], we have evaluated the interobserver concordance of VA of Ki67 LI in 160 cases of breast cancers. In this study, the same cohort was used except 5 cases which were unsuitable for digital image analysis because of the unsatisfied image quality. 155 cases of primary invasive breast cancer were randomly extracted from the pathology database of Fudan University Shanghai Cancer Center. All patients underwent surgery at the Cancer Center in 2012 without neoadjuvant chemotherapy. Because all cases in our study were randomly extracted from the pathology database, so all types of invasive breast cancers were included from grade 1(G1) to G3, ER negative and positive, PR negative and positive, HER2 negative and positive cases. Clinicopathological features of all cases were reviewed. All specimens were fixed with 10% neutral phosphate-buffered formalin and paraffin-embedded 4μm-thick slices of representative tumor blocks were stained with hematoxylin and eosin (H&E). Immunohistochemical analysis for Ki67 was performed on Benchmark XT system (Ventana, Tucson, AZ, USA), using MIB-1 antibody (dilution 1:100; Code M7240, Dako, Glostrup, Denmark).
Visual assessment (VA)
The Ki67 LI of all cases were visual assessed with specific instructions by five breast pathologists independently in a blinded manner. The mean values of five observers of each case were obtained as final VA values. Nuclear staining of any intensity was defined as Ki67-positive. The Ki67 LI was eyeballing scored for the percentage of positive tumor cells among all tumor cells in invasive tumor area at 10% intervals (i.e., 10, 20, 30, 40, 50, 60, 70, 80, 90, 100%). The whole slide was scanned at low-power microscopy first. At least three high-power (×40 objective) fields should be selected to represent the spectrum of staining seen on initial overview of the whole slide. In heterogeneously stained samples (Fig 1), each pathologist used two different methods to choose the scoring fields: (1) hot-spot score: the observers focused on the areas of hot spots, defined as areas in which Ki67 staining is particularly prevalent, and at least three independent areas were selected, and hot spots distributed in the invasive edge of the tumor must be included; (2) average score: the observers selected at least three independent areas including hot spots in an overall average assessment across the section. If the staining was homogenous (Fig 2), at least three randomly high-power fields were scored. The hot-spot score and average score were same in such samples. In our previous study [13], we have evaluated the interobserver concordance of VA of Ki67 LI among five observers in the same cohort. In this study, the data of Ki67 LI VA values of each observer were the same as in our previous study. The mean values of five observers of each case according to two score methods were recalculated as final VA values, which were used to compare with DIA values in this study.
With a high Ki67 LI on the left and a low Ki67 LI on the right.
With a homogenous diffuse high Ki67 LI across the slide.
Digital Image Analysis (DIA)
All the stained slides were scanned into digital slides by VENTANA iScan HT System Version 1.0 (Ventana Medical Systems, Inc, Sunnyvale, CA). The digital slides were analyzed by VENTANA Virtuoso Digital Pathology Image Analysis software Version 5.3 (Ventana Medical Systems, Inc, Sunnyvale, CA). The parameters of the software were set up as follows (Fig 3): large, round and brown stained nuclei were marked as red dots, representing positive tumor cells; round and not stained nuclei were marked as green dots, representing negative tumor cells; spindle mesenchymal cells were not marked. Firstly, the whole digital slide was viewed by another breast pathologist at a low magnification to choose the fields needed to be scored. Two different methods, with the same principle in VA, were used to select score areas: hot-spot score and average score including hot spots. At least five score areas would be selected to represent the spectrum of staining seen on initial overview of the whole digital slide. Each score area, containing about 1000 tumor cells, was surrounded by green lines, and the mesenchymal components were excluded by black lines (Fig 4). Ki67 LI of each selected field was analyzed by the digital image analysis software, and a mean value of each case was obtained according to two score methods.
Positive tumor cells were labeled with red dots and negative tumor cells with green dots. The areas surrounded by black lines were excluded. A few negative tumor cells weren’t recognized (black arrow).
The scored area was surrounded by green lines and the mesenchymal components were excluded by black lines.
Statistical analysis
Statistical analysis was performed by the statistical software package SPSS 19.0 for Windows (SPSS Inc., Chicago, Illinois, USA). Intra-class correlation coefficient (ICC) was estimated with a 95% confidence interval (CI) using two-way mixed models to assess the consistency between VA and DIA assessment of Ki67 LI according to two score methods. Higher ICC usually indicates better consistency. There is no universally accepted standard criteria for the ICC, the following criteria, similar to the kappa coefficient were used here to aid interpretation [14]: 0.00–0.20 was interpreted as “slight correlation”; 0.21–0.40 as “fair correlation”; 0.41–0.60 as “moderate correlation”; 0.61–0.80 as “substantial correlation”; and >0.80 as “almost perfect correlation.” Two-sided P value less than 0.05 was considered to be statistical significant.
The difference between VA and DIA values was not accord with normal distribution (p for Kolmogorov-Simonov tests <0.01). Therefore, Wilcoxon signed-rank test was used to compare the median of paired-difference between VA and DIA values.
Results
Clinicopathological data
All patients were female and ranged in age from 23 to 93 years, with a median age of 51. According to TNM stage, 44 cases were classified as stage I, 89 cases were stage II, and 22 cases were stage III. The tumors ranged from 0.5 to 5.0 cm in size, with a median diameter of 2.4 cm. 147 cases were diagnosed as invasive carcinoma of no special type (94.8%), and 8 cases (5.2%) were special subtypes of breast carcinoma (6 cases of invasive lobular carcinoma and 2 cases of mucinous carcinoma). Invasive tumors were grade 1(G1) in 6 cases, G2 in 80 cases and G3 in 69 cases. 118 cases were positive for estrogen receptor (ER), 104 cases were positive for progesterone receptor (PR), and 36 cases were positive for human epidermal growth factor 2 (HER2). 91 cases were classified as G2-G3, ER positive/ HER2 negative breast cancers.
Evaluation of Ki67 LI
The detailed data of Ki67 LI scores of VA and DIA was provided in the S1 Dataset. The ICCs between VA and DIA of Ki67 LI according to two score methods were showed in Table 1. A perfect agreement was demonstrated between VA and DIA of Ki67 LI in the whole cohort of our study according to both score methods by ICC analysis. Average score method (ICC = 0.974, 95%CI 0.964, 0.981, P<0.0001) showed a slightly better consistency than hot-spot score method (ICC = 0.957, 95%CI 0.941, 0.968, P<0.0001).
Since the value of Ki67 LI is more crucial for therapy decisions in G2-G3, ER positive/ HER2 negative breast cancers, a further analysis of consistency between VA and DIA of Ki67 LI in 91 cases of G2-G3, ER positive/ HER2 negative breast cancers were performed. It also showed a perfect agreement between VA and DIA of Ki67 LI in these cases by ICC analysis (Table 2). Average score method (ICC = 0.952, 95%CI 0.928, 0.968, P<0.0001) and hot-spot score method (ICC = 0.941, 95%CI 0.912, 0.961, P<0.0001) both showed a perfect consistency between VA and DIA of Ki67 LI.
Ki67 cutoffs ranging from 10% to 30% have been most widely used to classify patients into “Ki67 high” or “Ki67 low” risk groups for making clinical decisions. So in our study, all cases were classified into three groups (≤10%, 11%-30% and >30% Ki67 LI), stratified by VA values, according to two score methods respectively. In low Ki67 LI group (≤10%), it is incomparable because of the different assessment intervals of VA and DIA. The proportions of positive tumor cells were scored at 10% intervals by VA, so all the Ki67 LI were equal to 10% in this group. However, the Ki67 LI values around 10% scored by DIA were all exact values obtained from the digital image analysis software. In intermediate Ki67 LI group (11%-30%), a perfect correlation (ICC, 0.804 [95% CI 0.693, 0.877]) was showed by average score method and a substantial correlation (ICC, 0.678 [95% CI 0.480, 0.811]) was showed by hot-spot score method between VA and DIA. In high Ki67 LI group (>30%), a perfect correlation was both showed between VA and DIA according to average score (ICC, 0.945 [95% CI 0.911, 0.966]) and hot-spot score method (ICC, 0.903 [95% CI 0.855, 0.936]) (Table 3).
To evaluate the correlation between Ki67 staining distribution (heterogeneous or homogenous) and reproducibility of assessment, all cases were classified into three groups based on the paired-difference (d) between VA values of hot-spot score and VA values of average score (d<5, 5≤d<10, d≥10). The smaller the paired-difference between hot-spot score and average score, the more homogenous staining of Ki67 was indicated. ICCs between VA and DIA in three groups according to two score methods were evaluated respectively. A perfect agreement between VA and DIA was all demonstrated in three groups according to two score methods (Table 4). Two score methods both showed a perfect correlation in three groups: d<5 group (ICC, average score: 0.979 [95% CI 0.968, 0.986]; hot-spot score: 0.973 [95% CI 0.959, 0.982]), 5≤d<10 group (ICC, average score: 0.979 [95% CI 0.957, 0.990]; hot-spot score: 0.935 [95% CI 0.868, 0.968]), and d≥10 group (ICC, average score: 0.921 [95% CI 0.854, 0.958]; hot-spot score: 0.845 [95% CI 0.721, 0.916]). Smaller paired-difference meant more homogenous in staining. The ICC was observed to slightly decrease with increasing paired-difference, which indicated a slightly better Ki67 LI agreement between VA and DIA in homogenous staining slides than in heterogeneous staining ones.
Wilcoxon signed-rank test was used to compare the median of paired-difference between VA and DIA values. VA values were relatively smaller than DIA values according to both score methods (average score: median of paired-difference -3.72, Z value -7.997, P<0.0001; hot-spot score: median of paired-difference -9.12, Z value -9.725, P<0.0001) (Table 5).
Discussion
The potential clinical values of Ki67 LI in breast cancer have been recognized gradually in recent years. Several studies have showed high levels of Ki67 LI in breast cancer are associated with worse outcomes [2, 15, 16]. Selz et al. reported that Ki67 expression was a predictor of locoregional recurrence in breast cancer patients with negative lymph nodes after modified radical mastectomy [17]. In neoadjuvant treatment, Ki67 LI was associated with pathological response [3, 18]. However, there is still no standardized measurement methodology yet to evaluate Ki67 LI, which has hindered its use in clinical practice.
Manual counting of as many as 1000 tumor cells has often been recommended to evaluate Ki67 LI [5]. However, this method is tedious and labor intensive. Some studies highlighted the limitations of daily practice based on tumor cell counting and showed that the Ki67 LI values were significantly influenced by the inter-observer and intra-observer reproducibility [6–8, 19]. Visual assessment at a glance is a simpler method, which would be easier and faster. In the routine work of our department, visual assessment (VA) at 10% intervals is a main method to evaluate Ki67 LI in breast cancer. In our previous study [13], we evaluated the interobserver concordance of VA of Ki67 LI in breast cancer. A perfect agreement was demonstrated by VA as a whole, but the interobserver concordance of intermediate Ki67 LI in which most cutoffs are located for making clinical decisions was relatively low. Many studies showed a relatively poor consistency of Ki67 LI in the moderately differentiated (G2) breast cancers [6–10]. Recently, Varga et al’s study showed a moderate improvement in the inter-observer reproducibility of Ki67 LI in G2 breast cancer [20]. Automated digital image analysis (DIA) is a potential efficient method of Ki67 LI assessment, with benefits of increased capacity, precision and accuracy when compared to visual evaluation or counting [8, 9, 21–24]. In this study, we compared the consistency of VA and DIA of Ki67 LI in breast cancer. Our study showed a perfect agreement between VA and DIA of Ki67 LI in the whole cohort. Since the value of Ki67 LI in patients with ER negative, HER2 positive or G1 is much less relevant for therapy decisions, we excluded these cases from our cohort and performed a further analysis. A perfect agreement was also demonstrated in G2-G3, ER positive/HER2 negative cases. Our study indicated that VA and DIA both could be used to assess Ki67 LI in clinical practice.
Heterogeneity of Ki67 staining can occur across breast cancer cases, and which areas of the tumors should be scored is controversial. It has been an important reason of the poor interobserver concordance in Ki67 LI evaluation. The approach to selecting scoring areas varies across studies [5, 13, 19]. In this study, we adopted two different score methods, average score and hot-spot score, to evaluate the concordance between DIA and VA of Ki67 LI. As a result, two score methods both showed a perfect consistency between VA and DIA of Ki67 LI. Average score method (ICC = 0.974) showed a slightly better agreement than hot-spot score method (ICC = 0.957), but the difference was extremely small. In Varga et al’s study [20], a good intra-observer reliability was also demonstrated by all score methods on light-microscopy for Ki67 assessment.
Ki67 cutoff values, correlated with clinical decision-making in breast cancer, remain controversial and have not been clearly established yet [10, 25–27]. Multiple studies in early breast cancer showed that cutoffs ranging from 10% to 30% have been most commonly used [10, 25–29]. Many studies showed high interobserver variability among cases with intermediate Ki67 LI, the region in which most cutoffs are located for making clinical decisions [10, 13]. Computer-based image analysis may be a potential method used in the intermediate Ki67 LI groups [19]. In our study, we compared the consistency between DIA and VA in different Ki67 LI groups. It is incomparable because of the different assessment intervals of VA and DIA in low Ki67 LI group (≤10%). However, Ki67 LI is not crucial in decision-making of the treatment in this group. An excellent agreement between DIA and VA was showed in high Ki67 LI group (>30%). In intermediate Ki67 LI group (11%-30%), the group with obvious clinical significance, the consistency between VA and DIA was substantial (hot-spot score) to perfect (average score), lower than high Ki67 LI group, but was acceptable. Our study showed that DIA may be a potential method to evaluate the tumors with intermediate Ki67 LI, but further research should be conducted to evaluate the reproducibility of this method.
Ki67 staining was homogenous in some cases and heterogeneous in others. According to the paired-difference (d) between VA values of hot-spot score and average score, all cases were classified into three groups (d<5, 5≤d<10, d≥10) in our study. Smaller paired-difference suggested more homogenous in staining. A perfect consistency between VA and DIA was all demonstrated in three groups, and a slightly better Ki67 LI agreement was observed in homogenous staining slides than in heterogeneous staining ones. Our study indicated that the heterogeneity of tumors may slightly affect the consistency between VA and DIA of Ki67 LI.
Although the consistency between VA and DIA was very good by ICC analysis in our study, DIA values were relatively larger than VA values as a whole. The biological importance of these values isn’t known at the moment and further research is still needed. The main reason for this discrepancy between VA and DIA may be a bias in identification of tumor cells. DIA has the advantage of measuring a much larger number of cells and strong objectivity, as compared to human operator at the microscope. However, DIA also has some disadvantages compared with VA, such as the identification of tumor cells. In terms of VA, tumor cells are easily distinguished from lymphocytes or other stromal cells by observers. But sometimes DIA is unable to distinguish tumor cells from lymphocytes, such as a few Ki67-positive lymphocytes may be recognized as tumor cells, or a few negative tumor cells may be misinterpreted as lymphocytes and not be recognized (Fig 3), which would lead to an increasing Ki67 LI value. Double stains may be used as a potential method to highlight tumor cells and to improve the accuracy of DIA in Ki67 evaluation in future studies [30].
In conclusion, our study showed an excellent agreement between VA and DIA of Ki67 LI in breast cancer in the whole mixed cohort, suggesting that VA and DIA both could be used to assess Ki67 LI in clinical practice. Average score and hot-spot score methods both demonstrated a perfect concordance between VA and DIA of Ki67 LI. The almost perfect agreement between VA and DIA was observed in high Ki67 LI cases, displaying a homogenous staining pattern. The consistency between VA and DIA was relatively low in intermediate Ki67 LI group, and further research should be conducted to evaluate the reproducibility of DIA in this “gray zone” group. The heterogeneity of tumors may slightly affect the consistency between VA and DIA of Ki67 LI. Assessment of VA provides lower Ki67 values than DIA, the biological importance of these values are not known at the moment.
Supporting Information
S1 Dataset. The detailed data of Ki67 LI scores of visual assessment and automated digital image analysis.
https://doi.org/10.1371/journal.pone.0150505.s001
(XLSX)
Author Contributions
Conceived and designed the experiments: RS. Performed the experiments: FZ RB BY FY WY RS. Analyzed the data: FZ. Wrote the paper: FZ. Revised the manuscript: RS.
References
- 1. Gerdes J, Lemke H, Baisch H, Wacker HH, Schwab U, Stein H. Cell cycle analysis of a cell proliferation-associated human nuclear antigen defined by the monoclonal antibody Ki-67. J Immunol. 1984; 133(4):1710–1715. pmid:6206131
- 2. Fasching PA, Heusinger K, Haeberle L, Niklos M, Hein A, Bayer CM, et al. Ki67, chemotherapy response, and prognosis in breast cancer patients receiving neoadjuvant treatment. BMC Cancer. 2011; 11:486. pmid:22081974
- 3. Kim KI, Lee KH, Kim TR, Chun YS, Lee TH, Park HK. Ki-67 as a Predictor of Response to Neoadjuvant Chemotherapy in Breast Cancer Patients. J Breast Cancer. 2014; 17(1):40–46. pmid:24744796
- 4. Goldhirsch A, Wood WC, Coates AS, Gelber RD, Thürlimann B, Senn HJ; Panel members. Strategies for subtypes—dealing with the diversity of breast cancer: highlights of the St. Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2011. Ann Oncol. 2011; 22(8):1736–1747. pmid:21709140
- 5. Dowsett M, Nielsen TO, A'Hern R, Bartlett J, Coombes RC, Cuzick J, et al. Assessment of Ki67 in breast cancer: recommendations from the International Ki67 in Breast Cancer working group. J Natl Cancer Inst. 2011; 103(22):1656–1664. pmid:21960707
- 6. Vörös A, Csörg ő E, Nyári T, Cserni G. An intra- and interobserver reproducibility analysis of the Ki-67 proliferation marker assessment on core biopsies of breast cancer patients and its potential clinical implications. Pathobiology. 2013; 80(3):111–118. pmid:23258384
- 7. Vörös A, Csörg ő E, Kővári B, Lázár P, Kelemen G, Rusz O, et al. Different Methods of Pretreatment Ki-67 Labeling Index Evaluation in Core Biopsies of Breast Cancer Patients Treated with Neoadjuvant Chemotherapy and Their Relation to Response to Therapy. Pathol Oncol Res. 2014; 21(1):147–155. pmid:24859973
- 8. Polley MY, Leung SC, McShane LM, Gao D, Hugh JC, Mastropasqua MG, et al. An International Ki67 Reproducibility Study. J Natl Cancer Inst. 2013; 105(24):1897–1906. pmid:24203987
- 9. Gudlaugsson E, Skaland I, Janssen EA, Smaaland R, Shao Z, Malpica A, et al. Comparison of the effect of different techniques for measurement of Ki67 proliferation on reproducibility and prognosis prediction accuracy in breast cancer. Histopathology. 2012; 61(6):1134–1144. pmid:22963617
- 10. Varga Z, Diebold J, Dommann-Scherrer C, Frick H, Kaup D, Noske A, Obermann E, et al. How reliable is Ki-67 immunohistochemistry in grade 2 breast carcinomas? A QA study of the Swiss Working Group of Breast and Gynecopathologists. PLoS One. 2012; 7(5): e37379. pmid:22662150
- 11. Laurinavicius A, Laurinaviciene A, Dasevicius D, Elie N, Plancoulaine B, Bor C, et al. Digital image analysis in pathology: benefits and obligation. Anal Cell Pathol (Amst).2012; 35(2):75–78.
- 12. Fasanella S, Leonardi E, Cantaloni C, Eccher C, Bazzanella I, Aldovini D, et al. Proliferative activity in human breast cancer: Ki-67 automated evaluation and the influence of different Ki-67 equivalent antibodies. Diagn Pathol. 2011; 6 Suppl 1:S7. pmid:21489202
- 13. Shui R, Yu B, Bi R, Yang F, Yang Y. An interobserver reproducibility analysis of Ki67 visual assessment in breast cancer. PLoS One. 2015; 10(5):e0125131. pmid:25932921
- 14. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973; 33(3): 613–619.
- 15. de Azambuja E, Cardoso F, de Castro G Jr, Colozza M, Mano MS, Durbecq V, et al. Ki-67 as prognostic marker in early breast cancer: a meta-analysis of published studies involving 12,155 patients. Brit J Cancer. 2007; 96(10):1504–1513. pmid:17453008
- 16. Yerushalmi R, Woods R, Ravdin PM, Hayes MM, Gelmon KA. Ki67 in breast cancer: prognostic and predictive potential. Lancet Oncol. 2010; 11(2):174–183. pmid:20152769
- 17. Selz J, Stevens D, Jouanneau L, Labib A, Le Scodan R. Prognostic Value of Molecular Subtypes, Ki67 Expression and Impact of Post mastectomy Radiation Therapy in Breast Cancer Patients With Negative Lymph Nodes After Mastectomy. Int J Radiat Oncol Biol Phys. 2012; 84(5):1123–1132. pmid:22572073
- 18. Colleoni M, Bagnardi V, Rotmensz N, Viale G, Mastropasqua M, Veronesi P, et al. A nomogram based on the expression of Ki-67, steroid hormone receptors status and number of chemotherapy courses to predict pathological complete remission after preoperative chemotherapy for breast cancer. Eur J Cancer. 2010; 46(12):2216–2224. pmid:20471822
- 19. Mikami Y, Ueno T, Yoshimura K, Tsuda H, Kurosumi M, Masuda S, et al. Interobserver concordance of Ki67 labeling index in breast cancer: Japan Breast Cancer Research Group Ki67 Ring Study. Cancer Sci. 2013; 104(11):1539–1543. pmid:23905924
- 20. Varga Z, Cassoly E, Li Q, et al. Standardization for Ki-67 assessment in moderately differentiated breast cancer. A retrospective analysis of the SAKK 28/12 study. PLoS One. 2015; 10(4):e0123435. pmid:25885288
- 21. Konsti J, Lundin M, Joensuu H, Lehtimäki T, Sihto H, Holli K, et al. Development and evaluation of a virtual microscopy application for automated assessment of Ki-67 expression in breast cancer. 2011; 11: 3.
- 22. Vörös A, Csörg ő E, Kővári B, Lázár P, Kelemen G, Cserni G. The Use of Digital Images Improves Reproducibility of the Ki-67 Labeling Index as a Proliferation Marker in Breast Cancer. Pathol Oncol Res. 2014; 20(2):391–397. pmid:24202856
- 23. Laurinavicius A, Plancoulaine B, Laurinaviciene A, Herlin P, Meskauskas R, Baltrusaityte I, et al. A methodology to ensure and improve accuracy of Ki67 labelling index estimation by automated digital image analysis in breast cancer tissue. Breast Cancer Res. 2014; 16(2):R35. pmid:24708745
- 24. Mohammed ZM, McMillan DC, Elsberger B, Going JJ, Orange C, Mallon E, et al. Comparison of visual and automated assessment of Ki-67 proliferative activity and their impact on outcome in primary operable invasive ductal breast cancer. Br J Cancer.2012; 106(2):383–388. pmid:22251968
- 25. Cheang MC, Chia SK, Voduc D, Gao D, Leung S, Snider J, et al. Ki67 index, HER2 status, and prognosis of patients with luminal B breast cancer. J Natl Cancer Inst. 2009; 101(10):736–750. pmid:19436038
- 26. Stuart-Harris R, Caldas C, Pinder SE, Pharoah P. Proliferation markers and survival in early breast cancer: a systematic review and meta-analysis of 85 studies in 32,825 patients. Breast. 2008; 17 (4): 323–334. pmid:18455396
- 27. Cserni G, Vörös A, Liepniece-Karele I, Bianchi S, Vezzosi V, Grabau D, et al. Distribution pattern of the Ki67 labelling index in breast cancer and its implications for choosing cut-off values. Breast. 2014; 23(3): 259–263. pmid:24613255
- 28. Penault-Llorca F, André F, Sagan C, Lacroix-Triki M, Denoux Y, Verriele V, et al. Ki67 expression and docetaxel efficacy in patients with estrogen receptorpositive breast cancer. J Clin Oncol. 2009; 27(17):2809–2815. pmid:19380452
- 29. Goldhirsch A, Winer EP, Coates AS, Gelber RD, Piccart-Gebhart M, Thürlimann B, et al. Personalizing the treatment of women with early breast cancer: highlights of the St. Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2013. Ann Oncol. 2013; 24(9):2206–2223. pmid:23917950
- 30. Nielsen PS, Bentzer NK, Jensen V, Steiniche T, Jylling AM. Immunohistochemical Ki-67/KL1 double stains increase accuracy of Ki-67 indices in breast cancer and simplify automated image analysis. Appl Immunohistochem Mol Morphol. 2014; 22(8):568–576. pmid:24897070