In Asia, up to 25% of breast cancer patients present with distant metastases at diagnosis. Given the heterogeneous survival probabilities of de novo metastatic breast cancer, individual outcome prediction is challenging. The aim of the study is to identify existing prognostic models for patients with de novo metastatic breast cancer and validate them in Asia.
Materials and Methods
We performed a systematic review to identify prediction models for metastatic breast cancer. Models were validated in 642 women with de novo metastatic breast cancer registered between 2000 and 2010 in the Singapore Malaysia Hospital Based Breast Cancer Registry. Survival curves for low, intermediate and high-risk groups according to each prognostic score were compared by log-rank test and discrimination of the models was assessed by concordance statistic (C-statistic).
We identified 16 prediction models, seven of which were for patients with brain metastases only. Performance status, estrogen receptor status, metastatic site(s) and disease-free interval were the most common predictors. We were able to validate nine prediction models. The capacity of the models to discriminate between poor and good survivors varied from poor to fair with C-statistics ranging from 0.50 (95% CI, 0.48–0.53) to 0.63 (95% CI, 0.60–0.66).
Citation: Miao H, Hartman M, Bhoo-Pathy N, Lee S-C, Taib NA, Tan E-Y, et al. (2014) Predicting Survival of De Novo Metastatic Breast Cancer in Asian Women: Systematic Review and Validation Study. PLoS ONE 9(4): e93755. https://doi.org/10.1371/journal.pone.0093755
Editor: Syed A. Aziz, Health Canada and University of Ottawa, Canada
Received: January 8, 2014; Accepted: March 6, 2014; Published: April 2, 2014
Copyright: © 2014 Miao et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by Lien Centre for Palliative Care Extramural Research Award (LCPC(ER)/2012/0007), and Ministry of Higher Education, Malaysia High Impact Research Grant (UM.C/HIR/MOHE/06). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Global incidence rates of breast cancer are on the rise and the increase is largely due to an upsurge in breast cancer rates in Asia . Asian women are more likely to be diagnosed with late stage disease compared to their Western counterparts. Approximately 10% to 25% of Asian breast cancer patients present with de novo metastatic disease, compared to 3% to 5% in Europe and United States , , , , . In addition, metastatic lesions in Asian women are larger and often involve multiple sites .
Metastatic breast cancer is incurable. Median survival rates range from one to four years, but on an individual level, survival times of up to 15 years have been reported , , , , , , , . While recent studies suggest that surgical removal of primary breast tumor has a positive impact on the survival of de novo metastatic patients , , , systemic therapy, is the main treatment. Due to advances in loco-regional and systemic treatment and due to the detection of small, solitary metastases, survival has improved over time, especially in patients with hormone receptor-positive tumors , .
Accurate assessment of individual prognosis of patients with de novo metastatic breast cancer is needed for treatment decision making. In addition, like all patients with cancer, women with distant metastases want to know their prognosis . As clinicians are known to be overoptimistic in predicting survival , prediction rules can be useful for this heterogeneous group of patients with different treatment options. Although many multivariable prognostic indices have been developed for breast cancer in the last two decades, the majority are not applicable to patients with de novo metastatic disease , , . In this study, we aim to identify prediction tools which can be used for prognostication of patients with de novo metastatic breast cancer and externally validate their performance in the Singapore-Malaysia hospital-based breast cancer registry.
Materials and Methods
This study obtained ethics approval from National Healthcare Group (NHG) Domain Specific Review Board (DSRB).
Our first step was to perform a systematic review of the available literature, according to the PRISMA guidelines . A free text search was performed on 13 August 2013 to identify eligible studies using MEDLINE and EMBASE electronic database. Our search strategy included search terms and synonyms for prognostic models and the following string was used: ((metastatic breast cancer) AND ((prognostic scor* OR prognostic index OR nomogram OR predictive model OR validation OR validate OR prognostic model OR predictor) AND (scor* OR index OR model OR predict* OR nomogram OR validat*))) NOT (expression profiling OR microarray* OR proteomic OR affymetrix). After reviewing the titles and abstracts, full text was selected applying predefined in- and exclusion criteria. Included were studies presenting multivariable models, with the aim to predict overall survival of metastatic breast cancer patients. We excluded animal models or clinical trials on treatment efficacy, as well as studies which used disease free, progression free survival or response to treatment as the only outcome of interest. Etiological studies which only assessed the effect size of one specific prognostic factor or only evaluated the prognostic value of a single biomarker were not included. We also excluded prediction tools developed for patients with metastases from various primary cancers. Prognostic tools for patients with advanced cancer nearing the end of life or tools specific for recurrent metastatic breast cancer were not included as these patients have been exposed to multiple chemotherapy regimens and are often treatment resistant. Two studies which validated previously published models in metastatic breast cancer patients were excluded. Additional articles were retrieved by cross-referencing. Details regarding the author, year of publication, study design, model variables and performance measures were extracted if available. Quality of the selected publications was assessed using items listed in the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement, which were relevant to our study .
Validation of the performance of the selected prediction models was performed within the Singapore Malaysia Hospital Based Breast Cancer Registry. This registry consists of three hospital-based breast cancer registries in Singapore and Malaysia. National University Hospital (NUH) and Tan Tock Seng Hospital (TTSH) are two public tertiary hospitals in Singapore. The registry at NUH includes cases diagnosed between 1990 and 2010 while the TTSH registry started in 2001. University Malaya Medical Centre (UMMC), an academic tertiary hospital in Kuala Lumpur, Malaysia, has prospectively collected breast cancer cases from 1993 to 2008. All three registries include data on basic patient demography, clinical and pathological tumor characteristics and treatment profile. These registries have received approval from respective ethical review committees. Death information was obtained from the hospitals' medical records and ascertained by linkage to National Registration Departments in both countries. Patients were followed up from the date of diagnosis until the date of death or date of last contact whichever came first. The date of last contact was 1 November 2010 for UMMC patients, 1 July 2011 for NUH patients and 1 October 2012 for TTSH patients. Details of the registries have been described previously , , . Breast cancer patients with distant metastasis detected within three months after diagnosis were identified from this registry and formed the basis of this study. Individual data on the date of birth, ethnicity, tumor size, grade, estrogen receptor (ER) status, progesterone receptor (PR) status, human epidermal growth factor receptor 2 (HER2) status, site(s) of metastasis and treatment were available in the registry. For NUH patients we went back to the clinical files as site(s) of metastasis was not systematically recorded. Due to the lack of information on hormone receptor status in the early years, we restricted our cohort to women diagnosed between 2000 and 2010. Patients with metastases in the ipsilateral supraclavicular lymph nodes but no metastasis at any other distant site were not considered as metastatic patients, according to the sixth edition of the tumor node metastasis classification of the American Joint Committee on Cancer (AJCC) .
In the validation set, we investigated the pattern of missing data and assumed that data missingness was related to at least one other variable but not dependent on value of the observation itself, i.e. missing at random . A total number of 230 (36%) individuals had complete data on all variables used in validation and 90 (14%) cases had 3 or more variables missing. On average, each individual had 1.13 variables missing (standard deviation = 1.22), ranging from 0 to 5. Missing values were imputed once using regression imputation .
For each individual patient, we calculated the prognostic score for the different prognostic models/indices except for those developed by recursive partitioning analysis  and artificial neural network , as terminal nodes were missing in our dataset or algorithm was not provided to allow calculation of prognostic scores. For models including performance status, a variable that was not captured in our database, we assumed all patients to be fit at the time of diagnosis, i.e. 0 on Zubrod scale, which is the same as the Eastern Cooperative Oncology Group (ECOG) and the WHO scale, and 100 on the Karnofsky performance status (KPS) scale. In order to check this assumption, we retrieved comorbidity data from the medical records of a subset of 87 NUH patients who diagnosed after 2006. We also assumed the best case scenario for lactate dehydrogenase (LDH). For brain metastasis models, a score of zero (best case scenario) was assigned to the largest brain metastasis dimension in Marko et al.'s model. We assumed no trastuzumab use for HER2 positive patients in Ahn et al.'s model, as in Singapore and Malaysia trastuzumab use was rare during the time of our study. Since our study population consisted of patients who were metastatic at presentation, disease free interval (DFI) was set as zero for all women.
The distribution of each prognostic score was then divided into tertiles with the exception for Rabinovich's model, for which were only two possible combinations. We compared the survival of low, intermediate and high-risk score patients by plotting the Kaplan Meier survival curves for each tertile. Median survival and 95% confidence intervals (CI) were obtained for different groups and differences were tested by log-rank test and log-rank test for trend. The discrimination ability of the models was assessed by concordance statistic (C-statistic), which is the probability of correctly distinguishing between deceased and surviving patients within a random pair of patients . The interpretation of C-statistic is equivalent to area under a curve (AUC) in receiver operating characteristic (ROC) analysis. A value of 0.5 indicates no discrimination and value of 1.0 means perfect discrimination. For models with C-statistic larger than 0.6, 1-year, 2-year and 3-year cumulative survival probabilities were plotted for each quintile of the prognostic score to test calibration.
The search strategy resulted in 1298 titles (Figure 1). Forty-eight full text articles were selected after screening the titles and abstracts and two articles were added by cross-referencing. A total of 16 prognostic indices met our inclusion criteria. Eight models were developed for patients with metastatic breast cancer in general, seven for patients with brain metastasis from breast cancer and one for breast cancer patients with metastatic spinal cord compression , , , , , , , , , , , , , , , . All prognostic indices were designed for both de novo and recurrent metastatic breast cancer patients (Table 1). Study sizes ranged from 83 to 619 patients, with a median study size of 246 patients. The median survival from time of detection of metastasis ranged from 9.6 to 22 months. Cox regression incorporated time-to-event data and all-cause mortality as outcome was used for model development in 13 studies. Three studies conducted recursive partitioning analysis and one used artificial neural network. For Cox regression modeling, forward or backward stepwise selection with different cut-off P-values, either 0.05 or 0.1 was applied to identify final predictors.
Performance status, ER status, metastatic site(s) and disease free interval were the most common prognostic factors included in the different models. Performance status was measured on different scales, i.e. five studies used Zubrod/ECOG/WHO score while 6 models for brain metastasis used KPS , , , , , , , , , , . Model coefficients or hazard ratios were presented in all Cox regression models. Six studies transformed the model into a scoring system for easy calculation of predicted survival and three studies developed a nomogram , , , , , , , , . Recursive decision tree was constructed from recursive partitioning analysis in two studies , . Only 5 studies evaluated the discrimination of their models using C-statistic or AUC , , , , , which ranged from 0.67 to 0.74 (moderate discrimination). Calibration was assessed by plotting predicted versus observed survival for only two models, which turned out to be well calibrated , . Four studies conducted internal validation using random subset of data, ten-fold cross-validation and bootstrapping with 200 and 1000 resamples , , , , . Temporal validation of the model using data collected from the same hospital but later than those in the development set was conducted in four studies , , . Five models were externally validated in other hospitals or outside the original country , , , , . Quality of the selected publications is summarized in Table 2.
Our validation set included 642 Asian de novo metastatic breast cancer patients with a median age of 53 years (range, 24–94). Patient characteristics are reported in Table 3. Over a follow-up period of 1267.6 person-years, 492 patients had died and the median survival time was 19 months (95% CI, 16.5–21.5). The 1-year, 2-year and 3-year survival rates were 62%, 43% and 31% respectively. Half of the patients had more than one metastatic site involved and the majority did not receive any surgery or radiotherapy. Chemotherapy and hormone therapy were administered to 53% and 32% of the study population respectively. Among the 87 NUH patients with comorbidity data, hypertension (30%) and diabetes (23%) were the most common medical conditions. Less than 10% of this group was suffering from coronary heart disease (7%), stroke (2%), chronic obstructive pulmonary disease (3%) and renal failure (1%) and 6% of the patients have more than two comorbidities.
We validated all models that used Cox regression, with the exception of the models developed by Hortobagyi et al., Giordano et al., Le Scodan et al. and Rades et al. because the key predictors alkaline phosphatase (ALKP), circulating tumor cells (CTC), lymphocyte count and metastasis to spine were not available. Only Williams et al.'s, Yamamoto et al.'s, Rabinovich et al.'s and Ryberg et al.'s models were able to significantly discriminate between different risk groups in terms of overall survival based on log-rank test (Figure 2). The median survival for the low-risk group, intermediate-risk group and high-risk group classified according to Williams et al.'s model was 30 months, 21 months and 10 months respectively. For Rabinovich et al.'s model with two possible combinations, the median survival was 27 months and 16 months for the low and high risk groups. For Ryberg et al.'s model, the median survival was 29, 17 and 10 months respectively for the three groups. However the log-rank for trend test was not significant for Yamamoto et al.'s model as the median survival was 17 months for the low risk group, 24 months for the medium risk group and 15 months for the high risk group.
Risk groups were defined by tertiles of risk scores of prediction models for patients with de novo metastatic breast cancer.
In our cohort, discrimination of the different models was poor to fair, with C-statistics ranging from 0.51 to 0.63 (Table 4). The model with the highest discriminatory ability was the model developed by Williams et al. (C-statistic 0.63, 95% CI 0.60–0.66), followed by Ryberg et al. (C-statistic 0.61, 95% CI 0.59–0.64). A notable decreasing trend of 1-year, 2-year and 3-year cumulative survival probabilities was observed for the five risk groups (quintiles, Figure 3). For Williams et al.'s model, the 3-year survival probabilities for the lowest and highest risk group were 49% (95% CI, 39%–58%) and 10% (95% CI, 4%–16%) respectively. For Ryberg et al.'s model, 3-year survival probabilities were 53% (95% CI, 45%–61) and 13% (95% CI, 7%–19%) for the low versus high risk groups respectively.
Risk groups were defined by quintiles of risk scores of Williams et al.'s and Ryberg et al.'s model. 1st quintile is the group with the highest predicted survival probability and 5th quintile is with the lowest predicted survival probability.
Survival after de novo metastatic breast cancer, a relatively common condition among breast cancer patients in South East Asia, varies considerably. In this study, we showed that this highly variable prognosis can be predicted using currently available prediction rules, only to a certain extent in Asian patients. Overall, the prediction performance in the present series in Asia was not as good as in the original reports. Some of these prediction rules, which were identified through systematic review of the literature, used easily available clinical information such as age, hormone receptor status and site of metastasis. Some other models included biomarkers, which are not routinely available during the work up of breast cancer patients such as CTC and LDH.
We validated nine of the models in our Asian dataset and found that two models performed moderately well. In fact, with basic clinical information, (i.e. grade, ER status and site of metastasis), these models were able to classify patients as high risk and low risk. Based on risk scores calculated from Williams et al.'s and Ryberg et al.'s models, which included simple freely available clinical information, the difference of 3-year survival probability between the highest and lowest quintiles was close to 40%. Still, there was substantial overlap between the categories, and the current prediction rules were at best fairly able to discriminate between low and high risk patients (highest C-statistic = 0.63). Comparing to the other 3 models developed for all metastatic breast cancer patients, the models developed by Williams et al and Ryberg et al incorporated ER status and also grouped metastatic site into more categorizes. We were unable to validate the models which included advanced biomarkers, as this information was not routinely captured in our patients.
The inferior performance of the models in our Asian dataset as compared to the original report could be explained by unavailability of some predictors in our cohort and the fact that these indices/models were not specifically designed for de novo metastatic breast cancer. Another explanation could be that the Western derived models are not suitable for Asia setting. For example, in women with stage I–III breast cancer, Adjuvant!Online overpredicted survival by almost 7% and this overprediction was especially pronounced in younger women and women of Malay descent . The underlying cause might be different distributions of age, tumor characteristics, competing risks and life styles factors. Several studies have reported that Asian breast cancer patients are more likely to be premenopausal, ER/PR-negative and HER2-positive , , . Such differences could result in more skewed or more restricted range of prediction scores (Table 4).
Accuracy of predicting survival is crucial for women with de novo metastatic breast cancer as treatment varies widely, from no treatment at all, to removal of primary tumor and aggressive systemic treatment. The use of endocrine therapy and anti-HER2 drugs has been shown to prolong survival of metastatic patients., ,  Many randomized control trials have also reported significant survival benefit from modern chemotherapeutic agents, such as taxanes . Recent studies have suggested that women who undergo surgery for de novo metastatic breast cancer have a significantly lower risk of death as compared to those who do not , , . However the high proportion of patients not treated in our cohort or different response to treatment between Asian and Caucasian women may affect the usefulness of certain predictors such as hormone receptor status as well as the overall performance of the prediction models.
We acknowledge that our study suffers from limitations. The main limitation of the current study is the unavailability of certain clinical variables for prediction in our database such as performance status and LDH. Performance status, either recorded in Zubrod/ECOG/WHO or KPS, is a significant predictor in 11 indices/models. According to the development studies, 60% to 79% of their study population in fact had good performance status (Zubrod/ECOG/WHO = 0 or 1 or KPS≥70). Based on the results from a subset of patients with comorbidity data in our validation set, our assumption of patients to be generally fit may have resulted in some overestimation of predicted survival probabilities for a subset of patients. The number of CTC has been shown to be highly predictive for overall survival in patients with metastatic breast cancer , . The CELLSEARCH test (Veridex, LLC, Raritan, NJ, USA) is the first and only clinically validated, FDA-cleared system for CTC assessment , . However it is not routinely measured in Asia and is unlikely to be measured in future in low and middle income countries. The underperformance of models developed for brain metastasis maybe partially caused by the exclusion of non-treated patients in the development study, the lack of largest brain metastasis dimension and trastuzumab use in our validation dataset. Another limitation of our validation is the incomplete data of certain predictors. The pattern of missingness suggested missing at random and thus imputation is a better and more reasonable option than complete case analysis. The C-statistic for Williams et al's model from complete case analysis of 297 patients with grade, ER status and metastatic site(s) was 0.63 (95% CI, 0.59–0.67), which was very similar to the result from imputation (0.63, 95% CI, 0.60–0.66). However the standard errors and confidence intervals of the estimates might be too low as we ignored the uncertainty of imputed values by single imputation.
We conclude that existing prognostic models can only moderately predict survival of women with de novo metastatic breast cancer in the Asian setting. New models derived from a representative sample from an Asian population with different disease burden, would be able to accurately discriminate between patients with relatively good versus poor prognosis better.
Conceived and designed the experiments: HM MH NBP HV. Analyzed the data: HM MH NBP KM HV. Contributed reagents/materials/analysis tools: MH NBP SCL NT EYT PC HSW JG SMR CHY HV. Wrote the paper: HM MH NBP SCL NT EYT PC HSW JG SMR CHY HV.
- 1. Ferlay J, Shin HR, Bray F, Forman D, Mathers C, et al. (2010) Estimates of worldwide burden of cancer in 2008: GLOBOCAN 2008. Int J Cancer 127: 2893–2917.
- 2. Yip CH, Taib NA, Mohamed I (2006) Epidemiology of breast cancer in Malaysia. Asian Pac J Cancer Prev 7: 369–374.
- 3. Tan EY, Wong HB, Ang BK, Chan MY (2005) Locally advanced and metastatic breast cancer in a tertiary hospital. Ann Acad Med Singapore 34: 595–601.
- 4. Lim SE, Back M, Quek E, Iau P, Putti T, et al. (2007) Clinical observations from a breast cancer registry in Asian women. World J Surg 31: 1387–1392.
- 5. Chopra R (2001) The Indian scene. J Clin Oncol 19: 106S–111S.
- 6. Sant M, Allemani C, Berrino F, Coleman MP, Aareleid T, et al. (2004) Breast carcinoma survival in Europe and the United States. Cancer 100: 715–722.
- 7. Agarwal G, Pradeep PV, Aggarwal V, Yip CH, Cheung PS (2007) Spectrum of breast cancer in Asian women. World J Surg 31: 1031–1040.
- 8. Ly BH, Nguyen NP, Vinh-Hung V, Rapiti E, Vlastos G (2010) Loco-regional treatment in metastatic breast cancer patients: is there a survival benefit? Breast Cancer Res Treat 119: 537–545.
- 9. Chang J, Clark GM, Allred DC, Mohsin S, Chamness G, et al. (2003) Survival of patients with metastatic breast carcinoma: importance of prognostic markers of the primary tumor. Cancer 97: 545–553.
- 10. Khodari W, Sedrati A, Naisse I, Bosc R, Belkacemi Y (2013) Impact of loco-regional treatment on metastatic breast cancer outcome: A review. Crit Rev Oncol Hematol 87(1): 69–79.
- 11. Perez-Fidalgo JA, Pimentel P, Caballero A, Bermejo B, Barrera JA, et al. (2011) Removal of primary tumor improves survival in metastatic breast cancer. Does timing of surgery influence outcomes? Breast 20: 548–554.
- 12. Tai P, Yu E, Vinh-Hung V, Cserni G, Vlastos G (2004) Survival of patients with metastatic breast cancer: twenty-year data from two SEER registries. BMC Cancer 4: 60.
- 13. Todd M, Shoag M, Cadman E (1983) Survival of women with metastatic breast cancer at Yale from 1920 to 1980. J Clin Oncol 1: 406–408.
- 14. Largillier R, Ferrero JM, Doyen J, Barriere J, Namer M, et al. (2008) Prognostic factors in 1,038 women with metastatic breast cancer. Ann Oncol 19: 2012–2019.
- 15. Andre F, Slimane K, Bachelot T, Dunant A, Namer M, et al. (2004) Breast cancer with synchronous metastases: trends in survival during a 14-year period. J Clin Oncol 22: 3302–3308.
- 16. Rapiti E, Verkooijen HM, Vlastos G, Fioretta G, Neyroud-Caspar I, et al. (2006) Complete excision of primary breast tumor improves survival of patients with metastatic breast cancer at diagnosis. J Clin Oncol 24: 2743–2749.
- 17. Pathy NB, Verkooijen HM, Taib NA, Hartman M, Yip CH (2011) Impact of breast surgery on survival in women presenting with metastatic breast cancer. Br J Surg 98: 1566–1572.
- 18. Ruiterkamp J, Voogd AC, Bosscha K, Tjan-Heijnen VC, Ernst MF (2010) Impact of breast surgery on survival in patients with distant metastases at initial presentation: a systematic review of the literature. Breast Cancer Res Treat 120: 9–16.
- 19. Degner LF, Kristjanson LJ, Bowman D, Sloan JA, Carriere KC, et al. (1997) Information needs and decisional preferences in women with breast cancer. JAMA 277: 1485–1492.
- 20. Glare P, Virik K, Jones M, Hudson M, Eychmuller S, et al. (2003) A systematic review of physicians' survival predictions in terminally ill cancer patients. BMJ 327: 195–198.
- 21. Ravdin PM, Siminoff LA, Davis GJ, Mercer MB, Hewlett J, et al. (2001) Computer program to assist in making decisions about adjuvant therapy for women with early breast cancer. J Clin Oncol 19: 980–991.
- 22. Todd JH, Dowle C, Williams MR, Elston CW, Ellis IO, et al. (1987) Confirmation of a prognostic index in primary breast cancer. Br J Cancer 56: 489–492.
- 23. Michaelson JS, Chen LL, Bush D, Fong A, Smith B, et al. (2011) Improved web-based calculators for predicting breast carcinoma outcomes. Breast Cancer Res Treat 128: 827–835.
- 24. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6: e1000097.
- 25. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, et al. (2007) The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 370: 1453–1457.
- 26. Pathy NB, Yip CH, Taib NA, Hartman M, Saxena N, et al. (2011) Breast cancer in a multi-ethnic Asian setting: results from the Singapore-Malaysia hospital-based breast cancer registry. Breast 20 Suppl 2S75–80.
- 27. Greene FL, American Joint Committee on Cancer., American Cancer Society. (2002) AJCC cancer staging manual. New York: Springer-Verlag. xiv, 421 p. p.
- 28. Donders AR, van der Heijden GJ, Stijnen T, Moons KG (2006) Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 59: 1087–1091.
- 29. Gordon L, Olshen RA (1985) Tree-structured survival analysis. Cancer Treat Rep 69: 1065–1069.
- 30. Biganzoli E, Boracchi P, Mariani L, Marubini E (1998) Feed forward neural networks for the analysis of censored survival data: a partial logistic regression approach. Stat Med 17: 1169–1186.
- 31. Harrell FE Jr, Califf RM, Pryor DB, Lee KL, Rosati RA (1982) Evaluating the yield of medical tests. JAMA 247: 2543–2546.
- 32. Nash CH 3rd, Jones SE, Moon TE, Davis SL, Salmon SE (1980) Prediction of outcome in metastatic breast cancer treated with adriamycin combination chemotherapy. Cancer 46: 2380–2388.
- 33. Hortobagyi GN, Smith TL, Legha SS, Swenerton KD, Gehan EA, et al. (1983) Multivariate analysis of prognostic factors in metastatic breast cancer. J Clin Oncol 1: 776–786.
- 34. Williams MR, Todd JH, Nicholson RI, Elston CW, Blamey RW, et al. (1986) Survival patterns in hormone treated advanced breast cancer. Br J Surg 73: 752–755.
- 35. Rabinovich M, Vallejo C, Bianco A, Perez J, Machiavelli M, et al. (1992) Development and validation of prognostic models in metastatic breast cancer: a GOCS study. Oncology 49: 188–195.
- 36. Yamamoto N, Watanabe T, Katsumata N, Omuro Y, Ando M, et al. (1998) Construction and validation of a practical prognostic index for patients with metastatic breast cancer. J Clin Oncol 16: 2401–2408.
- 37. Ryberg M, Nielsen D, Osterlind K, Skovsgaard T, Dombernowsky P (2001) Prognostic factors and long-term survival in 585 patients with metastatic breast cancer treated with epirubicin-based chemotherapy. Ann Oncol 12: 81–87.
- 38. Giordano A, Giuliano M, De Laurentiis M, Eleuteri A, Iorio F, et al. (2011) Artificial neural network analysis of circulating tumor cells in metastatic breast cancer patients. Breast Cancer Res Treat 129: 451–458.
- 39. Giordano A, Egleston BL, Hajage D, Bland J, Hortobagyi GN, et al. (2013) Establishment and validation of circulating tumor cell-based prognostic nomograms in first-line metastatic breast cancer patients. Clin Cancer Res 19: 1596–1602.
- 40. Le Scodan R, Massard C, Mouret-Fourme E, Guinebretierre JM, Cohen-Solal C, et al. (2007) Brain metastases from breast carcinoma: validation of the radiation therapy oncology group recursive partitioning analysis classification and proposition of a new prognostic score. Int J Radiat Oncol Biol Phys 69: 839–845.
- 41. Nieder C, Marienhagen K, Astner ST, Molls M (2009) Prognostic scores in brain metastases from breast cancer. BMC Cancer 9: 105.
- 42. Sperduto PW, Kased N, Roberge D, Xu Z, Shanley R, et al. (2012) Effect of tumor subtype on survival and the graded prognostic assessment for patients with breast cancer and brain metastases. Int J Radiat Oncol Biol Phys 82: 2111–2117.
- 43. Ahn HK, Lee S, Park YH, Sohn JH, Jo JC, et al. (2012) Prediction of outcomes for patients with brain parenchymal metastases from breast cancer (BC): a new BC-specific prognostic model and a nomogram. Neuro Oncol 14: 1105–1113.
- 44. Marko NF, Xu Z, Gao T, Kattan MW, Weil RJ (2012) Predicting survival in women with breast cancer and brain metastasis: a nomogram outperforms current survival prediction models. Cancer 118: 3749–3757.
- 45. Le Scodan R, Massard C, Jouanneau L, Coussy F, Gutierrez M, et al. (2012) Brain metastases from breast cancer: proposition of new prognostic score including molecular subtypes and treatment. J Neurooncol 106: 169–176.
- 46. Niwinska A, Murawska M (2012) New breast cancer recursive partitioning analysis prognostic index in patients with newly diagnosed brain metastases. Int J Radiat Oncol Biol Phys 82: 2065–2071.
- 47. Rades D, Douglas S, Schild SE (2013) A validated survival score for breast cancer patients with metastatic spinal cord compression. Strahlenther Onkol 189: 41–46.
- 48. Liu MT, Huang WT, Wang AY, Huang CC, Huang CY, et al. (2010) Prediction of outcome of patients with metastatic breast cancer: evaluation with prognostic factors and Nottingham prognostic index. Support Care Cancer 18: 1553–1564.
- 49. Robertson JF, Dixon AR, Nicholson RI, Ellis IO, Elston CW, et al. (1992) Confirmation of a prognostic index for patients with metastatic breast cancer treated by endocrine therapy. Breast Cancer Res Treat 22: 221–227.
- 50. Bhoo-Pathy N, Yip CH, Hartman M, Saxena N, Taib NA, et al. (2012) Adjuvant! Online is overoptimistic in predicting survival of Asian breast cancer patients. Eur J Cancer 48: 982–989.
- 51. Yip CH (2009) Breast cancer in Asia. Methods Mol Biol 471: 51–64.
- 52. Li CI, Malone KE, Daling JR (2002) Differences in breast cancer hormone receptor status and histology by race and ethnicity among women 50 years of age and older. Cancer Epidemiol Biomarkers Prev 11: 601–607.
- 53. Telli ML, Chang ET, Kurian AW, Keegan TH, McClure LA, et al. (2011) Asian ethnicity and breast cancer subtypes: a study from the California Cancer Registry. Breast Cancer Res Treat 127: 471–478.
- 54. Pal SK, Dehaven M, Nelson RA, Onami S, Hsu J, et al. (2012) Impact of modern chemotherapy on the survival of women presenting with de novo metastatic breast cancer. BMC Cancer 12: 435.
- 55. Chia SK, Speers CH, D'Yachkova Y, Kang A, Malfair-Taylor S, et al. (2007) The impact of new chemotherapeutic and hormone agents on survival in a population-based cohort of women with metastatic breast cancer. Cancer 110: 973–979.
- 56. Gradishar WJ (2013) Emerging approaches for treating HER2-positive metastatic breast cancer beyond trastuzumab. Ann Oncol.
- 57. O'Shaughnessy J (2005) Extending survival with chemotherapy in metastatic breast cancer. Oncologist 10 Suppl 320–29.
- 58. Cristofanilli M, Budd GT, Ellis MJ, Stopeck A, Matera J, et al. (2004) Circulating tumor cells, disease progression, and survival in metastatic breast cancer. N Engl J Med 351: 781–791.
- 59. Cristofanilli M, Hayes DF, Budd GT, Ellis MJ, Stopeck A, et al. (2005) Circulating tumor cells: a novel prognostic factor for newly diagnosed metastatic breast cancer. J Clin Oncol 23: 1420–1430.
- 60. Balic M, Dandachi N, Hofmann G, Samonigg H, Loibner H, et al. (2005) Comparison of two methods for enumerating circulating tumor cells in carcinoma patients. Cytometry B Clin Cytom 68: 25–30.
- 61. Muller V, Riethdorf S, Rack B, Janni W, Fasching PA, et al. (2012) Prognostic impact of circulating tumor cells assessed with the CellSearch System and AdnaTest Breast in metastatic breast cancer patients: the DETECT study. Breast Cancer Res 14: R118.