Figures
Abstract
Objective
To analyze the impact of the lymph node ratio (LNR, ratio of metastatic to examined nodes) on the prognosis of hypopharyngeal cancer patients.
Methods
SEER (Surveillance, Epidemiology and End Results)-registered hypopharyngeal cancer patients with lymph node metastasis were evaluated using multivariate Cox regression analysis to identify the prognostic role of the LNR. The categorical LNR was compared with the continuous LNR and pN classifications to predict cause-specific survival (CSS) and overall survival (OS) rates of hypopharyngeal cancer patients.
Results
Multivariate analysis of 916 pN+ hypopharyngeal cancer cases identified race, primary site, radiation sequence, T classification, N classification, M classification, the number of regional lymph nodes examined, the continuous LNR (Hazard ratio 2.415, 95% CI 1.707–3.416, P<0.001) and age as prognostic variables that were associated with CSS in hypopharyngeal cancer. The categorical LNR showed a higher C-index and lower Akaike information criterion (AIC) value than the continuous LNR. When patients (n = 1152) were classified into four risk groups according to LNR, R0 (LNR = 0), R1 (LNR ≤0.05), R2 (LNR 0.05–0.30) and R3 (LNR >0.30), the Cox regression model for CSS and OS using the R classification had a higher C-index value and lower AIC value than the model using the pN classification. Significant improvements in both CSS and OS were found for R2 and R3 patients with postoperative radiotherapy.
Conclusions
LNR is a significant prognostic factor for the survival of hypopharyngeal cancer patients. Using the cutoff points 0.05/0.30, the R classification was more accurate than the pN classification in predicting survival and can be used to select high risk patients for postoperative treatment.
Citation: Wang Y-L, Feng S-H, Zhu J, Zhu G-P, Li D-S, Wang Y, et al. (2013) Impact of Lymph Node Ratio on the Survival of Patients with Hypopharyngeal Squamous Cell Carcinoma: A Population-Based Analysis. PLoS ONE 8(2): e56613. https://doi.org/10.1371/journal.pone.0056613
Editor: Jian-Xin Gao, Shanghai Jiao Tong University School of Medicine, China
Received: September 19, 2012; Accepted: January 11, 2013; Published: February 19, 2013
Copyright: © 2013 Wang et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by the National Science Foundation of China (81001204 to Y-L Wang). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Hypopharyngeal cancer accounts for 2–6% of head neck cancers. [1], [2] The prognosis of patients with cancer of the hypopharynx can be poor despite aggressive combined modality treatment. [3] Traditionally, laryngopharyngectomy with reconstruction of the pharynx has been the preferred initial treatment modality for hypopharyngeal cancers. In an attempt to limit the morbidity of surgical therapy, nonsurgical treatments have gained popularity. [2] While for selected patients with early T classification hypopharyngeal cancer, transoral laser microsurgery in combination with neck dissection and postoperative radiotherapy shows results comparable to those of open surgical procedures and radiotherapy, morbidity and complication rates tend to be lower. [4] For patients with a T4a classification (tumor invasion of thyroid/cricoid cartilage, hyoid bone, thyroid gland or the central compartment of soft tissue), surgery plus neck dissection followed by adjuvant chemotherapy/radiotherapy or radiotherapy has been preferred in accordance to the NCCN guidelines. [3]
When primary surgery is the selected management path for resectable hypopharyngeal cancer cases, postoperative chemotherapy/radiotherapy is recommended (level I evidence) for the adverse pathologic features of extracapsular nodal spread and/or a positive mucosal margin. [3], [5] For other risk features, clinical judgment should be used when deciding to use radiotherapy alone or when considering including chemotherapy with radiotherapy. A better postoperative staging system for hypopharyngeal cancer would be helpful in selecting suitable patients for more intensified postoperative therapy and in the design of clinical trials. The lymph node ratio (LNR), defined as the number of involved nodes divided by the number of lymph nodes examined, was found to improve prognostic information in breast cancer, gastric cancer, colorectal cancer, melanoma and others. [6], [7], [8], [9], [10], [11], [12] Approximately 60% to 80% of patients with hypopharyngeal cancer have locally advanced disease with spread to regional nodes at diagnosis. [13] However, there have been no previous studies on the impact of the LNR on predicting the prognosis of hypopharyngeal cancer.
In the current study, the prognostic role of LNR was analyzed in SEER (Surveillance, Epidemiology and End Results)-registered hypopharyngeal cancer patients with lymph node metastasis. In addition, the cutoff points for the LNR in defining patients as high, medium or low risk groups were identified. The predictive accuracy for survival of the categorical LNR was also compared with the pN classification of hypopharyngeal cancer.
Materials and Methods
Patients
The SEER Cancer Statistics Review (http://seer.cancer.gov/), a report on the most recent cancer incidence, mortality, survival, prevalence and lifetime risk statistics, is published annually by the Data Analysis and Interpretation Branch of the National Cancer Institute, MD, USA. [14] SEER collects and publishes these statistics from population-based registries covering 26% of the US population. The 17 SEER registries routinely collect data on patient demographics, primary tumor site, tumor morphology, extent of disease, first course of treatment and active follow-up for vital status. [14] The SEER set has been widely used for the analysis of LNR staging of breast, colon, gastric and other cancers. [11], [15], [16].
Cases of hypopharyngeal carcinoma from 1988 to 2008 were extracted from the SEER database (SEER*Stat 7.0.5) according to the Site Recode classifications. The data were standardized according to the schema of the International Classification of Disease for Oncology. Cancers were limited to the hypopharynx, which were defined as the pyriform sinus (C12.9), postcricoid region (C13.0), hypopharyngeal aryepiglottic fold (C13.1), posterior wall of the hypopharynx (C13.2), overlapping lesion of the hypopharynx (C13.8) and hypopharynx, NOS (C13.9). Histology was limited to squamous cell carcinoma (histology recode - broad groupings 8050–8090). Only hypopharyngeal carcinomas as a single primary tumor or the first diagnosed cancer type of two or more primary tumors were included in current study due to the available information for cause specific survival analysis in SEER database. The LNR was calculated as the number of positive regional nodes (1988+) divided by the number of regional nodes examined (1988+). The cases with disconcordant N classification information and the number of positive regional lymph nodes recorded in SEER database were rejected (N = 116). Finally, a total of 1152 cases of hypopharyngeal carcinoma were collected as the analysis set, and among them 916 cases had pathological lymph node involvement (pN+). This study was based on public use de-identified data from the U.S. SEER database and did not include interaction with human subjects or use personal identifying information. The study did not require informed consent and was approved by the Review Board of Fudan Univesity Shanghai Cancer Center, Shanghai, China. The authors, however, obtained Limited-Use Data Agreements from SEER.
Statistical Analysis
The categorical and continuous variables of hypopharyngeal cancer cases were retrieved from the SEER database and rechecked. TNM staging information was restaged according to the 2010 American Joint Committee on Cancer (AJCC) staging system, and cases with insufficient classification were defined as X. The CSS (SEER cause-specific survival, http://seer.cancer.gov/causespecific/) was a net survival measure representing survival of a specified cause of death in the absence of other causes of death. The ‘SEER cause-specific death classification’ variable is used to obtain cancer-specific survival probability for a given cohort of cancer patients. Deaths attributed to the cancer of interest are treated as events and deaths from other causes are treated as censored observation. [14] The overall survival (OS) was calculated based on the Vital status recode. [14].
The analysis was carried out in three stages. First, we evaluated the prognostic value of LNR as a continuous variable, adjusting for other covariates associated with CSS in 916 pN+ hypopharyngeal cancer cases. In the second stage, we proceeded to determine the most appropriate cutoff points for categorizing the LNR into high, medium and low risk groups, and compared the predictive accuracy for survival between the categorical LNR and the continuous LNR. The fist pair of cutoff points was identified by means of tertiles of continuous LNR. The second pair of cutoff points were analyzed using the X-tile program (http://www.tissuearray.org/rimmlab/), which identified the cutoff with the minimum P values from log-rank χ2 statistics for the categorical LNR in terms of survival. [8], [17] The third pair of cutoff points were calculated according to Akaike information criterion (AIC) selection for the multivariate Cox regression model. [7] Using R software with the MASS, Boot and Survival package, the possible pair of cutoff points with the maximum likelihood associated with the multivariate Cox regression model, which ranged from 0.05 to 0.95 at intervals of 0.05, was identified as the third pair of cutoff points. Patients with hypopharyngeal cancer (N = 1152) were classified into four categories (R0-3) according to the identified LNR cutoff points. The prognostic significance of categorical LNR (R classification) was compared with the pN classification.
Survival curves were plotted and survival rates were calculated using the Kaplan-Meier method. Statistical comparisons of different factors related to mortality were undertaken using the Log-rank χ2 test. In multivariate analysis, forward stepwise regression analysis was carried out using a Cox proportional hazards model. Harrell’s concordance index (C-index) and AIC values related to the Cox regression model were analyzed to compare the predictive ability of the continuous LNR and categorical LNR for the identification of the optimal cutoff points for the LNR, and the R and pN classifications. [18], [19] A higher C-index value and a lower AIC value indicated a more desirable model for predicting outcome. A P value of 0.05 was considered statistically significant. All statistical analyses were carried out using SPSS software version 17.0 (SPSS Inc., Chicago, IL) and R2.14.0 software with packages. [20].
Results
Lymph Node Ratio as a Prognostic Factor for Survival in Hypopharyngeal Cancer
The clinical characteristics of the 916 SEER patients with pN+ hypopharyngeal cancer are shown in Table 1. The median age of patients was 61 years (range 35–93 years). The median number of lymph nodes examined, positive lymph nodes and lymph node ratio were 25 (range 1–90), 2 (range 1–90) and 0.14 (range 0.01–1.00), respectively. The median follow-up time was 23 months (range, 0–238 months). There were 495 cases with cancer caused death, 181 cases with non-cancer caused death, 238 alive cases and 2 cases lost during follow-up at the end of follow-up. Kaplan-Meier estimates of 1-, 3-, 5- and 10-year CSS were 76.3%, 51.0%, 42.3% and 33.6%, respectively, and estimates of 1-, 3-, 5- and 10-year OS were 76.3%, 43.9%, 30.9% and 18.7%, respectively. The case number and 5-year CSS of patients diagnosed at 1988–1994, 1995–2001, 2002–2008 were 282, 298, 336 and 42.1%, 43.1%, 41.4%, respectively. There was no changes of the survival for pN+ hypopharyngeal cancer cases diagnosed at different period (Log-rank χ2 0.156, P = 0.925). The univariate analysis showed that race, primary site, radiation sequence, cancer directed surgery, T classification, N classification and M classification were all associated with CSS in 916 pN+ hypopharyngeal cancer cases. When these factors were assessed using multivariate Cox regression analysis, we found that race, primary site, radiation sequence, T classification, N classification, M classification, the number of regional lymph nodes examined, continuous LNR and age were all independent variables (Table 2).
Identification of LNR Cutoff Points
The complexity of the underlying computations for obtaining the hazard ratios for the continuous LNR ensures that the immediately readable hazard ratios for the categorized LNR are preferred in daily clinical practice. To stratify the patients with lymph node metastasis as high, medium and low risk groups associated with CSS, the upper and lower tertiles of continuous LNR that corresponded to 0.09 and 0.27 were defined as the first pair of cutoff points. The X-tile, which can control the inflated type I error problem and minimize the loss of information due to multiple testing through cross-validation, identified 0.08/0.33 as the second pair of cutoff points. [8], [17] After recomputing the likelihood associated with all pairs of LNR cutoffs (dividing patients into three risk groups) using the multivariate regression model (Table 2), 0.05/0.30 was identified as the third pair of cutoff points with the maximum likelihood associated with the Cox regression model. The SEER cases with lymph node metastasis were stratified as high, medium and low risk groups according to the three pairs of cutoff points identified above. The case numbers, the 5-year CSS and 5-year OS of the different risk groups were summarized in Table 3. To compare the predictive ability of the categorical LNR and the continuous LNR, the C-index and AIC value of the Cox regression model (Table 2) with substitution of the continuous LNR with the categorical LNR were calculated. As listed in Table 3, all three pairs of the categorical LNRs showed superior predictive ability to that of the continuous LNR, with the lower AIC value and higher C-index value associated with the Cox regression model. For the sake of convenience in clinical interpretation and application, the cutoff points 0.05/0.30 with the lowest AIC values were used for further analysis.
Superiority of the R Classification Over the pN Classification in the Prediction of Survival
Since the N classification and LNR are both lymph node staging system, the 1152 SEER cases of hypopharyngeal carcinoma were classified as the four risk groups, R0 (LNR, 0), R1 (LNR, 0–0.05), R2 (LNR, 0.05–0.30), R3 (LNR, >0.30) and defined as the R classification to compare with traditional N classification. Univariate analysis (Table 4) and multivariate Cox regression analysis (Table 5) indicated that race, primary site, T classification, N classification, M classification, radiation sequence, cancer directed surgery and age had a significant association with CSS. When substituting the N classification with the R classification, the Cox regression model of CSS for the R classification showed a lower AIC value and higher C-index value, which suggested that Cox regression model with R classification had better predictive ability (Table 5). The Cox regression model for the R classification was also superior to the N classification in predicting OS (Table 5). Table 5 and Figure 1 show the univariate Kaplan-Meier CSS and OS estimates according to risk groups, defined using the pN (Fig. 1A and C) or R classification (Fig. 1B and D). As shown at Figure 1, for the 5-year CSS or OS, both the N and R classifications showed good discriminatory ability among each group. For the 10-year CSS and OS, the survival curves for N1 and N2 crossed at 35% and 19%. The 15-year CSS and OS survival curves for N1, N2 and N3 classifications converged at 23% and 10%, respectively (Table 5). In comparison, the 10-year CSS and OS curves for the R1-3 classification were clearly separated even with a follow-up time exceeding 15 years. For the R classification, similar survival curves were obtained for the R1 (lower LNR) and R0 (no lymph node metastasis) groups (Fig. 1B and D), and the adjusted hazard ratio (95% CIs) of the Cox regression model for the R1 group was 1.134 (0.901–1.439) for CSS and 1.072 (0.850–1.352) for OS, when using R0 as the reference group (Table 5).
SEER cause-specific survival of the hypopharyngeal cancer cases with different pN classification (A) and R classification (B). Overall survival for different pN classifications (C) and R classifications (D). The SEER cause-specific survival (E) and overall survival (F) differences observed in N2-3/R2-3 group and other hypopharyngeal cancer patients with and without postoperative radiotherapy.
R Classification as an Index for Selecting High Risk Patients for Postoperative Radiotherapy
To analysis the role of the R classification in the management of hypopharyngeal cancer, the cases with (n = 776) and without (n = 292) postoperative radiotherapy according to the Radiation Sequence with Surgery recorded in SEER database were used for further study. Surgery and postoperative radiotherapy improved the CSS for N2 and N3 cases, whereas increased OS was only observed in N2 patients (Table 6). In the case of the R classification, an improvement in both CSS and OS was found for R2 and R3 patients who had received postoperative radiotherapy. To select high risk patients for postoperative radiotherapy, we defined the patients with a N2/N3 classification (n = 669/1068, 62.6%) and R2/R3 classification (n = 682/1068, 63.9%) as the N2-3/R2-3 group (n = 763/1068, 71.4%), a significant improvement (P<0.001) in both the CSS and OS was observed in the N2-3/R2-3 patients who had received postoperative radiotherapy (Table 6; Fig. 1E and F).
Discussion
The hypopharyngeal cancer cases with lymph node metastasis were staged as III/IV according to the AJCC TNM staging system. Approximately 70 to 85% of the patients reported in larger series were diagnosed as having stage III or IV disease at presentation. [3] The management of stages III/IV hypopharyngeal cancer has been relatively unsatisfactory owing to local recurrence and distant metastasis. Optimal therapy has remained a matter of debate, especially with regard to treatment intensity and sequencing. [2] Although treatment strategies of cancer advance tremendously, no significant survival improvements were observed in pN+ hypopharyngeal cancer patients diagnosed at different periods as shown in current results, which was also observed for laryngeal cancer and supposed to be caused by inappropriate patients selecting and lack of better index for guiding postoperative therapy. [21], [22], [23] It is plausible that selecting high risk patients is important in the choice of optimal treatment strategies. Current study clearly identified that the LNR is an important prognostic factor for CSS in hypopharyngeal cancer patients with lymph node metastasis. As compared with the N classification, the R classification using the cutoff points 0.05/0.30 showed better predictive ability for CSS and OS, with a lower AIC value and a higher C-index value. The survival curves for R1, R2 and R3 patients were clearly separate even after a 15-year follow-up period, whereas intersection of the survival curves for N 1–3 patients was found after a 10-year follow-up period. The similar survival estimates for R1 and R0 patients further confirmed the role of LNR in stratifying patients (a lower LNR to select lower risk patients).
Over the past three decades, more attention has been paid to the identification of factors that might help the surgeon to assess the precise risk of failure in individual patients. [20], [24] The best predictive index should be easily assessed and dependent on the target measured. For example in primary radiotherapy, volume of the primary tumor may be a predictive factor. [25], [26] For surgical approaches to organ preservation, anatomic sub-localization and extension of the primary tumor are more relevant factors. In the case of postoperative radiotherapy for hypopharyngeal cancer, adverse features were defined as extracapsular nodal spread, positive margins, pT3 or pT4 primary tumor, N2 or N3 nodal disease, selected pT1-T2, N0-N1, perineural invasion and vascular embolism according to the NCCN guidelines. [3] When the CSS and OS of individual R classification patients, with or without postoperative radiotherapy, were compared in the current study, survival benefits were observed for R2 and R3 patients. Combining the N and R classifications together can also select more high risk patients for postoperative radiotherapy than using the N classification alone (62.6% vs. 71.4%). All these results support the fact that R2 and R3 should be defined as adverse features for the postoperative management of hypopharyngeal cancer. Because information regarding the details of radiotherapy (the radiation techniques, dose delivered and fractions, and use of concurrent chemotherapy, etc) and pathological reports (margin status, extracapsular extension, perineural invasion and vascular embolism, etc) are not available in the SEER database, the definitive role of the R classification in postoperative staging and selecting high risk patients for postoperative concurrent chemoradiotherapy could not be discussed in the current study, and is deserving of further research.
Although we have adjusted for all available patient and tumor characteristics in our analysis, as with all SEER based studies, our study was limited by the information available in the database. The SEER database is dependent on the individual physician reporting on the classification of the patient, tumor and treatment characteristics. In this way, it is representative of national patterns of cancer care and has a large population base; however, it is also subject to inconsistencies. Although the number of lymph nodes examined and the number of positive nodes is information that can easily be reported with accuracy, there are still cases that were rejected for inclusion in the current study because of disconcordant information with regard to the N classification and the number of lymph node metastases. The quality of neck dissection achieved by the surgeon, and the quantity of lymph nodes harvested and examined by the pathologist will substantially change the LNR and the results. On the other hand, patients who have a lower number of lymph nodes resected (a relatively lower quality of operation), which may cause inflation of the LNR and a higher R classification, will be assessed as a high risk group. The LNR is an index not only of disease burden but also of surgical standards. This is the reason why the current study, together with studies on cancer from other sites, showed that the LNR improved the predictive ability of survival relative to the N classification. [8], [9], [16].
In conclusion, our analysis of the SEER database revealed a significant association between the LNR and survival of hypopharyngeal cancer patients. Using the cutoff points 0.05/0.30, the hypopharyngeal cancer patients with lymph node metastasis were classified into R1, R2 and R3 risk groups. The R classification can be used together with the N classification to select high-risk patients for postoperative treatment. However, more and prospective studies were still needed to confirm the prognostic role of LNR for hypophayryngeal cancer and more clinical evidence should be obtained.
Acknowledgments
The authors would like to thank SEER for open access to the database and Dr. Minghui Wang from School of Biosciences, The University of Birmingham, UK for his critical discussion of statistical methods.
Author Contributions
Conceived and designed the experiments: YLW SHF GPZ QHJ. Performed the experiments: YLW SHF JZ GPZ DSL YW YXZ GHS QHJ. Analyzed the data: YLW SHF JZ GPZ DSL YW YXZ GHS QHJ. Contributed reagents/materials/analysis tools: YLW SHF JZ GPZ DSL YW YXZ GHS QHJ. Wrote the paper: YLW SHF JZ GPZ DSL YW YXZ GHS QHJ.
References
- 1. Ligier K, Belot A, Launoy G, Velten M, Bossard N, et al. (2011) Descriptive epidemiology of upper aerodigestive tract cancers in France: incidence over 1980–2005 and projection to 2010. Oral Oncol 47: 302–307.
- 2. Takes RP, Strojan P, Silver CE, Bradley PJ, Haigentz M Jr, et al. (2012) Current trends in initial management of hypopharyngeal cancer: the declining use of open surgery. Head Neck 34: 270–281.
- 3. Pfister DG, Ang KK, Brizel DM, Burtness BA, Cmelak AJ, et al. (2011) National Comprehensive Cancer Network Clinical Practice Guidelines in Oncology. Head and neck cancers. J Natl Compr Canc Netw 9: 596–650.
- 4.
Suarez C, Rodrigo JP, Silver CE, Hartl DM, Takes RP, et al.. (2012) Laser surgery for early to moderately advanced glottic, supraglottic, and hypopharyngeal cancers. Head Neck.
- 5. Bernier J, Cooper JS, Pajak TF, van Glabbeke M, Bourhis J, et al. (2005) Defining risk levels in locally advanced head and neck cancers: a comparative analysis of concurrent postoperative radiation plus chemotherapy trials of the EORTC (#22931) and RTOG (# 9501). Head Neck 27: 843–850.
- 6. Spillane AJ, Cheung BL, Winstanley J, Thompson JF (2011) Lymph node ratio provides prognostic information in addition to american joint committee on cancer N stage in patients with melanoma, even if quality of surgery is standardized. Ann Surg 253: 109–115.
- 7. Vinh-Hung V, Verkooijen HM, Fioretta G, Neyroud-Caspar I, Rapiti E, et al. (2009) Lymph node ratio as an alternative to pN staging in node-positive breast cancer. J Clin Oncol 27: 1062–1068.
- 8. Wang W, Xu DZ, Li YF, Guan YX, Sun XW, et al. (2011) Tumor-ratio-metastasis staging system as an alternative to the 7th edition UICC TNM system in gastric cancer after D2 resection–results of a single-institution study of 1343 Chinese patients. Ann Oncol 22: 2049–2056.
- 9. Ceelen W, Van Nieuwenhove Y, Pattyn P (2010) Prognostic value of the lymph node ratio in stage III colorectal cancer: a systematic review. Ann Surg Oncol 17: 2847–2855.
- 10. Deng J, Sun D, Pan Y, Zhang L, Zhang R, et al. (2012) Ratio between Negative and Positive Lymph Nodes Is Suitable for Evaluation the Prognosis of Gastric Cancer Patients with Positive Node Metastasis. PLoS One 7: e43925.
- 11. Gao P, Song YX, Wang ZN, Xu YY, Tong LL, et al. (2012) Integrated ratio of metastatic to examined lymph nodes and number of metastatic lymph nodes into the AJCC staging system for colon cancer. PLoS One 7: e35021.
- 12. Song YX, Gao P, Wang ZN, Tong LL, Xu YY, et al. (2012) Which is the most suitable classification for colorectal cancer, log odds, the number or the ratio of positive lymph nodes? PLoS One 6: e28937.
- 13. Kotwall C, Sako K, Razack MS, Rao U, Bakamjian V, et al. (1987) Metastatic patterns in squamous cell cancer of the head and neck. Am J Surg 154: 439–442.
- 14.
Surveillance, Epidemiology and End Results (SEER) website. Howlader N, Noone A, Krapcho M, Neyman N, Aminou R, et al. SEER Cancer Statistics Review, 1975–2008, National Cancer Institute. Bethesda, MD. Based on November 2010 SEER data submission, posted to the SEER web site, 2011. Available: http://seer.cancer.gov/csr/1975_2008/. Accessed 2011 Oct 7.
- 15. Vinh-Hung V, Joseph SA, Coutty N, Ly BH, Vlastos G, et al. (2010) Age and axillary lymph node ratio in postmenopausal women with T1–T2 node positive breast cancer. Oncologist 15: 1050–1062.
- 16. Wang J, Dang P, Raut CP, Pandalai PK, Maduekwe UN, et al. (2012) Comparison of a lymph node ratio-based staging system with the 7th AJCC system for gastric cancer: analysis of 18,043 patients from the SEER database. Ann Surg 255: 478–485.
- 17. Camp RL, Dolled-Filhart M, Rimm DL (2004) X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clin Cancer Res 10: 7252–7259.
- 18. Bradburn MJ, Clark TG, Love SB, Altman DG (2003) Survival analysis Part III: multivariate data analysis – choosing a model and assessing its adequacy and fit. Br J Cancer 89: 605–611.
- 19. Harrell FE Jr, Lee KL, Mark DB (1996) Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 15: 361–387.
- 20.
The R Project for Statistical Computing websit. R Development Core Team (2011). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. Available: http://www.R-project.org/. Accessed 2012 Dec 7.
- 21. Glynn RW, Lowery AJ, Scutaru C, O’Dwyer T, Keogh I (2012) Laryngeal cancer: Quantitative and qualitative assessment of research output, 1945–2010. Laryngoscope 122: 1967–1973.
- 22. Hoffman HT, Porter K, Karnell LH, Cooper JS, Weber RS, et al. (2006) Laryngeal cancer in the United States: changes in demographics, patterns of care, and survival. Laryngoscope 116: 1–13.
- 23. Chen AY, Fedewa S, Zhu J (2011) Temporal trends in the treatment of early- and advanced-stage laryngeal cancer in the United States, 1985–2007. Arch Otolaryngol Head Neck Surg 137: 1017–1024.
- 24. Bernier J, Cooper JS (2005) Chemoradiation after surgery for high-risk head and neck cancer patients: how strong is the evidence? Oncologist 10: 215–224.
- 25. Bisdas S, Nguyen SA, Anand SK, Glavina G, Day T, et al. (2009) Outcome prediction after surgery and chemoradiation of squamous cell carcinoma in the oral cavity, oropharynx, and hypopharynx: use of baseline perfusion CT microcirculatory parameters vs. tumor volume. Int J Radiat Oncol Biol Phys 73: 1313–1318.
- 26. Mendenhall WM, Morris CG, Amdur RJ, Hinerman RW, Mancuso AA (2003) Parameters that predict local control after definitive radiotherapy for squamous cell carcinoma of the head and neck. Head Neck 25: 535–542.