Colorectal cancer (CRC) is one of the most common cancers in the western world. Screening is an efficient method of reducing cancer-related mortality. Molecular biomarkers for cancer in general and CRC in particular have been proposed, and hypermethylated DNA from stool or blood samples are already implemented as biomarkers for CRC screening.
We aimed to evaluate the performance of proven hypermethylated DNA promoter regions as plasma based biomarkers for CRC detection.
We conducted a cross-sectional case-control study of 193 CRC patients and 102 colonoscopy-verified healthy controls. Using methylation specific polymerase chain reaction, we evaluated 30 DNA promoter regions previously found to be CRC specific. We used multivariable logistic regression with stepwise backwards selection, and subsequent leave-pair-out cross validation, to calculate the optimism corrected area under the receiver operating characteristics curve (AUC) for all stage as well as early stage CRC.
None of the individual DNA promoter regions provided an overall sensitivity above 30% at a reasonable specificity. However, seven hypermethylated promoter regions (ALX4, BMP3, NPTX2, RARB, SDC2, SEPT9, and VIM) along with the covariates sex and age yielded an optimism corrected AUC of 0.86 for all stage CRC and 0.85 for early stage CRC. Overall sensitivity for CRC detection was 90.7% at 72.5% specificity using a cut point value of 0.5.
Citation: Rasmussen SL, Krarup HB, Sunesen KG, Johansen MB, Stender MT, Pedersen IS, et al. (2017) Hypermethylated DNA, a circulating biomarker for colorectal cancer detection. PLoS ONE 12(7): e0180809. https://doi.org/10.1371/journal.pone.0180809
Editor: Jorg Tost, Institut de genomique, FRANCE
Received: April 10, 2017; Accepted: June 21, 2017; Published: July 10, 2017
Copyright: © 2017 Rasmussen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was primarily funded by Aalborg University and Aalborg University Hospital. Grant support was received from “Region Nordjyllands Forskningsfond”, “Heinrich Kopps Legat”, and “Eva og Henry Frænkels Mindefond”.
Competing interests: The authors have declared that no competing interests exist.
Colorectal cancer (CRC) is one of the most common cancers, reaching annual incidence rates of >1.3 million cases worldwide . Ensuring survival of CRC patients relies on detection at early stages, which can be achieved through population-based screening [2,3]. The current screening program in Denmark includes an immunochemical faecal occult blood test (iFOBT) followed by a colonoscopy if iFOBT is positive. However, patient adherence to current screening programs is limited by low completion rates with great differences between ethnic groups . This necessitates the development of other methods for early CRC detection in order to ensure patient survival. Cell-free nucleic acids are currently of great interest as blood-based biomarkers for cancer, as these might be more specific for individual cancer types than protein-based biomarkers . Methylation occurs across the whole genome with the exception of gene promoter regions which are preferably hypomethylated. Hypermethylation of the gene promoter regions induces gene silencing in two ways: (i) inhibition of transcription factor binding, and (ii) binding of methyl-binding domain proteins, which enable chromatin modifications. DNA hypermethylation occurs early and often in the adenoma to carcinoma sequence promoting it as an ideal blood-based biomarker for CRC. This has led to the development of a commercially available blood test for DNA methylation analysing the promoter for the SEPT9 gene . However, evaluation of the SEPT9 assay in a large-scale cross-sectional study revealed sub-optimal sensitivity and specificity (48.2% and 91.5% respectively) . Other case-control studies analysing a larger panel of genes, have revealed more promising results, however, these studies are often small and lack well-defined control groups .
The aim of this study was to evaluate the performance of a panel of hypermethylated promoter regions in plasma for CRC detection, in order to enable blood-based CRC screening.
This was a cross-sectional study analysing the ability of plasma derived cell-free DNA hypermethylation to distinguish patients with CRC from a control group of patients suspected for but without CRC. Between 2003 and 2005 at The Department of Gastrointestinal Surgery, Aalborg University Hospital, a consecutive series of CRC patients were included to evaluate the correlation between coagulation status and CRC. The inclusion of the patients is described elsewhere . All patients with diagnosed CRC and available blood samples at the time of inclusion were included in the current study. During the same study period, blood samples from patients referred for colonoscopy with symptoms of, but without CRC were also collected. These patients were of a similar age as the CRC patients, and constituted the control group.
We classified patient tumours according to the tumour, node, and metastasis (TNM) system, and staging was in accordance with the American Joint Committee on Cancer staging system (AJCC) 7th Edition.
Written informed consent was obtained from all patients, and the initial study was approved by The North Denmark Region Committee on Health Research Ethics (N-20040067). The subsequent hypermethylation analysis was also approved by The North Denmark Region Committee on Health Research Ethics (N-20140064) and registered at ClinicalTrials.gov (NCT02928120).
Outcome and predictor variables
We aimed to establish a multivariable prediction model for CRC detection using a panel of 30 promoter regions, previously evaluated in stool or blood, as biomarkers for CRC with varying sensitivities . Thus, we defined the outcome variable as patients with/without CRC.
Along with the covariates sex and age, these 30 hypermethylated promoter regions were the potential predictor variables. A list of the gene names and their function is provided in the supplementary material (S1 Table).
Blood samples from the CRC patients were obtained at the time of diagnosis and before any kind of treatment. Blood samples from the control group were obtained prior to colonoscopy. Blood sampling was conducted in accordance with The European Concerted Action on Thrombosis (ECAT) procedures. All blood samples were centrifuged at 4°C for 20 minutes at 4000 rpm and the plasma samples were immediately stored at -80°C for future use. The period from sample acquisition to storage never exceeded two hours.
The method for DNA extraction and methylation analysis is based on a rapid bisulphite-treatment protocol described by Pedersen et al. (2012) . A schematic overview of the experimental protocol is appended in the supplementary material (S1 Fig).
Plasma nucleic acids were extracted from 450–1000 μl plasma samples using The easyMagTM platform (NucliSens® [bioMérieux SA, France]) according to the manufacturers’ instructions. The purified nucleic acids were eluted in 35 μl elution buffer (NucliSens® [bioMérieux SA, France]). Five μl DNA extract were used for quantitation. The remaining 30 μl was mixed with 60 μl deamination solution, deaminated for 10 minutes at 90°C, followed by a purification step (using the easyMagTM platform) and lastly eluted in 25 μl 10 mM KOH. In order to expand the deaminated DNA, we conducted a first round polymerase chain reaction (PCR) using a mix of methylation specific outer primers for all the investigated promoter regions. The reaction buffer (25 μl) consisted of PCR buffer, 13 μM MgCl2, 0.6 mM dNTP (dTTP is replaced by dUTP), 250 nM of each outer primer, 1.5 U Taq polymerase (BIOTAQTM [Bioline®, Taunton, MA, USA]), and 0.3 U Cod Uracil-DNA Glycosylase (Cod UNG [ArcticZymes®, Tromsoe, Norway]) in order to limit the risk of contamination in the two step PCR. We distributed the first round reaction mix to individual 200 μl PCR tubes, which were incubated for five minutes at 37°C, followed by 95°C for five minutes, and cooled to room temperature. Thereafter, we added 25 μl of purified deamination product to each tube yielding a reaction volume of 50 μl. For the second PCR, we distributed 10 μl buffer containing 0.4 μM methylation specific inner primers and probes in 30 individual wells in a 96 well PCR plate. We added 10 μl of the first round PCR product to 710 μl preincubated reaction mix (37°C for five minutes and 95°C for 10 minutes) containing PCR buffer, 250 μM dNTP, 10 μM MgCl2, 8 U Taq polymerase (BIOTAQTM [Bioline®, Taunton, MA, USA]), and 0.8 Uracil-DNA Glycosylase (Invitrogen®, Waltham, MA, USA). Twenty μl of reaction mix was then added to each of the 30 wells to a final reaction volume of 30 μl.
We handled the outcome variable (CRC/no CRC) and the potential predictor variables: hypermethylated DNA promoter regions (hypermethylated/not hypermethylated), CEA-levels (>/≤ 5 ng/ml, sex (male/female), and age (age>66/age≤66) as binary variables. This rendered the data suitable for logistic regression modelling. We used all the patients in the model development process and the subsequent cross-validation.
First, we calculated the median and range of the number of hypermethylated promoter regions and cell-free DNA concentrations according to CRC patients and controls. We compared the two patient groups using the non-parametric Wilcoxon-Mann-Whitney test. Secondly, using logistic regression, we performed a univariate screening of potential predictors according to the outcome variable at a significance level of p = 0.3. Thirdly, we constructed a multivariable logistic regression model, using stepwise backwards selection. Receiver operating characteristic (ROC) curves are presented and the area under the ROC curve (AUC) calculated. Interactions were evaluated between all the potential predictor variables included in the final model. All models were evaluated using Hosmer-Lemeshow’s goodness of fit test. Fourthly, we computed a Penalized regression model using Firth’s method with backwards selection, to assess the impact of separation issues on the model building process. Lastly, we performed internal validation using “Leave pair out cross validation” computing the optimism corrected AUC in order to evaluate the predictive performance of the final prediction model. The predictive performance of the final model was evaluated for all patients and after restriction to early-stage CRC patients (stage I-II).
We used STATA® V.13.1 (StataCorp LP, TX, USA) for all statistical analyses.
Review of the CRC patients led to the exclusion of twelve patients: seven with benign disease or non-colorectal cancer, three did not have any residual cancer after endoscopic resection, one patient initially refused surgery, and one patient did not provide informed consent. Five additional patients were excluded, because the reference gene could not be amplified during PCR analysis (S2 Fig). Review of the control patients lead to the exclusion of five patients with inflammatory bowel disease and 27 patients diagnosed with any kind of neoplastic disease in the years following inclusion. This left blood samples from 193 CRC patients and 102 controls without CRC. The remaining control group included 33 patients with resectable adenomas, none of which were of high-grade dysplasia. Patient characteristics are provided in Table 1.
The hypermethylation status of all the promoter regions is provided in Table 2. The median number (range) of hypermethylated promoters were four (1–11) in the control group and five (0–28) in the CRC group (p = 0.212) (Fig 1). The median level of cell-free DNA was 4.10 ng/ml (0.31–52.19) in the control group compared with 4.00 ng/ml (0.26–132.58) in the CRC group (p = 0.982).
The initial univariate screening left 19 of the potential predictor variables along with sex and age>66 for further analysis. The logistic regression with stepwise backwards selection is visualised in Fig 2. Model 12 was considered the most applicable, because it contained a limited number of genes and the model did not differ from the model produced by Penalized regression using Firth’s method. Incorporation of CEA as a binary variable (>5 ng/ml) in the stepwise selection process did not lead to a difference in marker selection.
Note. Logistic regression modelling with stepwise backwards selection. Potential predictor variables are located in the top row. Model number is recorded in the left column. Area under the receiver operating curve (AUC) according to model number and the P-value according to the removed predictor variable is located in the two rightward columns.
None of the prediction models showed a significant lack of model fit at the 0.05 significance level.
Model 12 which included seven hypermethylated gene promoter regions (ALX4, BMP3, NPTX2, RARB, SDC2, SEPT9, and VIM) and the covariates: sex(female) and age>66 had the ability to distinguish CRC patients from patients without CRC with an optimism-corrected AUC of 0.860 (optimism = 0.027) (Fig 3A). There was a significant interaction between the prediction markers RARB and VIM (p<0.001). However, inclusion of the interaction in the model only provided modest information (optimism corrected AUC = 0.869). The interaction was therefore omitted from the final model.
Note. A) ROC curve for all stage CRC with a non-optimism corrected AUC of 0.8870. B) ROC curve for stage I and II CRC with a non-optimism corrected AUC of 0.8775. Receiver operating characteristics (ROC). Colorectal cancer (CRC). Area under the receiver operating characteristics curve (AUC).
Removal of the 33 patients with adenomas from the control group did not alter the efficacy of the prediction model (optimism corrected AUC = 0.863).
In order to characterise Model 12’s performance for early stage cancers, we evaluated the model by removing the patients with stage three and four CRC. This rendered an optimism-corrected AUC of 0.853 (optimism = 0.025) (Fig 3B).
The sensitivity, specificity, positive and negative predictive values of Model 12 for CRC detection in all stages and early stages only, were calculated from the ROC analysis using a 0.5 cut point value. This cut point value led to the most accurate classification of the cancer patients and the controls. The values are provided in Table 3.
We also assessed the putative effect of PCR cycle numbers on the results of the assay, between CRC patients and controls. We classified the promoter regions into groups according to their cycle threshold values (0, 0–25, 25–30, and >30) (S4 Table). The distribution shows some difference in cycle threshold value between CRC patients and controls. However, because of limited power, the effect of this difference could not be evaluated in the multivariable logistic regression model.
In this study, we analysed a panel of 30 genes previously found to be hypermethylated in patients with CRC and other neoplasia. Through multivariable logistic regression, we selected seven gene promoter regions (ALX4, BMP3, NPTX2, RARB, SDC2, SEPT9, and VIM), which could distinguish early stage CRC patients from a colonoscopy verified CRC free control population.
Epi proColon® (Epigenomics AG Corporation, Berlin, Germany) is the only commercially available blood based DNA hypermethylation screening test for CRC. The test is based on SEPT9 hypermethylation, and even though there are promising results, there are still some drawbacks. In a large cross-sectional study of 1,516 patients scheduled for colonoscopy, the assay alone only reached a sensitivity of 48.2% at 95.1% specificity, showing the apparent lack of sensitivity as an individual CRC biomarker . We examined the SEPT9 v2 promoter, which is methylated in ~90% colorectal malignant and premalignant lesions . Our study confirmed that hypermethylation of SEPT9 measured in plasma is more frequent in CRC patients, but an acceptable sensitivity was only achieved with SEPT9 included as part of a larger panel of hypermethylated promoter regions. The best individual marker was ALX4, however, with limited sensitivity (sensitivity of 28.5% at 99.0% specificity), further emphasising the need for a multigene hypermethylation panel for CRC detection.
Interestingly, RARB hypermethylation was a protective factor, more frequently hypermethylated in healthy controls (69.6%), compared to patients with CRC (25.0%). This is in contrast with the fact that RARB has been found to be preferentially hypermethylated in early stage rectal tumours along with high-grade cervical intraepithelial lesions and high-risk prostate cancer [13,14]. Since T3 tumours represent the bulk of our CRC cohort, along with the fact that RARB methylation is lost through the progression of rectal tumours, our results could indicate that RARB hypomethylation is a biomarker for late stage CRC .
We also analysed the hypermethylation frequencies of BMP3 and NDRG4—the two genes implemented in the Cologuard® (Exact Sciences Corporation, Madison, WI, USA) stool based CRC screening assay. BMP3 reached our gene panel for CRC detection, and while NDRG4 was exclusively hypermethylated in CRC patients, it was only positive in 9.3% of cases and thus, not implemented in the model. Whether this difference is due to the media of choice (blood vs. stool) or other factors remains to be elucidated. The use of stool could provide increased DNA for analysis as colonic epithelial cells undergo anoikis. Moreover, the molecular characteristics of colorectal tumour cells is influenced by their location inside the tumour—either at the luminal front or the invasion front [16,17]. The limited sensitivity of NDRG4 in plasma could also be due to some of the factors listed in the section below.
Even though our panel of promoter regions resemble those analysed by others, there seems to be a rather large gap in both marker selection and performance. Lee et al found, that APC, MGMT, RASSF2A, and WIF1 had a sensitivity of 86.5% with a specificity of 92.1% . We evaluated three of these gene promoter regions, through our multivariate logistic regression. None reached the final model. The marker SDC2 was found through an epigenome wide association study and evaluated in serum samples, revealing a sensitivity of 92.3% for stage I CRC at a specificity of 95.2% . Our results on SDC2 are more modest with a sensitivity and specificity of 24.0% and 94.1% respectively. The differences in marker performance may be due to differences in ethnicity and choice of control population. The control population in the study by Lee et al. was only specified as Asian patients undergoing a regular health check, whereas our population is from a Caucasian patient cohort of similar age and gender referred for colonoscopy with CRC symptoms.
There are some limitations to our analytical setup.
Hypermethylated DNA promoter regions, other than the 30 included in our initial screening panel, may be more efficient as biomarkers for CRC detection. The gene promoter regions were initially selected based on a systematic literature search . We used this approach to evaluate proven CRC hypermethylation biomarkers, previously analysed in tumour remote media like blood and stool samples. Sequencing methods have since improved, providing new knowledge of complex genetic and epigenetic disruptions in colorectal carcinogenesis, and the field of epigenetic research is growing rapidly. Other approaches for the evaluation of hypermethylation biomarkers such as the implementation of an epigenome wide association study could have been used. Whether other DNA hypermethylations are more efficient as cell-free DNA based biomarkers for CRC remains to be elucidated.
Regarding the differences in marker performance, between previous studies and our current study, performance issues could be attributed to analytical limitations. Methylation specific PCR only enables the analysis of one site in each of the promoter regions, meaning that any discordance in the choice of primers and probes could lead to different results . Furthermore, we used a rather small amount of plasma (<1ml) for our analysis whereas the new kit for SEPT9 analysis (Epi proColon® 2.0 [Epigenomics AG Corporation, Berlin, Germany]) isolates DNA from ~5 ml of plasma, which renders more DNA for analysis and possible replicate analysis . This problem is stressed by the fact, that the number of cell-free tumour DNA fragments per 5 ml could be less than 10 for stage I CRC, making the amount of plasma used for methylation detection critical .
This study was exploratory in order to construct a biomarker panel of hypermethylated DNA promoter regions for CRC detection. The selection of the prediction markers was made on the entire cohort, in order to construct the most robust model. To evaluate the inherit problem of overfitting, we conducted internal validation using “leave pair out cross validation”. However, before the model can be used in a clinical setting, external validation in an independent cohort must be conducted.
The major strength of our study is the use of a cohort of consecutive CRC patients and a well-defined colonoscopy verified cancer-free control group with a comparable age and gender distribution. Other studies have employed less than optimal control groups, often not described in more detail than “healthy controls”. We have used patients who, albeit having symptoms, are an excellent representation of the screening population.
Another strength of our study is the method used for DNA extraction and bisulphite conversion for methylation analysis. Previously, the amount of DNA degradation through the bisulphite treatment was between 84 and 96% . Through an optimized conversion step, we were able to treat the DNA with bisulphite, with a recovery as high as 60%, enabling us to detect hypermethylated DNA fragments in the limited amounts of plasma available in our study.
The development of the prediction model is in full accordance with current guidelines for the development of biomarkers for outcome detection .
In our study, a panel of seven hypermethylated gene promoter regions (ALX4, BMP3, NPTX2, RARB, SDC2, SEPT9, and VIM) with the covariates: sex and age>66 was able to distinguish CRC patients from patients suspected for, but without CRC. Importantly, the model also had the ability of detecting early stage CRC with a similar performance.
This study shows, that no single hypermethylated DNA biomarker can be used in a diagnostic setting for CRC, but a panel of such may be of greater clinical interest. External validation in future studies would ensure that the diagnostic performance is reproducible.
S2 Table. Characteristics of gene specific primers and probes.
S3 Table. Characteristics of the reference gene (MEST) primers and probes.
S4 Table. Patients and controls according to cycle threshold.
S1 Fig. Hypermethylation analysis of cell-free plasma derived DNA.
The authors wish to thank all participants in the study for providing biologic material. Moreover, the authors wish to thank Bio analyst June Lundtoft for her invaluable assistance.
- 1. International Agency for Research on Cancer. GLOBOCAN 2012: Estimated Cancer Incidence, Mortality and Prevalence Worldwide in 2012. [Online Material] [Internet]. [cited 15 Feb 2016]. Available: http://globocan.iarc.fr/
- 2. Tsikitis VL, Malireddy K, Green EA, Christensen B, Whelan R, Hyder J, et al. Postoperative surveillance recommendations for early stage colon cancer based on results from the clinical outcomes of surgical therapy trial. J Clin Oncol. 2009;27: 3671–6. pmid:19564531
- 3. Lindebjerg J, Osler M, Bisgaard C. Colorectal cancers detected through screening are associated with lower stages and improved survival. Dan Med J. 2014;61: A4758. pmid:24393588
- 4. Inadomi JM, Vijan S, Janz NK, Fagerlin A, Thomas JP, Lin Y V, et al. Adherence to colorectal cancer screening: a randomized clinical trial of competing strategies. Arch Intern Med. 2012;172: 575–82. pmid:22493463
- 5. Schwarzenbach H, Hoon DSB, Pantel K. Cell-free nucleic acids as biomarkers in cancer patients. Nat Rev Cancer. 2011;11: 426–437. pmid:21562580
- 6. Payne SR. From discovery to the clinic: the novel DNA methylation biomarker (m)SEPT9 for the detection of colorectal cancer in blood. Epigenomics. Future Medicine Ltd.; 2010;2: 575–585. pmid:22121975
- 7. Church TR, Wandell M, Lofton-Day C, Mongin SJ, Burger M, Payne SR, et al. Prospective evaluation of methylated SEPT9 in plasma for detection of asymptomatic colorectal cancer. Gut. 2013;63: 317–325. pmid:23408352
- 8. Lee BB, Lee EJ, Jung EH, Chun H- K, Chang DK, Song SY, et al. Aberrant Methylation of APC, MGMT, RASSF2A, and Wif-1 Genes in Plasma as a Biomarker for Early Detection of Colorectal Cancer. Clin Cancer Res. 2009;15: 6185–6191. pmid:19773381
- 9. Tornby Stender M, Brøndum Frøkjær J, Sandie Hagedorn Nielsen T, Bjerregaard Larsen T, Lundbye-Christensen S, Elbrønd H, et al. Combined use of clinical pre-test probability and D-dimer test in the diagnosis of preoperative deep venous thrombosis in colorectal cancer patients. Thromb Haemost. 2008;99: 396–400. pmid:18278191
- 10. Rasmussen SL, Krarup HB, Sunesen KG, Pedersen IS, Madsen PH, Thorlacius-Ussing O. Hypermethylated DNA as a biomarker for colorectal cancer: a systematic review. Color Dis. 2016;18: 549–561. pmid:26998585
- 11. Pedersen I, Krarup H, Thorlacius-Ussing O, Madsen P. High recovery of cell-free methylated DNA based on a rapid bisulfite-treatment protocol. BMC Mol Biol. 2012;13: 12. pmid:22448717
- 12. Grützmann R, Molnar B, Pilarsky C, Habermann JK, Schlag PM, Saeger HD, et al. Sensitive detection of colorectal cancer in peripheral blood by septin 9 DNA methylation assay. PLoS One. Public Library of Science; 2008;3: e3759. pmid:19018278
- 13. Song M, Nishihara R, Wu K, Qian ZR, Kim SA, Sukawa Y, et al. Marine ω-3 polyunsaturated fatty acids and risk of colorectal cancer according to microsatellite instability. J Natl Cancer Inst. 2015;107. pmid:25810492
- 14. Litovkin K, Van Eynde A, Joniau S, Lerut E, Laenen A, Gevaert T, et al. DNA Methylation-Guided Prediction of Clinical Failure in High-Risk Prostate Cancer. PLoS One. 2015;10: e0130651. pmid:26086362
- 15. Leong KJ, Beggs A, James J, Morton DG, Matthews GM, Bach SP. Biomarker-based treatment selection in early-stage rectal cancer to promote organ preservation. Br J Surg. 2014;101: 1299–1309. pmid:25052224
- 16. Brabletz T, Jung A, Hermann K, G?nther K, Hohenberger W, Kirchner T. Nuclear Overexpression of the Oncoprotein β-Catenin in Colorectal Cancer is Localized Predominantly at the Invasion Front. Pathol—Res Pract. 1998;194: 701–704. pmid:9820866
- 17. Melotte V, Yi JM, Lentjes MHFM, Smits KM, Van Neste L, Niessen HEC, et al. Spectrin Repeat Containing Nuclear Envelope 1 and Forkhead Box Protein E1 Are Promising Markers for the Detection of Colorectal Cancer in Blood. Cancer Prev Res. 2015;8: 157–164. pmid:25538088
- 18. Oh T, Kim N, Moon Y, Kim MS, Hoehn BD, Park CH, et al. Genome-wide identification and validation of a novel methylation biomarker, SDC2, for blood-based detection of colorectal cancer. Journal of Molecular Diagnostics. 2013. pp. 498–507. pmid:23747112
- 19. Kurdyukov S, Bullock M. DNA Methylation Analysis: Choosing the Right Method. Biology (Basel). 2016;5: 3. pmid:26751487
- 20. Tóth K, Sipos F, Kalmár A, Patai A V, Wichmann B, Stoehr R, et al. Detection of methylated SEPT9 in plasma is a reliable screening method for both left- and right-sided colon cancers. PLoS One. 2012;7: e46000. pmid:23049919
- 21. Bettegowda C, Sausen M, Leary RJ, Kinde I, Wang Y, Agrawal N, et al. Detection of Circulating Tumor DNA in Early- and Late-Stage Human Malignancies. Sci Transl Med. American Association for the Advancement of Science; 2014;6: 224ra24. pmid:24553385
- 22. Grunau C, Clark SJ, Rosenthal A. Bisulfite genomic sequencing: systematic investigation of critical experimental parameters. Nucleic Acids Res. Oxford University Press; 2001;29: E65–5. pmid:11433041
- 23. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): the TRIPOD Statement. Br J Surg. 2015;102: 148–58. pmid:25627261