2 Nov 2012: Heitman SJ, Hilsden RJ, Au F, Dowden S, Manns BJ (2012) Correction: Colorectal Cancer Screening for Average-Risk North Americans: An Economic Evaluation. PLOS Medicine 9(11): 10.1371/annotation/0fd49c83-2c6d-42b5-a8c1-45a0aaedaa77. doi: 10.1371/annotation/0fd49c83-2c6d-42b5-a8c1-45a0aaedaa77 View correction
Colorectal cancer (CRC) fulfills the World Health Organization criteria for mass screening, but screening uptake is low in most countries. CRC screening is resource intensive, and it is unclear if an optimal strategy exists. The objective of this study was to perform an economic evaluation of CRC screening in average risk North American individuals considering all relevant screening modalities and current CRC treatment costs.
Methods and Findings
An incremental cost-utility analysis using a Markov model was performed comparing guaiac-based fecal occult blood test (FOBT) or fecal immunochemical test (FIT) annually, fecal DNA every 3 years, flexible sigmoidoscopy or computed tomographic colonography every 5 years, and colonoscopy every 10 years. All strategies were also compared to a no screening natural history arm. Given that different FIT assays and collection methods have been previously tested, three distinct FIT testing strategies were considered, on the basis of studies that have reported “low,” “mid,” and “high” test performance characteristics for detecting adenomas and CRC. Adenoma and CRC prevalence rates were based on a recent systematic review whereas screening adherence, test performance, and CRC treatment costs were based on publicly available data. The outcome measures included lifetime costs, number of cancers, cancer-related deaths, quality-adjusted life-years gained, and incremental cost-utility ratios. Sensitivity and scenario analyses were performed. Annual FIT, assuming mid-range testing characteristics, was more effective and less costly compared to all strategies (including no screening) except FIT-high. Among the lifetimes of 100,000 average-risk patients, the number of cancers could be reduced from 4,857 to 1,782 and the number of CRC deaths from 1,393 to 457, while saving CAN$68 per person. Although screening patients with FIT became more expensive than a strategy of no screening when the test performance of FIT was reduced, or the cost of managing CRC was lowered (e.g., for jurisdictions that do not fund expensive biologic chemotherapeutic regimens), CRC screening with FIT remained economically attractive.
CRC screening with FIT reduces the risk of CRC and CRC-related deaths, and lowers health care costs in comparison to no screening and to other existing screening strategies. Health policy decision makers should consider prioritizing funding for CRC screening using FIT.
Please see later in the article for the Editors' Summary
Citation: Heitman SJ, Hilsden RJ, Au F, Dowden S, Manns BJ (2010) Colorectal Cancer Screening for Average-Risk North Americans: An Economic Evaluation. PLoS Med 7(11): e1000370. doi:10.1371/journal.pmed.1000370
Academic Editor: Eduardo L. Franco, McGill University, Canada
Received: June 3, 2010; Accepted: October 14, 2010; Published: November 23, 2010
Copyright: © 2010 Heitman et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This project was supported by the Canadian Agency for Drugs and Technologies in Health and Alberta Innovates - Health Solutions. BJM and RJH are supported by Alberta Innovates - Health Scholar Awards. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: CRC, colorectal cancer; CTC, computed tomographic colonography; FDNA, fecal DNA assay; FOBT, fecal occult blood test; FIT, fecal immunochemical test; QALY, quality-adjusted life-year; RCT, randomized controlled trial
Colorectal (bowel) cancer is the second leading cause of cancer deaths for both men and women in North America. Colorectal cancer screening is an important means for reducing morbidity and mortality and fulfils the World Health Organization criteria for mass screening. However, a variety of CRC screening approaches are available. Colonoscopy is viewed as the gold standard of colorectal cancer screening as it has a high sensitivity for identifying adenomas and cancer and polyps can be removed during the screening examination. However, colonoscopy is associated with a number of complications and there are also barriers to access. Another type of test, the guaiac fecal occult blood test, has been shown to reduce mortality from colorectal cancer but this test has low sensitivity for identifying colorectal neoplasia, particularly adenomas. Fecal immunochemical tests, which also detect blood in the stool, have improved test performance characteristics (high sensitivity and specificity) and the potential to improve participation rates compared to guaiac fecal occult blood test and flexible sigmoidoscopy. Fecal DNA (a stool test, based on the detection of DNA shed by cancerous tissue) is another screening option, as is computed tomographic colonography (“virtual” colonoscopy), that might rival colonoscopy in detecting advanced adenomas and colorectal cancer but is expensive and requires a full colonic preparation.
Why Was This Study Done?
In the absence of firm comparative evidence to guide the selection of any one screening modality and given the varied test performance characteristics and the significant differences in costs and resources associated with each, a robust cost-effectiveness analysis might help health policy makers in deciding whether or not to offer screening and if so, in selecting the most appropriate and cost effective screening modality. In this study the researchers conducted a full economic evaluation of all relevant colorectal cancer screening modalities in North America.
What Did the Researchers Do and Find?
The researchers used an incremental cost-utility analysis, a sophisticated modeling technique, and two hypothetical patient cohorts (individuals with an “average risk,” i.e., no family history of colorectal cancer, aged 50–64 and 65–75) to compare guaiac-based fecal occult blood test or fecal immunochemical test annually (the researchers considered three distinct fecal immunochemical testing strategies on the basis of assays and collection methods taken from studies that have reported “low,” “mid,” and “high” test performance characteristics), fecal DNA every three years, flexible sigmoidoscopy or computed tomographic colonography every 5 years, and colonoscopy every 10 years. The researchers also included a no screening natural history arm as a comparison to each screening approach. For the baseline data of their model, the researchers used adenoma and colorectal prevalence rates from a recent systematic review and based screening adherence, test performance, and colorectal treatment costs on available data. The researchers found that annual fecal immunochemical testing with mid-range testing characteristics, was more effective and less costly compared to all strategies (including no screening). Using this screening modality, among the lifetimes of 100,000 average-risk patients, the number of cancers could be reduced from 4,857 to 1,393 and the number of deaths from colorectal cancer from 1,782 to 457, while saving CAN$68 per person. Although in the sensitivity and scenario analysis, screening patients using fecal immunochemical testing became more expensive than a strategy of no screening when the test performance of fecal immunochemical testing was reduced, or the cost of managing colorectal cancers was lowered, the researchers found that screening for colorectal cancer with fecal immunochemical testing remained the most economically attractive screening option.
What Do These Findings Mean?
This model-based economic analysis found that fecal immunochemical testing is more effective and less costly than all other colorectal screening strategies, including the most commonly-used stool-based screening test, guaiac-based fecal occult blood testing, and no screening. Furthermore, this study suggests that annual screening with fecal immunochemical testing (assuming mid-range test performance characteristics) reduces the risk of colorectal cancer and colorectal cancer–related deaths, and lowers health care costs in comparison to all other screening strategies and to no screening. Therefore, health policy makers should consider prioritizing funding for fecal immunochemical testing as the screening modality for colorectal cancer.
Please access these Web sites via the online version of this summary at http://dx.doi.org/10.1371/journal.pmed.1000370.
As the fourth most common cancer and second-leading cause of cancer death among men and women , colorectal cancer (CRC) is an important health issue. CRC fulfills the World Health Organization (WHO) criteria for mass screening , and existing clinical practice guidelines recommend that average risk individuals begin screening at age 50 –. A variety of CRC screening modalities are available, including stool-based tests and radiological and endoscopic examinations of the colon. Colonoscopy has high sensitivity for identifying adenomas and cancer and permits the removal of polyps during a screening examination . However, the risk of complications (including bleeding, perforation, and death) and barriers to access including limited availability and high patient-borne costs  diminish its appeal. The guaiac-based fecal occult blood tests (FOBTs) have been shown in randomized controlled trials (RCTs) to reduce CRC mortality –. However, FOBT has low sensitivity for identifying colorectal neoplasia, in particular adenomas. The fecal immunochemical tests (FITs) have improved test performance characteristics  and potential to improve participation rates compared to FOBT and flexible sigmoidoscopy . A third type of stool test, based on the detection of DNA shed by neoplastic tissue (fecal DNA) is also available ,. Lastly, computed tomographic colonography (CTC) or “virtual” colonoscopy is a promising new modality . Although recent studies – have shown CTC to rival colonoscopy in detecting advanced adenomas and CRC, CTC is expensive, requires a full colonic preparation, and the available cost-effectiveness data have been contradictory –.
In light of the rapidly rising costs of chemotherapy for CRC , and evidence that CRC mortality can be reduced by screening –, population-based screening programs for average risk individuals are being considered in several countries. In the absence of firm comparative evidence to guide the selection of any one modality, the practice in some jurisdictions has been to recommend choice among the available screening options –. However, some countries do not support population-based CRC screening and many with organized programs do not offer choice . Given the varied test performance characteristics and the significant differences in costs and resources associated with each, health care decision makers should consider the results of cost-effectiveness analyses when deciding whether or not to offer screening and in selecting the most appropriate screening modality.
There have been several previous economic analyses of CRC screening , though recent studies have failed to consider all potentially relevant strategies including CTC , and FIT . Furthermore, a wide range of FIT test performance has been reported, the impact of which requires further exploration in cost-effectiveness analyses. Finally, many studies have not considered current CRC treatment costs, nor the different nonmedical costs between CRC screening strategies, both of which may be important. Given these limitations, we performed a full economic evaluation of all relevant CRC screening modalities in North America, and present our results in a transparent fashion to assist medical decision makers.
An incremental cost-utility analysis was performed comparing the following CRC screening modalities: guaiac-based FOBT, FIT, fecal DNA, colonoscopy, flexible sigmoidoscopy, and CTC. These modalities were compared to each other and to a no screening natural history arm among average-risk individuals, aged 50 to 75 y. Two average-risk age-stratified patient cohorts were simultaneously modelled: people aged 50–64 and 65–75. In the base case, screening was assumed to continue from age 50–75, but the analysis continued over the lifetime of the cohorts. Average risk was defined as asymptomatic individuals with no personal or family history of CRC or adenomatous polyps and no history of preexisting medical conditions known to increase the risk of CRC (e.g., inflammatory bowel disease).
Although we acknowledge that many jurisdictions are already committed to CRC screening, we included a no screening strategy given that, despite widespread screening recommendations, the majority of individuals are not being screened . In the base case analysis, costs were those relevant to a publicly funded health care system and included patient time and travel costs in keeping with recent guidelines . Consistent with contemporary guidelines and the perspective of the publicly funded health care system, costs resulting from lost productivity were not considered . Given the impact of CRC on both quantity and quality of life, health benefits were measured in quality-adjusted life-years (QALYs) gained over a lifetime horizon. Future costs and benefits were discounted at 5% annually . Base case analyses were performed using Markov cohort simulation; second order probabilistic sensitivity analysis was used to derive 95% confidence intervals around mean costs and QALYs, and for probabilistic sensitivity analysis (see below). First order Monte Carlo simulation was used to estimate CRC incidence and death rates and the number of primary screening tests and colonoscopies required. Incremental analyses (expressed as the cost per QALY gained) were performed by rank ordering all competing strategies by increasing cost after eliminating strategies that were more costly and less effective (i.e., dominated).
Consistent with guidelines for good modeling in health care , the validity of our model was formally established including extensive “debugging” exercises and calibration to published clinical datasets –. Gastroenterologists, including two of the authors (SJH and RJH), carefully reviewed the structure and flow of the model. The model was also reviewed by Alaa Rostom, Gastroenterologist and Medical Director at the Forzani and MacPhail Colon Cancer Screening Centre in Calgary, Alberta. Ultimately, it was determined that the model had good face validity. After ensuring that there were no syntactical errors, we first calibrated the model's no screening arm against the no screening control arms of the landmark FOBT RCTs –. For this we used baseline adenoma and CRC prevalence rates from a contemporary meta-analysis  and ensured that the number of cancers and cancer deaths generated by our model closely approximated the control arms of the clinical trials over an identical follow-up period. We next ensured that the number of cancers and cancer deaths predicted by the FOBT screening arms closely approximated those noted within the FOBT arms of the FOBT RCTs. All of the other strategies were validated in a similar fashion assuring face validity and calibration. Finally, we also compared our CRC and CRC death rate with those generated by another validated decision analytical model, noting near perfect correlation .
Computer Simulation Model
The Markov model was constructed using decision analysis software (TreeAge Pro Suite 2007). It was assumed that all CRCs arise through the following sequence: normal colon → nonadvanced adenoma → advanced adenoma → CRC. Nonadvanced adenomas were defined as tubular adenomas <10 mm in size. Advanced adenomas comprised any adenoma ≥10 mm regardless of histology, and adenomas <10 mm containing at least 25% villous component and/or high grade dysplasia. We considered several general health states, including (1) alive with no prevalent or prior history of adenomas or CRC, (2) alive with a missed adenoma, (3) alive with a missed asymptomatic CRC, (4) alive with a missed CRC after presenting with symptoms, (5) alive with a CRC found by screening, (6) alive post polypectomy, and (7) dead. Each year (1-y cycle length), individuals with or without adenomas or CRC could either remain in the same health state, progress to another health state, or die (Figure 1).
This diagram depicts the general health states and flow through the model.
In the base case, screening was offered annually for FOBT and FIT, every 3 y for fecal DNA, every 5 y for flexible sigmoidoscopy and CTC, and every 10 y for colonoscopy. Once a patient was diagnosed with either an adenoma or CRC, the model's design permitted subsequent surveillance with colonoscopy at either 3- or 5-y intervals depending on the results of the last colonoscopy, consistent with current guidelines –. Screening and surveillance commenced at age 50 and stopped at age 75.
Risk of polyps and CRC and the adenoma-carcinoma sequence.
We based our prevalence estimates of adenomatous polyps and CRC on a recent systematic review among those at average risk for CRC . Age was determined to be an important source of heterogeneity in the pooled estimates , and thus the prevalence rates in our model were stratified into two age categories: 50–64 and 65–75 y (Table 1).
Not all polyps are adenomatous. However, determining a polyp's histology generally requires that it be biopsied or removed. As a result, some polypectomies expose patients to complications without reducing the risk of CRC. We estimated that 41%  of polyps <10 mm were adenomatous compared to 82% of polyps ≥10 mm (Table 1) . Screening guidelines recommend that all polyps be removed at the time of a colonoscopy to determine histology and establish an appropriate surveillance interval. Although some advocate for ignoring polyps <5 mm in size found on CTC, we assumed that all patients with polyps found on CTC regardless of size would be referred for colonoscopy. The risk of proximal adenomatous polyps and CRC is increased among those with adenomatous polyps in the left colon . As such, we assumed that patients with left-sided adenomas found on flexible sigmoidoscopy would be referred for colonoscopy consistent with general clinical practice.
The rate of progression of adenomatous polyps is not well established. We initially chose progression rates that were consistent with other published models , and made small adjustments to these rates to ensure that the total number of CRCs in our natural history/no screening strategy closely approximated the number of CRCs found in the control arms of the FOBT trials .
Death occurred according to either age-dependent population mortality rates observed for Canadians  or based on the mortality rates observed for patients with CRC according to their stage at diagnosis (Table 1) . Those with CRC found through screening were assumed to have improved survival over patients presenting with symptomatic cancer, on the basis of a more favorable stage distribution (i.e., more early stage cancers) at diagnosis (Table 1).
Adherence is important to the overall effectiveness of a screening program. Even in a randomized trial comparing annual FOBT with no screening, only 68% of patients who were randomized to FOBT actually completed the initial screen and 63% were compliant with subsequent rescreening. Moreover, for patients with positive FOBT results, only 81% had a colonoscopy . We adopted these imperfect adherence rates and assumed in the base case that adherence would be the same across strategies (Table 1).
Test performance characteristics of the CRC screening strategies.
The only method for properly assessing the test performance of a given screening modality is to compare it with a reference standard in all cases. Although colonoscopy is not infallible , it remains the accepted gold standard for evaluating the entire colon. Therefore, the base case sensitivities and specificities for polyps and CRC for each of the screening modalities were taken from the literature following a thorough search for properly designed studies that included at least a full colonoscopy in all individuals (Table 2). For the stool-based tests and for CTC, the test performance characteristics were considered on a per person basis.
Given significant differences even between the alternative stool-based screening tests themselves (often due to different collection methods or assay types), it would not be appropriate to consider them as a class . As such, we modeled different test performance scenarios for each test. A low  and high  performance level was modeled for FOBT tests that have reported in the literature (FOBT-low and FOBT-high, respectively) and a low ,, mid , and high  performance level was modeled for FIT assays that have been reported in the literature (FIT-low, FIT-mid, and FIT-high, respectively). The intent of modeling different levels of test performance for FOBT and FIT was to represent the range reported in the literature. This range is greatest for FIT, likely due to differences in collection methods and assays (Table 2). FIT-low represents that reported by Morikawa et al. , who studied the Magstream system with 1 d of stool collection. FIT-mid represents that reported by Nakama et al.  who used a 2-d method with the Monohaem system. FIT-high represents that reported by Levi et al.  who used the FlexSure OBT technology following 3 d of fecal collection. Both the first-  and second-  generation fecal DNA assays were modeled (FDNA-SDT1 and FDNA-SDT2, respectively).
Flexible sigmoidoscopy can evaluate the left colon to the splenic flexure, although this is not always possible . Routine clinical practice is generally to perform a full colonoscopy in individuals found to have an adenomatous polyp on flexible sigmoidoscopy. As such, the sensitivity of flexible sigmoidoscopy includes the additional lesions found by colonoscopy in patients identified as having an adenoma on flexible sigmoidoscopy –.
CTC and colonoscopy.
Landmark studies , that employed segmental unblinding methodology  provided the base case test performance estimates for both CTC and colonoscopy when possible. The sensitivity and specificity of CTC for polyps ≥10 mm was taken from the National CT Colonography Trial of the American College of Radiology Imaging Network (ACRIN) , a large multicenter study of CTC among primarily average-risk individuals. Polyps <5 mm were not reported in this study or other large cohorts of average risk individuals. However, we optimistically assumed that the sensitivity reported for 6–9 mm polyps would be the same for all polyps <10 mm. In a sensitivity analysis we reduced the sensitivity of polyps <10 mm to that reported in a meta-analysis of CTC that included higher risk patients . The sensitivity of colonoscopy for polyps ≥10 mm was taken from the study of Pickhardt et al. , which reported the test performance of both CTC and colonoscopy based on segmental unblinding. As this study also did not report data for polyps <5 mm, the sensitivity of colonoscopy for polyps <10 mm was taken from two back-to-back colonoscopy studies (Table 2) ,.
Flexible sigmoidoscopy and colonoscopy are associated with risks including bleeding, perforation, and rarely, death (Table 1). Even though CTC is less invasive than colonoscopy, colonic perforations have been reported –, though many of the small CTC induced perforations diagnosed with the CT in asymptomatic individuals may not be clinically important. We assumed a low risk of CTC-induced perforation in the base case analysis ,, and that this would never result in death (Table 1).
Costs related to screening. All costs are reported in 2008 CAN$. The direct costs of flexible sigmoidoscopy and colonoscopy, as well as costs attributed to bleeding and perforation complications , were based on local estimates derived from the Calgary Health Region costing database  and included the nonphysician costs (capital, nursing, drugs, and cleaning costs) and the physician fees for the procedure (Table 3). CTC for primary CRC screening is not currently part of the schedule of medical benefits in any province in Canada. The direct costs of CTC were therefore conservatively assumed to be the same as that of a CT abdomen/pelvis, likely an underestimate (Table 3). We assumed that stool-based screening would be offered at a person's annual visit to their general practitioner, and as such, we only considered the cost of the screening kit and related laboratory/processing costs (Table 3).
For all screening modalities, we included the relevant patient ± caregiver time and travel costs (nonmedical costs), on the basis of available surveys for flexible sigmoidoscopy, colonoscopy, FOBT, and CTC (Table 3) ,,. The nonmedical costs of FIT and fecal DNA were assumed to be the same as FOBT. In the base case, we did not consider the capital costs of initiating or administering a screening program and thus assumed that screening would be opportunistic in all strategies.
Costs related to managing CRC. Existing published data on the total costs of managing patients with CRC are outdated. We assumed that the cost of surgery for CRC has remained relatively stable and thus based our surgical costs on a Canadian study reporting 1998 figures, inflation adjusted to 2008 dollars .
In contrast, the cost of treating CRC with chemotherapy has increased substantially because of the development of more expensive agents . To estimate the cost of chemotherapy provided for advanced CRC, we used data from the Canadian Inter-Provincial Joint Oncology Drug Review (JODR) Process . These estimates were the average stage-based treatment costs for chemotherapy, taking into account that not all patients would be eligible for or would comply with treatment. Patients with stage IIB disease (∼50% of stage II patients) are generally managed with adjuvant chemotherapy using eight cycles of capecitabine ,. First line therapy for patients with stage III CRC was assumed to be 6 mo of oxaliplatin-based therapy . Considering the most recent clinical trials and assumed standards of care, the average patient with stage IV CRC received approximately 10 mo of infusional fluorouracil (5-FU), leucovorin, and oxaliplatin (FOLFOX) in combination with bevacizumab, followed by 14 doses of infusional 5-FU, leucovorin, and irinotecan (FOLFIRI). Those lacking K-Ras mutations were assumed to go on to receive 4 mo of anti-epidermal growth factor receptor–based inhibition therapy. We did not include the potential costs of liver metastectomy among stage IV patients, or the cost of preoperative radiation therapy in patients with operable rectal cancer.
Valuing health benefits.
Health benefits were measured in terms of QALYs gained. We obtained utilities for relevant health states on the basis of a study that used a standard gamble exercise in patients with a previous history of CRC or polyps who were presented with stage-dependent outcome states for CRC (Table 1) .
Allowance for uncertainty in the base case polyp and CRC prevalence estimates, mortality assumptions, screening test performance characteristics, screening-related risks, and costs were considered through the use of univariate and probabilistic sensitivity analyses. A number of scenario analyses were also included. We considered a scenario in which the additional costs of biologic chemotherapies for advanced stage CRC were excluded. We also examined scenarios where FIT was offered every 2 y instead of annually and analyzed our results without nonmedical costs. We assessed the impact of differential adherence rates across strategies at the initial screening encounter. For this analysis, we used the adherence rates determined by Hol et al. in a RCT comparing participation rates of FOBT, FIT, and flexible sigmoidoscopy in a screening population . As Hol et al.  did not study fecal DNA, colonoscopy, or CTC, we assumed that fecal DNA would have the same adherence as FIT due to its comparable simplicity for patients, and we assumed that colonoscopy would have the same adherence as flexible sigmoidoscopy. We also assessed the impact of lower subsequent adherence for the annual stool-based tests, since screening noncompliance may be more prevalent with an annual test compared to one offered less frequently. To do this assessment, we examined scenarios with decreased FOBT and FIT follow-up adherence.
Because we did not include any administrative costs for any of the CRC screening programs, we performed a sensitivity analysis to assess the impact of including administrative costs for the various screening tests. We were unable to identify a document that has reported the setup and operating costs for a population-based CRC screening program, but it is possible that programs that screen annually (i.e., stool-based tests) might have higher administrative costs than ones that screen patients every 10 y (i.e., colonoscopy). We provide sensitivity analyses varying the administrative costs per screening test between CAN$10 and CAN$50 to determine the impact on the results, making the assumption that programs screening more frequently will incur higher administrative costs.
To address limitations in classic univariate sensitivity analysis, we also performed probabilistic sensitivity analysis, which allows for the simultaneous sensitivity analysis of all variables over their plausible range ,. It does so by replacing estimates of probabilities, utilities, and costs with specific probability distributions, which are based on the reported means and variances for each variable. Statistical distributions were created around all of the variables for which there was substantial measurement uncertainty, including use of a beta distribution for proportions (i.e., mortality, proportion of patients with Stage I, II, III, and IV cancer), use of a normal distribution for normally distributed variables (i.e., certain costs and utility measures), log-normal distribution for skewed variables (i.e., certain costs), and triangular distributions for variables with a range, but no statistical distribution (i.e., adenoma transition over time, probability of adherence). Given that sensitivity and specificity are linked variables that do not vary independently (linked via receiver operating curves that were unavailable), these variables were not included within the probabilistic analyses—as noted above, the sensitivity and specificity of the various screening tests were subjected to wide sensitivity analysis using the testing characteristics provided by different primary studies.
Base Case Analysis
Annual CRC screening using FIT, assuming mid-range test performance characteristics, was the preferred strategy for average risk individuals in the base case analysis (Table 4). It was more effective and less costly than almost all of the other strategies including no screening. Only FIT when assuming even better test performance characteristics (i.e., FIT-high) produced more QALYs and resulted in fewer CRCs than FIT-mid, but at an additional cost of CAN$85,150 per QALY gained.
Using base case estimates, over the lifetimes of a 100,000 patient cohort, 4,857 and 1,782 individuals would develop and die from CRC, respectively, if CRC screening was not undertaken (Table 5). This “no screening” strategy would be expected to cost an average of CAN$1,901 per patient. Annual screening with FIT-mid would reduce the overall number of cancers by 71% and CRC mortality by 74% while saving CAN$68 per patient. Compared with the most effective FOBT strategy, FIT-mid would be expected to reduce the number of cancers by 60%, and CRC mortality by 63%, while saving CAN$362 per person.
Under no circumstances did flexible sigmoidoscopy, FOBT, CTC, or fecal DNA appear attractive in comparison to other CRC screening modalities. As such, these strategies are not reported in our sensitivity analysis table (Table 6). Lowering the cost of CRC treatment by excluding the use of biologic chemotherapies resulted in a scenario where FIT-mid resulted in additional costs compared to no screening (CAN$163 per patient or CAN$3,691 per QALY gained). Increasing the cost of FIT testing by 50% had a similar effect; FIT-mid cost an additional CAN$105 per patient and was associated with a cost per QALY of CAN$2,375 compared to no screening. Biennial screening using FIT-mid increased the cost savings when compared to no screening. However, performing FIT less frequently also made it less effective.
When the initial adherence rates for each of the strategies was no longer assumed to be identical, FIT-mid remained dominant over no screening (Table 6). Assuming the base case initial adherence rates, when we dropped the adherence rates for subsequent screens for all of the annual fecal-based strategies, FIT-mid remained dominant over no screening. However, when subsequent adherence for FIT was dropped from 63% to 40%, both FIT-mid and FIT-high became dominant over no screening, and colonoscopy became the most effective strategy at a cost per QALY gained of CAN$300,609 compared to FIT-high. When subsequent adherence for FIT was decreased to only 20%, colonoscopy remained the most effective strategy, at a cost per QALY gained of CAN$32,912 compared to FIT-high (Table 6).
Finally, we performed a sensitivity analysis to assess the impact of higher administrative costs that might be associated with an annual screening program (i.e., FIT) compared to one offered less frequently (i.e., colonoscopy). We noted that FIT remained dominant over no screening unless the administrative costs were ∼CAN$10 per test. If administrative costs were CAN$30 per test, annual FIT was associated with a cost per QALY of CAN$3,120 compared with no screening. However, if the administrative costs were CAN$50 per test, then colonoscopy would be the preferred screening modality compared with FIT, and would be associated with a cost per QALY gained of CAN$5,903 compared with no screening.
Our probabilistic sensitivity analysis revealed that FIT-mid was cost saving and more effective compared with no screening in nearly 100% of the simulations performed, confirming the robustness of the results (Figure 2).
An incremental cost-effectiveness scatterplot comparing FIT-mid with no screening in which the uncertainty in all model inputs has been tested simultaneously. Data points in the lower right quadrant reflect situations where FIT-mid is more effective and less costly than no screening.
Our study demonstrates that annual screening with FIT, assuming mid-range test performance characteristics, is more effective and less costly than other CRC screening strategies, including the most commonly used stool-based CRC screening test, FOBT, and no screening. Among a cohort of 100,000 average risk individuals followed until death, 4,857 cancers and 1,782 cancer-related deaths would be expected with no screening. An annual FIT with high sensitivity for cancer (81%) and moderate sensitivity for advanced adenomas (54%)  could reduce costs and decrease the number of CRCs and cancer-related deaths to 1,393 and 457, respectively. Screening with FIT was also more effective at reducing cancer and cancer-related deaths at lower costs compared with FOBT.
FIT represents a significant advance over the traditional guaiac-based FOBTs, in large part due to FITs improved sensitivity for identifying adenomatous polyps. Our findings underscore the importance of identifying patients with advanced adenomas and preventing cancer through the identification and removal of precancerous polyps. Indeed, changing the sensitivity of FIT for cancer had relatively little impact on our results, whereas reducing the sensitivity of FIT for advanced adenomas from 54% to below 45% resulted in FIT no longer being cost saving compared with no screening.
Although it may seem counter-intuitive that screening with FIT could be even more effective than colonoscopy, this is due to the more frequent screening interval with FIT. In base case analyses, and consistent with current guidelines ,, screening with FIT was done annually compared to every 10 y with colonoscopy. Therefore, even though the test performance of a single FIT test was inferior to colonoscopy, there were more opportunities to identify previously missed pathology with FIT compared to colonoscopy.
Our results are robust. FIT with mid-range performance (FIT-mid) remained optimal compared with no screening and all the other strategies except FIT with even better test performance (FIT-high) unless the cost of CRC treatment was reduced, or the sensitivity for advanced adenomas was decreased significantly. However, even with lower CRC treatment costs, FIT remained economically attractive. Many health jurisdictions now fund biologic chemotherapies for advanced-stage CRC and with further advances in CRC chemotherapy, it is unlikely that management costs for CRC will decrease . In addition, our modeled CRC treatment costs were lower than those used in a recent US study that had similar results , lending further support to the notion that CRC screening can indeed save money.
It is possible that the administrative costs of annual screening programs such as FIT would be more expensive over the long-run compared with those offered every 5 or 10 y. As these data are not known, we did not consider administrative costs or the costs to build and staff additional screening centers in our primary analysis. However, in sensitivity analysis, we noted that FIT-mid remained cost saving if the administration costs were <CAN$10 per test, and remained attractive compared with colonoscopy even if the administrative costs per test were CAN$30 per test. It should also be noted that the additional infrastructure required to implement primary screening with CTC, flexible sigmoidoscopy, or colonoscopy would likely counterbalance a substantial portion of these additional administrative costs of an annual screening program.
We assumed in the base case that adherence would be identical across all of the CRC screening strategies. Although this may not be true, we are unaware of a study that has evaluated screening uptake for all of the strategies we considered. However, fecal-based screening does not require a bowel preparation, is associated with lower patient-borne costs, and is safe to perform, which may be more appealing to the general population. Furthermore, FIT does not require any dietary restrictions. Indeed, in a recent randomized trial, FIT was associated with higher screening uptake than flexible sigmoidoscopy and FOBT . Of course, this finding only strengthens our conclusions as illustrated in our scenario analysis in which FIT had relatively higher adherence than all of the other strategies (Table 6). Recent data suggest that screening adherence with FOBT may drop by 50% after only 2 y in a biennial screening program ; this may affect programs with frequent screening (i.e., annual fecal-based strategies) to a greater extent than programs requiring less frequent screening (i.e., colonoscopy). As expected, when we dropped our subsequent adherence rates for FOBT and FIT, FIT-mid became less effective, though it remained dominant compared with no screening. In contrast, colonoscopy became the most effective strategy when the subsequent adherence rates for FOBT and FIT were dropped from 63% to 40%, though it was associated with an unattractive incremental cost per QALY. It is clear that further information on long-term adherence rates for annual stool-based tests are needed.
Our study has limitations. As with most economic evaluations, our results are limited by available evidence. The natural history of adenomas and their progression to cancer is not clearly known. However, we populated our model with the best available evidence including a systematic review of adenoma and CRC prevalence rates  and modeled new adenoma growth and adenoma progression over time to closely match high quality clinical datasets –. We did not model cancers arising from lesions other than adenomas. However, most CRCs arising in average risk individuals are believed to develop via the traditional adenoma-carcinoma sequence. A small proportion of CRC may develop from undetectable lesions (i.e., flat or depressed adenomas), and it is known that some interval cancers can arise through a rapid adenoma-carcinoma sequence between screening studies . It should be noted that this potential issue would impact the effectiveness of all CRC screening modalities, and thus would be unlikely to impact the differential effectiveness between our modeled strategies. Given data limitations, we modeled identical CRC stage distributions for cancers detected using all of the stool-based strategies despite differences in testing characteristics. Given FIT's superior sensitivity compared to FOBT, patients diagnosed with CRC might be expected to have more earlier stage cancers, which again would make FIT appear more attractive. We assumed that the results of each screening test were independent of the prior test result. While not informed by evidence, it is possible that this is not entirely true; however, it is important to note that the results of our analysis were robust to small changes in the sensitivity and specificity of each of the screening tests. Finally, although we did model the most widely available and promising screening strategies, additional technologies are being developed and it is possible that other screening paradigms, including nurse-based endoscopy, may become viable in the future as a means to reduce the cost of delivering flexible sigmoidoscopy and potentially colonoscopy.
In conclusion, annual screening with FIT having test performance characteristics within the mid-range reported in the literature is both more effective and less costly than other CRC screening modalities, including FOBT and colonoscopy, and not screening for CRC. Even if this level of test performance is not attainable in clinical practice, annual screening with a lower performing FIT is still highly attractive with a cost per QALY gained of <CAN$5,000 compared to no screening. Our results are robust suggesting that screening for CRC with FIT should be considered the modality of choice for average risk patients between the ages of 50 and 75 in North America.
ICMJE criteria for authorship read and met: SJH RJH FA SD BJM. Agree with the manuscript's results and conclusions: SJH RJH FA SD BJM. Designed the experiments/the study: SJH RJH BJM. Analyzed the data: SJH FA BJM. Collected data/did experiments for the study: SJH FA SD BJM. Wrote the first draft of the paper: SJH FA. Contributed to the writing of the paper: RJH FA SD BJM.
- 1. Jemal A, Siegel R, Ward E, Murray T, Xu J, et al. (2007) Cancer statistics, 2007. CA Cancer J Clin 57: 43–66.
- 2. Wilson JMG, Junger G (1968) Principles and practice of screening for disease. Geneva: WHO.
- 3. (2008) Screening for colorectal cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 149: 627–637.
- 4. Leddin D, Hunt R, Champion M, Cockeram A, Flook N, et al. (2004) Canadian Association of Gastroenterology and the Canadian Digestive Health Foundation: Guidelines on colon cancer screening. Can J Gastroenterol 18: 93–99.
- 5. Winawer S, Fletcher R, Rex D, Bond J, Burt R, et al. (2003) Colorectal cancer screening and surveillance: clinical guidelines and rationale-Update based on new evidence. Gastroenterology 124: 544–560.
- 6. Levin B, Lieberman DA, McFarland B, Andrews KS, Brooks D, et al. (2008) Screening and surveillance for the early detection of colorectal cancer and adenomatous polyps, 2008: a joint guideline from the American Cancer Society, the US Multi-Society Task Force on Colorectal Cancer, and the American College of Radiology. Gastroenterology 134: 1570–1595.
- 7. Lieberman D (2004) Colonoscopy: as good as gold? Ann Intern Med 141: 401–403.
- 8. Heitman SJ, Au F, Manns BJ, McGregor SE, Hilsden RJ (2008) Nonmedical costs of colorectal cancer screening with the fecal occult blood test and colonoscopy. Clin Gastroenterol Hepatol 6: 912-917 e911:
- 9. Hardcastle JD, Chamberlain JO, Robinson MH, Moss SM, Amar SS, et al. (1996) Randomised controlled trial of faecal-occult-blood screening for colorectal cancer. Lancet 348: 1472–1477.
- 10. Kronborg O, Fenger C, Olsen J, Jorgensen OD, Sondergaard O (1996) Randomised study of screening for colorectal cancer with faecal-occult-blood test. Lancet 348: 1467–1471.
- 11. Mandel JS, Bond JH, Church TR, Snover DC, Bradley GM, et al. (1993) Reducing mortality from colorectal cancer by screening for fecal occult blood. Minnesota Colon Cancer Control Study. N Engl J Med 328: 1365–1371.
- 12. van Rossum LG, van Rijn AF, Laheij RJ, van Oijen MG, Fockens P, et al. (2008) Random comparison of guaiac and immunochemical fecal occult blood tests for colorectal cancer in a screening population. Gastroenterology 135: 82–90.
- 13. Hol L, van Leerdam ME, van Ballegooijen M, van Vuuren AJ, van Dekken H, et al. (2010) Screening for colorectal cancer: randomised trial comparing guaiac-based and immunochemical faecal occult blood testing and flexible sigmoidoscopy. Gut 59: 62–68.
- 14. Ahlquist DA, Sargent DJ, Loprinzi CL, Levin TR, Rex DK, et al. (2008) Stool DNA and occult blood testing for screen detection of colorectal neoplasia. Ann Intern Med 149: 441-450, W481:
- 15. Itzkowitz SH, Jandorf L, Brand R, Rabeneck L, Schroy PC, 3rd, et al. (2007) Improved fecal DNA test for colorectal cancer screening. Clin Gastroenterol Hepatol 5: 111–117.
- 16. Johnson CD, Chen MH, Toledano AY, Heiken JP, Dachman A, et al. (2008) Accuracy of CT colonography for detection of large adenomas and cancers. N Engl J Med 359: 1207–1217.
- 17. Kim DH, Pickhardt PJ, Taylor AJ, Leung WK, Winter TC, et al. (2007) CT colonography versus colonoscopy for the detection of advanced neoplasia. N Engl J Med 357: 1403–1412.
- 18. Pickhardt PJ, Choi JR, Hwang I, Butler JA, Puckett ML, et al. (2003) Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults. N Engl J Med 349: 2191–2200.
- 19. Heitman SJ, Manns BJ, Hilsden RJ, Fong A, Dean S, et al. (2005) Cost-effectiveness of computerized tomographic colonography versus colonoscopy for colorectal cancer screening. Cmaj 173: 877–881.
- 20. Pickhardt PJ, Hassan C, Laghi A, Zullo A, Kim DH, et al. (2007) Cost-effectiveness of colorectal cancer screening with computed tomography colonography: the impact of not reporting diminutive lesions. Cancer 109: 2213–2221.
- 21. Vijan S, Hwang I, Inadomi J, Wong RK, Choi JR, et al. (2007) The cost-effectiveness of CT colonography in screening for colorectal neoplasia. Am J Gastroenterol 102: 380–390.
- 22. Schrag D (2004) The price tag on progress--chemotherapy for colorectal cancer. N Engl J Med 351: 317–319.
- 23. Benson VS, Patnick J, Davies AK, Nadel MR, Smith RA, et al. (2008) Colorectal cancer screening: a comparison of 35 initiatives in 17 countries. Int J Cancer 122: 1357–1367.
- 24. Pignone M, Saha S, Hoerger T, Mandelblatt J (2002) Cost-effectiveness analyses of colorectal cancer screening: a systematic review for the U.S. Preventive Services Task Force. Ann Intern Med 137: 96–104.
- 25. Parekh M, Fendrick AM, Ladabaum U (2008) As tests evolve and costs of cancer care rise: reappraising stool-based screening for colorectal neoplasia. Aliment Pharmacol Ther 27: 697–712.
- 26. Zauber AG, Lansdorp-Vogelaar I, Knudsen AB, Wilschut J, van Ballegooijen M, et al. (2008) Evaluating test strategies for colorectal cancer screening: a decision analysis for the U.S. Preventive Services Task Force. Ann Intern Med 149: 659–669.
- 27. Ho C, Heitman S, Membe SK, Morrison A, Moulton K, et al. (2008) Computed tomographic colonography for colorectal cancer screening in an average risk population: systematic review and economic evaluation. In: Canadian Agency for Drugs and Technologies in Health , editor. Ottawa, Canada: Canadian Agency for Drugs and Technologies in Health.
- 28. Rabeneck L, Paszat LF (2004) A population-based estimate of the extent of colorectal cancer screening in Ontario. Am J Gastroenterol 99: 1141–1144.
- 29. Canadian Agency for Drugs and Technologies in Health , editor. (2006) Guidelines for the economic evaluation of health technologies. Ottawa, Canada: Canadian Agency for Drugs and Technologies in Health. 3rd edition.
- 30. Weinstein MC, O'Brien B, Hornberger J, Jackson J, Johannesson M, et al. (2003) Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices--Modeling Studies. Value Health 6: 9–17.
- 31. Heitman SJ, Ronksley PE, Hilsden RJ, Manns BJ, Rostom A, et al. (2009) Prevalence of adenomas and colorectal cancer in average risk individuals: a systematic review and meta-analysis. Clin Gastroenterol Hepatol 7: 1272–1278.
- 32. Winawer SJ, Fletcher RH, Miller L, Godlee F, Stolar MH, et al. (1997) Colorectal cancer screening: clinical guidelines and rationale. Gastroenterology 112: 594–642.
- 33. Pickhardt PJ, Choi JR, Hwang I, Schindler WR (2004) Nonadenomatous polyps at CT colonography: prevalence, size distribution, and detection rates. Radiology 232: 784–790.
- 34. Lewis JD, Ng K, Hung KE, Bilker WB, Berlin JA, et al. (2003) Detection of proximal adenomatous polyps with screening sigmoidoscopy: a systematic review and meta-analysis of screening colonoscopy. Arch Intern Med 163: 413–420.
- 35. (2007) Death, by age group and sex, Canada, provinces and territories, annual. Ottawa, Canada: Statistics Canada.
- 36. O'Connell JB, Maggard MA, Ko CY (2004) Colon cancer survival rates with the new American Joint Committee on Cancer sixth edition staging. J Natl Cancer Inst 96: 1420–1425.
- 37. Whitlock EP, Lin JS, Liles E, Beil TL, Fu R (2008) Screening for colorectal cancer: a targeted, updated systematic review for the U.S. Preventive Services Task Force. Ann Intern Med 149: 638–658.
- 38. Imperiale TF, Ransohoff DF, Itzkowitz SH, Turnbull BA, Ross ME (2004) Fecal DNA versus fecal occult blood for colorectal-cancer screening in an average-risk population. N Engl J Med 351: 2704–2714.
- 39. Morikawa T, Kato J, Yamaji Y, Wada R, Mitsushima T, et al. (2007) Sensitivity of immunochemical fecal occult blood test to small colorectal adenomas. Am J Gastroenterol 102: 2259–2264.
- 40. Morikawa T, Kato J, Yamaji Y, Wada R, Mitsushima T, et al. (2005) A comparison of the immunochemical fecal occult blood test and total colonoscopy in the asymptomatic population. Gastroenterology 129: 422–428.
- 41. Nakama H, Zhang B, Zhang X (2001) Evaluation of the optimum cut-off point in immunochemical occult blood testing in screening for colorectal cancer. Eur J Cancer 37: 398–401.
- 42. Levi Z, Rozen P, Hazazi R, Vilkin A, Waked A, et al. (2007) A quantitative immunochemical fecal occult blood test for colorectal neoplasia. Ann Intern Med 146: 244–255.
- 43. Painter J, Saunders DB, Bell GD, Williams CB, Pitt R, et al. (1999) Depth of insertion at flexible sigmoidoscopy: implications for colorectal cancer screening and instrument design. Endoscopy 31: 227–231.
- 44. Imperiale TF, Wagner DR, Lin CY, Larkin GN, Rogge JD, et al. (2000) Risk of advanced proximal neoplasms in asymptomatic adults according to the distal colorectal findings. N Engl J Med 343: 169–174.
- 45. Imperiale TF, Wagner DR, Lin CY, Larkin GN, Rogge JD, et al. (2003) Using risk for advanced proximal colonic neoplasia to tailor endoscopic screening for colorectal cancer. Ann Intern Med 139: 959–965.
- 46. Lieberman DA, Weiss DG, Bond JH, Ahnen DJ, Garewal H, et al. (2000) Use of colonoscopy to screen asymptomatic adults for colorectal cancer. Veterans Affairs Cooperative Study Group 380. N Engl J Med 343: 162–168.
- 47. Pineau BC, Paskett ED, Chen GJ, Durkalski VL, Espeland MA, et al. (2001) Validation of virtual colonoscopy in the detection of colorectal polyps and masses: rationale for proper study design. Int J Gastrointest Cancer 30: 133–140.
- 48. Mulhall BP, Veerappan GR, Jackson JL (2005) Meta-analysis: computed tomographic colonography. Ann Intern Med 142: 635–650.
- 49. Hixson LJ, Fennerty MB, Sampliner RE, McGee D, Garewal H (1990) Prospective study of the frequency and size distribution of polyps missed by colonoscopy. J Natl Cancer Inst 82: 1769–1772.
- 50. Rex DK, Cutler CS, Lemmel GT, Rahmani EY, Clark DW, et al. (1997) Colonoscopic miss rates of adenomas determined by back-to-back colonoscopies. Gastroenterology 112: 24–28.
- 51. Burling D, Halligan S, Slater A, Noakes MJ, Taylor SA (2006) Potentially serious adverse events at CT colonography in symptomatic patients: national survey of the United Kingdom. Radiology 239: 464–471.
- 52. Pickhardt PJ (2006) Incidence of colonic perforation at CT colonography: review of existing data and implications for screening of asymptomatic adults. Radiology 239: 313–316.
- 53. Sosna J, Blachar A, Amitai M, Barmeir E, Peled N, et al. (2006) Colonic perforation at CT colonography: assessment of risk in a multicenter large cohort. Radiology 239: 457–463.
- 54. Heitman SJ, Fong A, Rabeneck L, Manns BJ, Hilsden RJ (2005) Direct costs of bleeding and perforation complications from colonoscopy. Am J Gastroenterol 100: S281.
- 55. Lee H, Manns B, Taub K, Ghali WA, Dean S, et al. (2002) Cost analysis of ongoing care of patients with end-stage renal disease: the impact of dialysis modality and dialysis access. Am J Kidney Dis 40: 611–622.
- 56. Frew E, Wolstenholme JL, Atkin W, Whynes DK (1999) Estimating time and travel costs incurred in clinic based screening: flexible sigmoidoscopy screening for colorectal cancer. J Med Screen 6: 119–123.
- 57. Hilsden R, Heitman S, Au F, Manns B, McGregor E (2008) Non-medical costs of colorectal cancer screening using computed tomographic colonography. Am J Gastroenterol 103:
- 58. Maroun J, Ng E, Berthelot JM, Le Petit C, Dahrouge S, et al. (2003) Lifetime costs of colon and rectal cancer management in Canada. Chronic Dis Can 24: 91–101.
- 59. (2008) Guidelines: Committee to Evaluate Drugs - Cancer Care Ontario Joint Drug Review Process, Ontario Drug Benefit Plan. Toronto, Canada: Ontario Ministry of Health.
- 60. Kerr DJ, Gray R, McConkey C, Barnwell J (2000) Adjuvant chemotherapy with 5-fluorouracil, L-folinic acid and levamisole for patients with colorectal cancer: non-randomised comparison of weekly versus four-weekly schedules--less pain, same gain. QUASAR Colorectal Cancer Study Group. Ann Oncol 11: 947–955.
- 61. Scheithauer W, McKendrick J, Begbie S, Borner M, Burns WI, et al. (2003) Oral capecitabine as an alternative to i.v. 5-fluorouracil-based adjuvant therapy for colon cancer: safety results of a randomized, phase III trial. Ann Oncol 14: 1735–1743.
- 62. Andre T, Boni C, Mounedji-Boudiaf L, Navarro M, Tabernero J, et al. (2004) Oxaliplatin, fluorouracil, and leucovorin as adjuvant treatment for colon cancer. N Engl J Med 350: 2343–2351.
- 63. Ness RM, Holmes AM, Klein R, Dittus R (1999) Utility valuations for outcome states of colorectal cancer. Am J Gastroenterol 94: 1650–1657.
- 64. Briggs A, Fenn P (1998) Confidence intervals or surfaces? Uncertainty on the cost-effectiveness plane. Health Econ 7: 723–740.
- 65. Briggs A, Sculpher M, Buxton M (1994) Uncertainty in the economic evaluation of health care technologies: the role of sensitivity analysis. Health Econ 3: 95–104.
- 66. Fenton JJ, Elmore JG, Buist DS, Reid RJ, Tancredi DJ, et al. (2010) Longitudinal adherence with fecal occult blood test screening in community practice. Ann Fam Med 8: 397–401.
- 67. Sawhney MS, Farrar WD, Gudiseva S, Nelson DB, Lederle FA, et al. (2006) Microsatellite instability in interval colon cancers. Gastroenterology 131: 1700–1705.
- 68. Regula J, Rupinski M, Kraszewska E, Polkowski M, Pachlewski J, et al. (2006) Colonoscopy in colorectal-cancer screening for detection of advanced neoplasia. N Engl J Med 355: 1863–1872.
- 69. Kavic SM, Basson MD (2001) Complications of endoscopy. Am J Surg 181: 319–332.
- 70. Warren JL, Klabunde CN, Mariotto AB, Meekins A, Topor M, et al. (2009) Adverse events after outpatient colonoscopy in the Medicare population. Ann Intern Med 150: 849–857, W152.
- 71. Rosen L, Bub DS, Reed JF 3rd, Nastasee SA (1993) Hemorrhage following colonoscopic polypectomy. Dis Colon Rectum 36: 1126–1131.
- 72. Waye JD, Lewis BS, Yessayan S (1992) Colonoscopy: a prospective report of complications. J Clin Gastroenterol 15: 347–351.
- 73. Misra T, Lalor E, Fedorak RN (2004) Endoscopic perforation rates at a Canadian university teaching hospital. Can J Gastroenterol 18: 221–226.
- 74. Garbay JR, Suc B, Rotman N, Fourtanier G, Escat J (1996) Multicentre study of surgical complications of colonoscopy. Br J Surg 83: 42–44.
- 75. Bressler B, Paszat LF, Chen Z, Rothwell DM, Vinden C, et al. (2007) Rates of new or missed colorectal cancers after colonoscopy and their risk factors: a population-based analysis. Gastroenterology 132: 96–102.
- 76. (2009) Primary screening programs for colorectal cancer in Canada using non-invasive home tests. http://www.cadth.ca/media/pdf/hta_htupdate_issue-9_e.pdf. Accessed 2 January, 2009.
- 77. Jonas DE, Russell LB, Sandler RS, Chou J, Pignone M (2008) Value of patient time invested in the colonoscopy screening process: time requirements for colonoscopy study. Med Decis Making 28: 56–65.