Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

KRAS Early Testing: Consensus Initiative and Cost-Effectiveness Evaluation for Metastatic Colorectal Patients in an Italian Setting

KRAS Early Testing: Consensus Initiative and Cost-Effectiveness Evaluation for Metastatic Colorectal Patients in an Italian Setting

  • Carlo Barone, 
  • Carmine Pinto, 
  • Nicola Normanno, 
  • Lorenzo Capussotti, 
  • Francesco Cognetti, 
  • Alfredo Falcone, 
  • Lorenzo Mantovani


KRAS testing is relevant for the choice of the most appropriate first-line therapy of metastatic colorectal cancer (CRC). Strategies for preventing unequal access to the test should be implemented, but their relevance in the practice is related to economic sustainability. The study adopted the Delphi technique to reach a consensus on several topics. Issues related to execution of KRAS testing were identified by an expert’s board and proposed to 108 Italian oncologists and pathologists through two subsequent questionnaires. The emerging proposal was evaluated by decision analyses models employed by technology assessment agencies in order to assess cost-effectiveness. Alternative therapeutic strategies included most commonly used chemotherapy regimens alone or in combination with cetuximab or bevacizumab. The survey indicated that time interval for obtaining KRAS test should not exceed 15 days, 10 days being an optimal interval. To assure the access to proper treatment, a useful strategy should be to anticipate the test after radical resection in patients at high risk of relapse. Early KRAS testing in high risk CRC patients generates incremental cost-effectiveness ratios between 6,000 and 13,000 Euro per quality adjusted life year (QALY) gained. In extensive sensitivity analyses ICER’s were always below 15,000 Euro per QALY gained, far within the threshold of 60,000 Euro/QALY gained accepted by regulatory institutions in Italy. In metastatic CRC a time interval higher than 15 days for result of KRAS testing limits access to therapeutic choices. Anticipating KRAS testing before the onset of metastatic disease in patients at high risk does not affect the sustainability and cost-effectiveness profile of cetuximab in first-line mCRC. Early KRAS testing may prevent this inequality in high-risk patients, whether they develop metastases, and is a cost-effective strategy. Based on these results, present joined recommendations of Italian societies of Oncology and Pathology should be updated including early KRAS testing.


Since 2008 KRAS mutational status has become the main tissue biomarker of resistance to anti-EGFR monoclonal antibodies in metastatic colorectal cancer (CRC). Large phase III and randomized phase II studies have demonstrated that mutation of KRAS gene predicts resistance to treatment with an anti-EGFR antibody either alone or in combination with chemotherapy [1], [2]. The effect of combination of anti-EGFR antibody and chemotherapy seems particularly relevant in patients with liver limited initially not resectable disease [3], [4]. Furthermore, in palliative setting the addition of anti-EGFR monoclonal antibodies to chemotherapy regimens increases the progression free survival and overall survival [5]. Only in few studies biased by selection and methodological issues the predictive role of KRAS has not clearly emerged; however, also in one of these studies response rate was significantly higher in wild-type (wt) tumors [6], [7].

The most accepted guidelines now consider KRAS mutation status a central step of decision-making process in the therapy of metastatic CRC, both in potentially resectable and palliative treatment settings. Access to the advantage provided by this test, however, may be limited by some practical difficulties that may hinder the therapeutic opportunities resulting from anti-EGFR targeting therapy. Mutational analysis, in fact, needs technical and expertise resources that may be not everywhere available [8]. Both complexity of the test and different access to molecular biology laboratory may cause delays, which often conflict with the urgency of clinical decision. This means that an unknown, but not irrelevant, percentage of patients is excluded from a potential therapeutic advantage with negative consequences either on symptom control or resection rate and survival.

The peculiarity of the Italian situation can be clearly seen from the data collected with the KRAS aKtive system, a network aimed to facilitate KRAS testing in Italy. In the period from 1 January 2011 to 31 December 2011, this project has involved 407 oncologists and 125 pathologists, and 24 reference laboratories in 16 of the 21 Italian regions [9]. The times to the diagnosis in most of involved regions result more than 15 days: with the exception of the only region of Puglia, all other times are longer than 10 days and, except Lazio and Tuscany, all are over 15 days (Figure 1). This value is similar to that found in a retrospective study including 160 French centers, where the median time between prescription and result of the K-RAS testing was 19 months [10].

Figure 1. KRAS aKtive program in Italy – Requested time (days) to diagnosis –2011.

In addition to differences in reaching the needed resources for KRAS test, economic concerns may have the potential to constrain the use of anti-EGFR antibodies, despite the large evidence resulting from clinical trials. Recently, a health technology assessment report has evaluated the clinical and economic profile of cetuximab in first-line metastatic colorectal cancer (mCRC) in Italy on a specific population (KRAS wt liver limited disease patients). The economic analysis of cetuximab in the treatment of metastatic colorectal cancer shows that this therapy, in combination with FOLFOX and FOLFIRI, is more cost-effective than the alternatives currently available in first line (bevacizumab+FOLFOX, FOLFOX, FOLFIRI); therefore cetuximab can be considered as a sustainable alternative for the NHS [11].

Among the possible strategies, aimed to equalize patients opportunity of access to the potential advantage of anti-EGFR strategy, the anticipation of KRAS testing might be of value. In the present study we have analyzed the opinion and the attitude of a representative group of Italian specialists, mainly oncologists and pathologists, on the implication of KRAS testing in order to optimize overall therapeutic approach to patients with metastatic CRC. The economic supportability of a different strategy of KRAS testing was assessed by a specifically modeled cost-effectiveness analysis.


Delphi Technique

The Delphi technique is a validated consensus-building process to develop consensus and make group-based decisions in a variety of fields [12], [13]. It was conceived and developed in the mid-1950s by researchers at the Rand Corporation as a way to predict the impact of technologies or interventions on complex systems, which has often been used in the social and health care context [14][16].

The Delphi method (Figure 2) is traditionally based on three fundamental concepts. The first is anonymity. The participants never meet each other during the process. Each participant submits his or her opinion independently, by completing a specially designed questionnaire. The replies are then disclosed to all participants, without identifying the particular respondent. The second concept is controlled feedback. The process consists of several rounds; during each of them the respondents are asked to judge all the opinions expressed in the previous rounds, often presented in the form of statistics. The last concept is statistical group response. The Delphi method reaches a collective decision and expresses it in terms of a statistical score. In addition to these basic characteristics, the Delphi method can be described as follows:

  • It requires individual effort for the expression of an opinion.
  • It requires written answers to questionnaires.
  • The individual opinions (questionnaire responses) are collected and assembled by the project coordinator.
  • The respondents have enough time to come up with and evaluate opinions (unlike task force meeting, in which, quite often, not enough time is allowed to assess other people’s opinions).

Delphi method was used specifically in the field of oncology and diagnostic test assessment for epidemiological, inhabitant awareness and behavior, and to set up and define healthcare protocols and procedures and treatment guidelines [17][27].

For the purpose of this specific project, a small group of specialists, the board of experts (comprised of six major specialists selected from Italian universities and public hospitals and one pharmacoeconomist) examined the scientific literature and developed a 22-item questionnaire (Q1; see Table 1), including 4 demographic initial questions. The questionnaire was designed for an expert panel consisting of 108 oncologists, pathologists, molecular biologists, surgeons, quite all of them persons in charge of hospital departments, randomly selected from different Italian regions.

Q1 was written in order to avoid possible bias caused by inadvertently influencing replies, so the sequence of questions was ordered within a framework of three mains chapters (Management of patients with metastatic colorectal cancer; Definition of operated patient at high risk of relapse; Anticipation of KRAS testing at the diagnosis of primary tumor). For each question, space was provided for comments.

The majority of Q1 questions (11 out of 18) allowed a classified answer on a scale of 0 (total disagreement) to 9 (complete agreement) while other asked the responders either to rank a set of provided options in order of relevance following their clinical opinion, or to fill in open-ended questions.

To better analyze the replies, two categories of answers were defined for the questions with a 0–9 range:

  • Score 0–4: negative answer;
  • Score 5–9: positive answer.

After the replies to Q1 were processed, a second questionnaire (Q2) was developed (Table 2). Q2 was presented to the same expert panel and replies were collected and processed in the same way, as done with Q1.

After both rounds, the level of agreement was evaluated based on the percentage of positive answers to each question. To reach consensus, a cut-off level of two-thirds (67%) of agreement (for positive or negative answers) was required for the first (Q1) and the second round (Q2). These arbitrary but standard consensus levels were agreed on by all members of the board before beginning the study.

Cost-effectiveness Analysis

In order to assess the cost-effectiveness of early KRAS testing in high-risk non metastatic CRC patients, we adapted a model previously used to assess the cost effectiveness of cetuximab plus chemotherapy vs chemotherapy alone or chemotherapy plus bevacizumab, i.e. the only other biologic agent to date approved in Italy in first line colorectal cancer [11]. The model has been developed and adapted based on models previously used in assessments performed by technology assessment agencies, e.g. NICE [28] and SMC [29].

Alternative therapeutic strategies included chemotherapy regimens (FOLFOX4, FOLFIRI), and biological drugs in combination with chemotherapy (cetuximab+FOLFOX-4, cetuximab+FOLFIRI, bevacizumab+FOLFOX4). The models were adapted to take into account for early KRAS testing in high-risk patients in those cases in which a deferred test would impair a well-timed treatment including cetuximab. The models have been populated with Italy specific cost data (drugs, tests, hospital admissions, administration, toxicity management, etc.), incorporating patients’ access schemes (cost/risk sharing agreements and capping) as described in details in the SMC assessment [29].

Not all patients at high risk would eventually develop metastases and would therefore be candidate for treatment with cetuximab. The cost effectiveness of early KRAS testing mimics the situation in which part of KRAS test would be performed in vain (i.e. for those patients who would not eventually develop metastases), and part would only be anticipated (i.e. for those who would subsequently develop metastases). Computationally, this is equivalent to adding to the population of patients eventually developing metastatic disease and being treated, the cost of KRAS tests of the population of patients that would not develop metastases and for which the test would have not been necessary. The size of these two populations depends on the level of risk of developing metastatic disease. In order to simulate the incremental cost effectiveness that would be generated by early KRAS testing in high risk patients and to test the robustness of results, we conducted several analyses under different assumptions, by setting the level of risk of developing metastatic disease at the level of 1 patients out of 2 (i.e. 50% chance), 1/3, 1/4, 1/5 and 1/10, i.e. including very low risk. The cost of KRAS test is quantified at 160 Euro per test. Costs are expressed in Euro of 2012 and effects are expressed in quality adjusted life years (QALY) gained.


Q1 was sent to 160 specialists involved in diagnosis and treatment process in the oncology field: 17 molecular biologists (10.7%), 21 surgeons (13.1%), 85 oncologists (53.1%), 37 pathologists (23.1%). These 160 specialists define a representative sample of the different Italian regions. The 108 respondents (67.5% of those initially selected) were from northern (43%), central (28%) and southern (29%) Italy. Q2 was sent to the 108 responders to Q1, and 96 (88.8% of them) returned an answer.

The percentage of respondents choosing each reply is presented in tables 1 and 2. By analyzing and evaluating the replies to both questionnaires, the board identified the following statements about different issues on KRAS testing that attained expert agreement of 67% or more:

Management of Patients with Metastatic Colorectal Cancer

  1. The determination of KRAS status is a key element in deciding the therapeutic strategy of patients with metastatic CRC (Q1–19)
  2. In clinical practice, the molecular parameters used routinely for the selection of first choice treatment in patients with metastatic CRC are primarily KRAS mutations in exons 12 and 13 (Q1–21)
  3. KRAS evaluation allows for an efficient use of resources, favoring the choice of the most appropriate and targeted treatment (Q1–13; Q2–8)
  4. Both primary tumor and metastases may be appropriate for KRAS testing (Q1–22)
  5. In a patient with metastatic CRC who must undergo a first-line chemotherapy, a time interval of more than 15 days for the result of KRAS testing limits the therapeutic choices (Q1–7; Q2–4)
  6. The maximum acceptable time for KRAS test result should not exceed 10 days (Q2–5)
  7. In patients with CRC and potentially resectable liver metastases susceptible of conversion therapy, waiting time for KRAS test result must be adequate in order to ensure the eventual use of a monoclonal anti-EGFR antibody in combination with chemotherapy (Q1–12)
  8. If waiting time for KRAS test result is too long, a therapeutic strategy alternative to the personalized therapy is not equally effective (Q1–11; Q2–7; Q2–7a)

Definition of Colorectal Cancer Operated Patients at High Risk of Relapse

  1. In radically resected N0 patients, the most significant prognostic factors are pT4, tumor grade, intestinal occlusion/perforation at presentation (Q1–16)
  2. In radically resected N+ patients, the most significant prognostic factors are pN2 and pT4 (Q1–17)
  3. Patients with surgically removed limited peritoneal carcinomatosis and/or positive peritoneal washing and/or removed ovarian metastases always require KRAS determination (Q1–18)

Anticipation of KRAS Testing at the Diagnosis of Primary Tumor

  1. In patients at high risk of relapse anticipating KRAS testing before the onset of metastatic disease may allow the timely use of the most appropriate therapy when the patients metastasizes (Q1–14; Q2–6b; Q2–8)
  2. In patients at high risk of relapse, the best time for KRAS testing is after radical resection of CRC in order to have the information when it should be necessary (Q1–9)
  3. Anticipating KRAS testing before the onset of metastatic disease in patients at high risk does not affect the sustainability of cetuximab in first-line mCRC regardless of the level of risk of developing metastases (Q1–14; Q2–8)

Cost effectiveness results of early KRAS testing in high risk patients that would have no access to well-timed KRAS testing if they develop metastatic disease are summarized in Table 3.

Table 3. Cost effectiveness results of Early KRAS testing in high risk patients that would have no access to well-timed KRAS testing if they develop metastatic disease.

In this table the treatment with cetuximab+FOLFOX-4 is compared to FOLFOX-4 and bevacizumab+FOLFOX-4, while cetuximab+FOLFIRI is compared to FOLFIRI. Anticipating the KRAS testing has as consequence an increase of the costs for the metastatic population represented by the cost of KRAS tests of those patients that will not develop metastases and for which the test would not be necessary. In order to simulate the incremental cost effectiveness that would be generated by early KRAS testing in high risk patients and to test the robustness of results, we conducted several analyses under different assumptions, by setting the level of risk of developing metastatic disease at the level of 1 patients out of 2 (i.e. 50% chance), 1/3, 1/4, 1/5 and 1/10, i.e. including very low risk. The range of ICER generated is between 9,948.51 Euro/QALY (ICER1) and 10,903.73 Euro/QALY (ICER5), far within the threshold of 60,000 Euro/QALY gained accepted by regulatory institutions in Italy.


The Delphi method used in the present analysis has advantages and drawbacks. The methodology can overcome many of the limitations intrinsic to traditional group decision-making processes, it keeps attention directly on the issue, and it is flexible and inexpensive compared to focus group. Depending on the nature of the problem, the method can be adjusted for improved overall efficacy. Since the use of strict statistical methods for setting guidelines is rather problematic, due to the quantitative nature of the expected results, the use of modified classification procedures makes easier monitoring and expression of the process by which a consensus is developed. On the other hand, there are some disadvantages: information comes from a selected group of people and may be not representative; it tends to eliminate extreme positions and to force a middle-of-the-road consensus; it is more time-consuming than group process methods; it requires skills in written communication; finally, it requires adequate time and participant commitment.

At the end, the consensus process has become part of the technology for solving problems in health service and medicine by putting the knowledge and experience of practitioners and other experts in touch with scientific literature [30].

In advanced CRC the treatment strategy based on KRAS status is related to clinical outcome of patients [3], [5]. Determining the tumor K-RAS status is now part of clinical practice in most countries; for example, in France the prescription rate in first line therapy is estimated around 81% [10]. In the present study most of experts come from centers certified by the national quality program for KRAS testing or participating to the KRAS aKtive program, so their opinion reflects both the clinical attitude and the real situation in treatment of CRC cancer in Italy. They strongly agree on the relevance of KRAS mutational status in the decision process in metastatic CRC because it allows both the choice of the most appropriate treatment and the proper use of resources. Although other mutations in KRAS, BRAF and PIK3CA genes have been evaluated in relation to resistance to anti-EGFR antibodies, only the most frequent seven KRAS mutations of exons 12 and 13 (Gly12Ala, Gly12Asp, Gly12Arg, Gly12Cys,Gly12Ser, Gly12Val, Gly13Asp) have been investigated in phase III clinical trials and have a proven relation to clinical efficacy of anti-EGFR antibodies [5], [31]. Accordingly, most panelists in our analysis believe that only these mutations should be considered in the practice and that accuracy in the determination of the test is not affected by the source of the sample, either the primary tumor or metastases.

Despite about 40% of experts think that time required to obtain the result of KRAS test do not affect treatment choice in first-line treatment of metastatic CRC, based on their experience, most of them doubt that presently an alternative therapeutic choice might have the same level of effectiveness when the possibility of personalizing treatment were deemed. In addition, large percentage of panelists agree that in first-line chemotherapy a time interval longer than 15 days for obtaining the result actually could limit the therapeutic choices. In support of this view, an interval of 10 days has been considered an optimal time, suggesting that waiting longer is not rare. As a matter of fact, in the previously mentioned KRAS aKtive system it has been shown that delay in obtaining KRAS testing is more than 15 days in most of Italian regions [9].

The clinical situation, however, seems to influence the relevance of shortening the time needed for having test results. In fact, a very large percentage of panelists agree that, in conversion therapy of liver metastases, waiting time for KRAS test must allow the use of a monoclonal anti-EGFR antibody in combination with chemotherapy. This partial divergence may be the consequence of two different aspects: on the one hand, response and tumor shrinkage is largely perceived as important in conversion therapy, as it results in several clinical studies. On the other hand, Italian regulatory rules allow to use cetuximab later whether it was not used in first-line. Therefore, some oncologists might conceive that, when response does not seem to have a crucial role, the activity of cetuximab might be recovered in a subsequent line of treatment. However, this thinking does not consider that a number of KRAS positive patients not responding to an alternative treatment might be definitively excluded from EGFR targeting therapy due to progressive disease, deterioration of performance status and eventually death.

In the metastatic CRC, only when the mutational status of KRAS is known, a proper therapeutic decision may be reached. Panelists agree that in patients with metachronous metastases this may be undoubtedly realized by anticipating KRAS test before the onset of metastatic disease, meeting the need of improving decision making in clinical practice, as it has been recently underlined [10]. In the opinion of most experts the right time for KRAS test is after radical resection of CRC. This implies the need of identifying which group of patients should be considered at high risk of relapse. Panelists largely shared that conditions as surgically removed limited peritoneal carcinomatosis and/or positive peritoneal washing and/or removed ovarian metastases have a very high risk of relapse and require an immediate assessment of KRAS mutational status. In radically resected patients, according to existing evidence, other unfavorable prognostic factors have been recognized including: pT4, high tumor grade, intestinal occlusion-perforation at presentation in N- patients, and pN2 followed by pT4 in N+.

Contrary to what happens in other European countries, such as Spain where a network do exist but all tests are referred to only five laboratories [32], in Italy the system is more scattered in the national territory [9] and the perception of relevance of the timing of KRAS testing is diffuse. Therefore, the convergence of panelists opinion toward the anticipation of KRAS testing in order to ensure the timely use of the most appropriate and personalized therapy in metastatic disease means that an anti-EGFR therapy should be extensively considered in metastatic KRAS wt tumors. As a consequence, the economic impact and sustainability of such a strategy has been evaluated.

KRAS testing to limit use of EGFR inhibitors to patients with KRAS wild-type tumors resulted in net savings of $7,500 to $1,200 and of €3,900 to €9,600 per patient in the United States and Germany, respectively, and was shown cost-effective in patients with KRAS wild-type liver limited disease [33], [34]. It has been estimated that KRAS testing to all metastatic CRCs may realize annual savings ranging from $740 to $103 million in the United States depending on parameters and alternative treatment included in the analysis, that result in different outcomes in terms of cost-effectiveness [35], [36].

Our analysis was aimed to evaluate the different scenery of KRAS early testing not in metastatic CRCs but in patients with CRC at risk of relapse and/or metastases. Not all patients at high risk will eventually develop metastases and will therefore be eligible for treatment with cetuximab. The cost effectiveness of early KRAS testing mimics the situation in which part of KRAS test will be performed in vain (i.e. for those patients who will not eventually develop metastases), and part will only be anticipated (i.e. for those who will subsequently develop metastases). Computationally, this is equivalent to adding to the population of patients eventually developing metastatic disease and being treated, the cost of KRAS tests of the population of patients that will not develop metastases and for which the test will not be necessary. The results of this economic analysis on early KRAS testing in CRC patients, including those at high as well those at very low risk, show that the incremental cost-effectiveness ratio remains within the range of 6,000 to 15,000 Euro per quality adjusted life year (QALY) gained, regardless of the level of risk of developing metastases and far within the threshold of 60,000 Euro/QALY gained accepted by regulatory institutions in Italy (Table 3). In our analysis, we hypothesized that the cost of promptly treating patients developing metastases will include the cost of those KRAS tests performed in patients that would not develop metastases. In case of absence of timely knowledge on KRAS status, patients may receive alternative treatments, which may be highly variable from area to area, but it will essentially include a mix of FOLFOX/FOLFIRI with or without bevacizumab. Therefore, in order to allow the decision maker to judge based on the actual practice in any relevant area, we assessed early KRAS testing against any single alternative therapeutic strategy that may take place in absence of adequate knowledge on KRAS status. In this way, every decision maker can find information on each possible relevant comparator assessed one by one against early KRAS test. In other words, rather than assessing the “mix” of treatments that patients may receive as a whole, we assessed each single part of the mix, one by one against KRAS testing.

This study shows that anticipating KRAS testing in patients with high risk of relapse is a strategy accepted and perceived as useful by Italian specialists in the field of diagnosis and treatment of CRC. A specifically modeled cost-effectiveness analysis suggests that this clinical attitude is economically sustainable.

Taken together, the economic sustainability and the convergence of panelists toward the anticipation of KRAS testing support the inclusion of early KRAS testing in the joined recommendations of societies of Medical Oncology and Pathology in Italy. This might represent the necessary condition for a larger national program of guidelines in molecular diagnosis of cancer.


Cost-Effectiveness Analysis (CEA).

Analysis comparing the costs and clinical outcomes of at least two therapeutic alternatives (one of which may also be the non-treatment). Outcomes (benefits) resulting from the alternatives are expressed in clinical units (e.g. years of life gained, number of lives saved, reduction in the incidence of a disease).

Cost-Utility Analysis (CUA).

Analysis comparing the costs and the consequences of at least two alternatives (one of which can also be the non-treatment), capturing outcomes in terms of both quantity and quality of life (utility) simultaneously. The outcomes indicator generally used in a CUA is the QALY. The effects of medical treatment are expressed in terms of quality-adjusted life years gained (QALY).

Incremental Cost-Effectiveness Ratio (ICER).

Ratio between the difference in costs and the difference of the outcomes generated by the two alternatives (one of which may also be the non-treatment). It is measured in terms of economic investment required to achieve an incremental clinical benefit (Example: Euro/QALY).

Quality Adjusted Life Years (QALY).

Life year gained multiplied by a factor between 1 and 0 (1 = full health, 0 = death), which summarizes the quantity and quality of life impact in a single index. The QALYs are used in the a-cost-utility analysis.

Willingness to pay.

Amount of money that an individual/society is willing to pay to obtain an outcome.


We wish to thank the 160 specialists who participated in the panel of experts: Massimo Aglietta, Istituto di Ricerca e Cura del Cancro di Candiolo, Torino; Giuseppe Antinolfi, Ospedale Monaldi, Napoli; Adelmo Antonucci, Ospedale Policlinico, Monza; Alessandro Apollo, Ospedale Universitario Santa Chiara, Pisa; Giuseppe Maria Aprile, A.O.U. Santa Maria della Misericordia, Udine; Maria Astorino, Ospedale Misericordia e Dolce, Grosseto; Antonio Avallone, Istituto dei Tumori Pascale, Napoli; Caterina Battaglia, A.O. Pugliese-Ciaccio, Catanzaro; Emilio Bertani, Istituto Europeo di Oncologia, Milano; Renato Bisonni, Ospedale Civile Augusto Murri, Fermo; Anna Maria Bochicchio, IRCCS CROB Rionero in Vulture, (PZ); Roberto Bordonaro, Azienda Ospedaliera Garibaldi Nesima, Catania; Giovanni Brandi, A.O.U. Policlinico S.Orsola-Malpighi, Bologna; Sergio Bretti, ASL Torino 4, Ivrea; Ugo Buonocore, Ospedale Cardarelli, Napoli; Fulvio Calise, Ospedale Cardarelli, Napoli; Francesca Capelli, Ospedale Cesare Zonchello, Nuoro; Francesca Caputo, Ospedale Cotugno, Napoli; Laura Caramanico, Azienda USL Vale d’Aosta, Aosta; Stefania Casazza, E.O. Ospedali Galliera, Genova; Francesca Castiglione, A.O.U. Careggi, Firenze; Vincenzo Catalano, A.O. Ospedali Riuniti Marche Nord, Presidio S. Salvatore, Pesaro; Massimiliano Cergnul, Casa di Cura Privata Accreditata MultiMedica, Castellanza; Andrea Ciarlo, Ospedale Misericordia e Dolce, Prato; Mario Clerico, Ospedale degli Infermi, Biella; Domenico Corsi, Ospedale San Giovanni Calibita-Fatebenefratelli-Isola Tiberina, Roma; Bruno Daniele, A.O. Gaetano Rummo, Benevento; Federica De Galitiis, Istituto Dermopatico Immacolata-IRCCS, Roma; Carlo De Sangro, Ospedale San Gennaro dei Poveri, Napoli; Alfonso De Stefano, A.O.U. Federico II, Napoli; Michele De Tursi, Ospedale “SS. Annunziata”, Chieti; Annarita Destro, Istituto Clinico Humanitas, Milano; Francesco Di Costanzo, Ospedale Careggi, Firenze; Francesca Di Fabio, Policlinico S.Orsola-Malpighi, Bologna; Katia Dotti, Fondazione IRCCS - Istituto Nazonale dei Tumori, Milano; Giorgio Ercolani, Policlinico S.Orsola-Malpighi, Bologna; Giovanni Esposito, Istituto Oncologico Veneto - IRCCS, Padova; Giuseppe Maria Ettorre, A.O. San Camillo-Forlanini, Roma; Antonio Febbraro, Ospedale Fatebenefratelli, Benevento; Gianfranco Filippelli, Ospedale San Francesco di Paola, Paola (CS); Franco Filipponi, Centro A.O.U. Pisana, Pisa; Michelangelo Fiorentino, Istituto Oncologico “Addarii”, Bologna; Roberto Fiorentino, Ospedale S. Maria delle Grazie-Pozzuoli, Napoli; Mario Franchini, ASL CN2 Alba - Bra, Alba; Franco Francomano, Policlinico “SS Annunziata” Chieti, Chieti; Michela Frisinghelli, Presidio Ospedaliero S. Chiara - Ospedale di Trento, Trento; Gennaro Galizia, A.O.U. Federico II, Napoli; Marco Galliano, Ospedale Monsignor Giovanni Galliano, Acqui Terme; Silvia Gasperoni, A.O.U. Careggi, Firenze; Andrea Gianatti, A.O. Ospedali Riuniti, Bergamo; Linda Giol, A.O. Santa Maria degli Angeli, Pordenone; Giuseppe Giuffrè, A.O.U. Policlinico “G. Martino”, Messina; Alfredo Guglielmi, A.O.U. Integrata, Verona; Michela Iacobellis, Ospedale “Umberto I”, Altamura; Alessandro Inno, Policlinico Gemelli, Roma; Roberta Invernizzi, A.O. Ospedale di Circolo, Busto Arsizio; Laura La Paglia, A.O.U. Policlinico “P. Giaccone”, Palermo; Eugenio Leonardo, A.O.U. “Ospedali Riuniti”, Trieste; Luciano Leonetti, A.O. “Pugliese-Ciaccio”, Catanzaro; Roberta Libener, A.O. S.S. Antonio e Biagio, Alessandria; Loredana Lo Giudice, A.O. Provincia di Lodi, Lodi; Sara Lonardi, Istituto Oncologico Veneto, Padova; Raffaele Longo, A.C.O. San Filippo Neri, Roma; Vito Lorusso, P.O. “Vito Fazzi”, Lecce; Giovanna Luchena, A.O. Ospedale Sant’Anna, Como; Vienna Ludovini, A.O. Ospedale Renato Silvestrini, Perugia; Gabriele Luppi, A.O.U. Policlinico, Modena; Antonio Maestri, A.U.S.L. di Imola, Imola; Alessandra Mandolesi, Università Politecnica delle Marche, Ancona; Michela Manzotti, Istituto Europeo di Oncologia, Milano; Pierenrico Marchesa, Fondazione Istituto San Raffaele Giglio di Cefalù, Palermo; Marzia Mare, Istituto Oncologico del Mediterraneo, Viagrande; Laura Mariuzzi, A.O.U. Santa Maria della Misericordia, Udine; Gianluca Masi, A.O.U. Pisana, Pisa; Luca Mastracci, A.O.U. San Martino, Genova; Vincenzo Memeo, Policlinico Giovanni XXIII, Bari; Piergiorgio Mezzatesta, La Maddalena - CDC di Alta Specialità - Dipartimento Oncologico, Palermo; Umberto Miglio, A.O.U. Ospedale Maggiore della Carità, Novara; Mauro Minelli, Ospedale S. Eugenio, Roma; Gianmaria Miolo, Centro di Riferimento Oncologico, Aviano; Vincenzo Montesarchio, A.O. Cotugno, Napoli; Oscar Nappi, A.O. Antonio Cardarelli, Napoli; Francesca Negri, A.O.U. di Parma, Parma; Maria Emanuela Negru, A.O.U. Maggiore della Carità, Novara; Gloria Pessina, Ospedale Belcolle, Viterbo; Vincenzo Petrozza, Università La Sapienza, Polo Pontino, I.C.O.T., Latina; Antonio Daniele Pinna, Policlinico S.Orsola-Malpighi, Bologna; Maria Adalgisa Police, A.O. R.N. San Giuseppe Moscati, Avellino; Angelo Pomillo, P.O. “Nicola Giannettasio”, Rossano; Francesca Pucci, A.O.U. di Parma, Parma; Patrizia Racca, Ospedale Molinette, Torino; Manuela Riccardi, Ospedale SS. Giovanni e Paolo, Venezia; Enrico Ricevuto, Ospedale S. Salvatore, L’Aquila; Fabiola Lorena Rojas Llimpe, Policlinico S.Orsola-Malpighi, Bologna; Adriana Romiti, A.O. Sant’Andrea, Roma; Gerardo Rosati, A.O.R. San Carlo, Potenza; Mario Roselli, Fondazione PTV - Policlinico Tor Vergata, Roma; Luigi Ruco, A.O. Sant’Andrea, Roma; Solidea Saltarelli, Ospedale S. Salvatore, L’Aquila; Roberto Santoro, A.O. San Camillo-Forlanini, Roma; Mario Scartozzi, A.O.U. Ospedali Riuniti - Torrette, Ancona; Anna Sebastio, P.O. S. Giuseppe Moscati, Taranto; Angelo Sidoni, A.O. “S. Maria”, Terni; Emiliano Tamburini, P.O. “Infermi”, Rimini; Marco Tampellini, A.O.U. San Luigi Gonzaga, Orbassano; Francesco Tata, A.O. Villa Scassi, Genova; Anna Tomezzòli, Ospedale Civile Maggiore Borgo Trento, Verona; Laura Troiani, IRCCS CROB Rionero in Vulture, Rionero; Paola Ulivi, I.R.S.T., Meldola (FC); Luigi Veneroni, P.O. “Infermi”, Rimini; Franco Verderame, A.O. Ospedali Civili Riuniti, Sciacca (AG); William Vermi, A.O. Spedali Civili, Brescia.

We wish to thank also ThinkTank, a Milan-based Delphi Method consultant agency, for its methodological and logistic support.

Author Contributions

Analyzed the data: CB CP NN LC FC AF LM. Wrote the paper: CB CP NN LM. Conceived and designed the questionnaires: CB CP NN LC FC AF LM.


  1. 1. Winder T, Lenz HJ (2010) Molecular predictive and prognostic markers in colon cancer. Cancer Treat Rev 36: 550–556.
  2. 2. Dumpke WC, Heinemann V (2010) Ras mutational status is a biomarker for resistance to EGFR inhibitors in colorectal carcinoma. Anticancer Res 30: 4673–4677.
  3. 3. Folprecht G, Gruenberger T, Bechstein WO, Raab HR, Lordick F, et al. (2010) Tumour response and secondary respectability of colorectal liver metastases following neoadjuvant chemotherapy with cetuximab: the CELIM randomised phase II trial. Lancet Oncol 11: 38–47.
  4. 4. Petrelli F, Barni S, Anti-EGFR agents for liver metastases (2012) Resectability and outcome with anti-EGFR agents in patients with KRAS wild-type colorectal liver-limited metastases: a meta-analysis. Int J Colorectal Dis 27: 997–1004.
  5. 5. Bokemeyer C, Van Cutsem E, Rougier P, Ciardiello F, Heeger S, et al. (2012) Addition of cetuximab to chemotherapy as first-line treatment for KRAS wild-type metastatic colorectal cancer: Pooled analysis of the CRYSTAL and OPUS randomised clinical trials. Eur J Cancer 48: 1466–1475.
  6. 6. Maughan TS, Adams RA, Smith CG, Meade AM, Seymour MT, et al. (2011) on behalf of the MRC COIN Trial Investigators (2011) Addition of cetuximab to oxaliplatin-based first-line combination chemotherapy for treatment of advanced colorectal cancer: results of the randomised phase 3 MRC COIN trial. Lancet 377: 2103–2114.
  7. 7. Tveit KM, Guren T, Gimelius B, Pfeiffer P, Sorbye H, et al. (2012) Phase III trial of cetuximab with continuous or intermittent fluorouracil, leucovorin, and oxliplatin (Nordic FLOX) versus FLOX alone in first-line treatment of metastatic colorectal cancer: the NORDIC-VII study. J Clin Oncol 30: 1755–1762.
  8. 8. Mileshkin L, Shah B, Michael M (2012) Predictive molecular tumour testing: What are the obstacles between bench and bedside? Chemother Res Pract. Epub ahead of print. DOI: 10.1155/2012/838509. 10.1155/2012/838509
  9. 9. Marchetti A, Pinto C, Taddei GL, Troncone G, Russo A, et al. (2011) KRAS mutations in colorectal cancer patients in Italy: Results from the KRAS aKtive program. J Clin Oncol 29 (suppl; abstr e14000).
  10. 10. Lièvre A, Artru P, Guiu M, Laurent-Puig P, Merlin JL, et al. (2013) The KRAS mutation detection within the initial management of patients with metastatic colorectal cancer: a status report in France in 2011. Eur J Cancer. Epub ahead of print. DOI: 10.1016/j.ejca.2013.02.016.
  11. 11. Barone C, Belisari A, Ciardiello F, D’Angiolella L, Furneri G, et al. (2012) Cetuximab nel trattamento di prima linea del carcinoma metastatico del colon-retto. Farmeconomia 13 (Suppl 1)1–80.
  12. 12. Linstone H, Turoff M, eds. (1975) The Delphi Method. Techniques and Applications. Reading, MA: Addison-Wesley Publishing Company. 1–616.
  13. 13. Jones J, Hunter D (1995) Consensus methods for medical and health services research. BMJ 311: 376–380.
  14. 14. Rowe G, Wright G (1999) The Delphi technique as a forecasting tool: issues and analysis. International Journal of Forecasting 15: 353–375.
  15. 15. Graham B, Regehr G, Wright JG (2003) Delphi as a method to establish consensus for diagnostic criteria. J Clin Epidemiol 56: 1150–1156.
  16. 16. Fehr A, Thürmann P, Razum O (2011) Expert Delphi survey on research and development into drugs for neglected diseases. BMC Health Serv Res 11: 312.
  17. 17. Raijmakers NJ, van Zuylen L, Costantini M, Caraceni A, Clark JB, et al. (2012) Issues and needs in end-of-life decision making: an international modified Delphi study. Palliat Med 26: 947–953.
  18. 18. Uphoff EP, Wennekes L, Punt CJ, Grol RP, Wollersheim HC, et al. (2012) Development of generic quality indicators for patient-centered cancer care by using a RAND modified Delphi method. Cancer Nurs 35: 29–37.
  19. 19. Speksnijder HT, Mank AP, van Achterberg T (2011) Nursing diagnoses (NANDA-I) in hematology-oncology: a Delphi-study. Int J Nurs Terminol Classif 22: 77–91.
  20. 20. Expert Panel on Radiation Oncology-Prostate, Frank SJ, Arterbery VE, Hsu IC, Abdel-Wahab M, Ciezki JP, et al. (2011) American College of Radiology Appropriateness Criteria permanent source brachytherapy for prostate cancer. Brachytherapy 10: 357–362.
  21. 21. Danielson B, Brundage M, Pearcey R, Bass B, Pickles T, et al. (2011) Development of indicators of the quality of radiotherapy for localized prostate cancer. Radiother Oncol 99: 29–36.
  22. 22. Delva F, Marien E, Fonck M, Rainfray M, Demeaux JL, et al. (2011) Factors influencing general practitioners in the referral of elderly cancer patients. BMC Cancer 11: 5.
  23. 23. Moss EL, Owen G, Jones PW, Sarhanis P, Nordin A, et al. (2010) The British Gynaecological Cancer Society Delphi consultation exercise on expected standards of practice for doctors specializing in the area of gynaecological oncology. Int J Gynecol Cancer 20: 488–491.
  24. 24. Expósito J, Bretón JJ, Domínguez C, Pons J (2010) Controversies on the management of clinical situations with low therapeutic effectiveness in oncology. Clin Transl Oncol 12: 493–498.
  25. 25. Chan A, Tan SH, Wong CM, Yap KY, Ko Y (2009) Clinically significant drug-drug interactions between oral anticancer agents and nonanticancer agents: a Delphi survey of oncology pharmacists. Clin Ther 31 Pt 2: 2379–2386.
  26. 26. Robson N, Rew D (2010) Collective wisdom and decision making in surgical oncology. Eur J Surg Oncol 36: 230–236.
  27. 27. Gagliardi AR, Simunovic M, Langer B, Stern H, Brown AD (2005) Development of quality indicators for colorectal cancer surgery, using a 3-step modified Delphi approach. Can J Surg 48: 441–452.
  28. 28. NICE technology appraisal guidance 176. Cetuximab for the first-line treatment of metastatic colorectal cancer. Issue date: August 2009; Review date: August 2012. Available: Accessed 2 September 2013.
  29. 29. Scottish Medicines Consortium No. 543/09 - Cetuximab, 100 mg/20 mL and 500 mg/100 mL solution for intravenous infusion (Erbitux®). Available: Accessed 2 September 2013.
  30. 30. Loblaw DA, Prestrud AA, Somerfield MR, Oliver TK, Brouwers MC, et al. (2012) American Society of Clinical Oncology Practice Guidelines: formal systematic review-based consensus methodology. J Clin Oncol 30: 3136–3140.
  31. 31. Amado RG, Wolff M, Peeters M, Van Cutsem E, Siena S, et al. (2008) Wild-type KRAS is required for panitumumab efficacy in patients with metastatic colorectal cancer. J Clin Oncol 26: 1626–1634.
  32. 32. Garcia-Foncillas J (2012) Determina KRAS: A consolidated project. J Clin Oncol 30 (suppl 4; abstr 428).
  33. 33. Vijayaraghavan A, Efrusy MB, Göke B, Kirchner T, Santas CC, et al. (2012) Cost-effectiveness of KRAS testing in metastatic colorectal cancer patients in the United States and Germany. Int J Cancer 131: 438–445.
  34. 34. Asseburg C, Frank M, Köhne C-H, Hartmann JT, Griebsch I, et al. (2011) Cost-effectiveness of targeted therapy with cetuximab in patients with K-ras wild-type colorectal cancer presenting with initially unresectable metastases limited to the liver in a German setting. Clin Ther 33: 482–497.
  35. 35. Shankaran V, Bentrem DJ, Mulcahy MF, Bennett CL, Benson ABIII (2009) Economic implication of Kras testing in metastatic colorectal cancer (mCRC). ASCO 2009 Gastrointestinal Cancers Symposium. Abstract No: 298. San Francisco, CA, 2009.
  36. 36. Behl AS, Goddard KAB, Flottemesch TJ, Veenstra D, Meenan RT, et al. (2012) Cost-effectiveness analysis of screening of KRAS and BRAF mutations in metastatic colorectal cancer. J Natl Cancer Inst 104: 1785–1795.