Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Assessing the relationship between toxicity and economic cost of oncological target agents: A systematic review of clinical trials

  • Francesca Tartari,

    Roles Conceptualization, Data curation, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Economics and Law, University of Macerata. Via Crescimbeni, Macerata, Italy

  • Alessandro Conti,

    Roles Data curation, Formal analysis

    Affiliation Azienda Ospedaliera dell’Alto Adige, Bressanone/Brissen Hospital. Via Dante, Bressanone/Brissen, Italy

  • Roy Cerqueti

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    roy.cerqueti@unimc.it

    Affiliation Department of Economics and Law, University of Macerata. Via Crescimbeni, Macerata, Italy

Assessing the relationship between toxicity and economic cost of oncological target agents: A systematic review of clinical trials

  • Francesca Tartari, 
  • Alessandro Conti, 
  • Roy Cerqueti
PLOS
x

Abstract

Target agents are peculiar oncological drugs which differ from the traditional therapies in their ability of recognizing specific molecules expressed by tumor cells and microenvironment. Thus, their toxicity is generally lower than that associated to chemotherapy, and they represent nowadays a new standard of care in a number of tumors. This paper deals with the relationship between economic costs and toxicity of target agents. At this aim, a cluster analysis-based exploration of the main features of a large collection of them is carried out, with a specific focus on the variables leading to the identification of their toxicity and related costs. The analysis of the toxicity is based on the Severe Adverse Events (SAE) and Discontinuation (D) rates of each target agent considering data published on PubMed from 1965 to 2016 in the phase II and III studies that have led to the approval of these drugs for cancer patients by US Food and Drug Administration. The construction of the dataset represents a key step of the research, and is grounded on the critical analysis of a wide set of clinical studies. In order to capture different evaluation strategies of the toxicity, clustering is performed according to three different criteria (including Voronoi tessellation). Our procedure allows us to identify 5 different groups of target agents pooled by similar SAE and D rates and, at the same time, 3 groups based on target agents’ costs for 1 month and for the median whole duration of therapy. Results highlight several specific regularities for toxicity and costs. This study present several limitations, being realized starting from clinical trials and not from individual patients’ data. However, a macroscopic perspective suggests that costs are rather heterogeneous, and they do not clearly follow the clustering based on SAE and D rates.

Introduction

The present study aims at finding out whether there is a clear connection between the toxicity of novel anticancer drugs and their cost. To this end, we explore the information related to the rate of Severe Adverse Events (SAE) and the discontinuation (D) of a qualified set of oncological drugs. Such rates contribute to the creation of a so-called Toxicity Index (TI). Specifically, we have created a high-quality dataset by investigating the phase III studies in the context of the approval by the US Food and Drug Administration (FDA) of the target agents and of their introduction in the clinical practice.

The motivations for our study are of economic and social nature. In fact, cancer is one of the most costly health conditions to manage worldwide [1]. Anticancer agents have represented the 43% of new drugs approved by the FDA in the last decade [2]. The increase of drug spending in oncology is mainly due to the recent introduction of new targeted and immunotherapy agents [3], which have improved the outcome of cancer patients in terms of Overall Survival (OS) and Progression-Free Survival (PFS) compared to conventional chemotherapy. Although these agents are generally associated with a lower rate of treatment D due to drug toxicity, their impact on patients' Quality of Life (QoL) should not be overlooked. Improving patients’ QoL and their compliance to treatments will represent the challenge for cancer researchers in the future years. Indeed, by a purely economic perspective, reducing the toxic effects of these treatments will allow to decrease the abstention from work days and to increase productivity, hence leading to a wider access to cures due to a better economic status [48].

This paper can be properly inserted in the frame of pharmacoeconomics, which is a scientific discipline related to the cost and the value of drugs and provides suggestion for the optimal allocation of the healh care resources. This conceptualization was proposed by Townsend in 1987 [9], who identified the Pharmacoeconomics as “the description and the analysis of costs of therapeutic approch substained by the Health System and Society”. However, the first definition of Pharmacoeconomics dates back to 1977 when Weinstein and Stason [10] published a paper dealing with economic analysis in health field.

On the current scenario of rapidly rising health care costs, pharmaeconomic techniques are becoming increasingly relevant to analyze the cost-effectiveness and economic sustainability of emerging drugs [11]. Among such techniques, cluster analysis plays a relevant role. In fact, cluster analysis is used to identify groups of similar data based on selected variables and is particularly suitable for their comparison. The versatility of such a statistical technique explains also its popularity in many fields of applied science [1220]. Indeed, cluster analysis seems to be appropiate for performing a global study of the connection between drug effectiveness, toxicity and cost. In this context, it is worth mentioning Perrier et al [14], who explored the transferability of health cost assessment between Italy and France. The authors constructed a hierarchical structure using cluster analysis and identified four different clusters based on diagnosis, surgery, chemotherapy and follow-up. Their findings showed that a high variability was present between this two countries, suggesting a low transferability of cost evaluations across Italy and France. Two years later, Liao et al. [15] performed an observational study on 18,380 patients with end-stage renal disease who initiated hemodialysis. By using K-means and hierarchical cluster analyses with either flexible beta or Ward’s methods, they identified 4 clusters based on sample sizes and change of cost patterns, finding that higher costs were correlated with more increasing comorbidity scores.

In our study we are different from the quoted papers since we first create a dataset containing clinical and economic information about all the oncological target agents approved in clinical practice. In this respect, it is important to recall that a target agent is a drug that is able to recognize one or more specific molecules expressed by tumor cells, immune cells or, more generally, by tumor microenvironment in cancer patients. The identification procedure has been rather complex -it mirrors the complexity of the faced problem- and represents a relevant step of the research.

Furthermore, we have employed a method based on Voronoi tessellation [21], which represents a potential visualization of the subgroups identified by the cluster analysis. Voronoi diagram is a kind of decomposition of a given metric space based on the distance (which is Euclidean in the original formulation of Voronoi) to specified sites called centroids [21]. Particularly, each centroid recognizes data that are nearer to it than to the other centroids in accord to the given distance. By applying this technique, we are able to explore the way in which clusters of toxicity and costs overlap, hence giving information on the relationship between drug toxicity and related cost.

As we will see below, to gain more insights we depart from the original formulation of Voronoi and consider also minimum and maximum distances.

Cluster analysis, with a specific Voronoi diagrams approach, has been recently applied in the economic field [2225]. In 2009, Liu et al. [22] explored the distribution of rural assessment using this technique. They showed that the distance from highways and rivers were the two factors that majorly influenced the distribution of rural settlements. More recently, Vaz et al. [23] reported a significant difference in term of regional innovation patterns as a consequence of istitutional innovation profiles.

As already mentioned above, we here investigate, through a cluster analysis procedure, whether there is a correlation between the cost of molecularly targeted and immnotherapy agents and their toxicity in terms of SAE and D rates.

To the best of our knowledge, this is the first paper dealing with toxicity and cost of target agents in oncology through a cluster analysis. More than this, the construction of the dataset on the basis of an exhaustive literature review is also a novelty in the oncological studies.

The rest of the paper is organized as follows. Section 2 collects the results of the analysis, while Section 3 provides a discussion of them. In Section 4 we present how the used dataset has been constructed and illustrate its main statistical properties. Furthermore, Section 4 contains also the description of the employed methodological tools, with a detailed explanation of the cluster analysis.

Materials and methods

Costruction of the dataset

The construction of the dataset has been implemented through a critical analysis of a wide set of clinical studies.

The selection of the relevant researchs has been carried out according to the instructions contained in the PRISMA [26] (S1 File). The scientific literature of interest has been identified from keywords selections on the PubMed database, in a period ranging from 1965 to 2016. Specifically, the research has been conducted by combining the words "cancer", "neoplasm", "solid tumor" and "clinical trial" with the name of each target agent.

As a second step, we have identified the papers dealing with human studies and randomized trials published in English and meeting the following criteria: 1) phase III studies conducted in patients with cancer; 2) random assignment of participants to treatment with a target therapy or a control (standard of care, placebo or best supportive care). In case of several publications related to the same experiment, only the most recent one or the most complete referring to included trial has been considered. Phase I and phase II trials has been excluded because of their variability and the lack of sufficient controls.

For each of the obtained papers we have reported the scientific study, the name of all authors, the name of the journal, the reference year, the number of the volume and the reference pages.

The resulting list of studies on target agents has been explored to assess the variables of interest related to the specific agent, i.e.: number of patients treated with target agents in the clinical studies, PFS (defined as the time from the start of therapy to disease progression or death), rate of all-grade AE and SAE (which leads to the necessity of medical assistence, hospitalization or drug interruption) and the D rate due to drug toxicity.

For the present research, we consider as variables the rate of SAE and the D rate, leaving the other ones for future studies.

Information on the costs of the target agents has been derived directly from their websites. All costs are expressed in American US Dollars.

Cluster analysis

Cluster analysis and Voronoi tesselation were performed by R software version 3.3.0 for Windows (62 megabytes, 32/64 bit). We have compared the clusters of target agents obtained when taking toxicity and when taking costs.

For what concerns toxicity, we have considered SAE and D rates as relevant variables. They are the parameters concurring in our conceptualization of the Toxicity Index (TI, hereafter).

The procedure of centroids selection has been implemented accordingly to clinical and scientific criteria, in order to represent the most meaningful groups of combinations of the two variables. For this analysis, we have reasonably considered five centroids as follows: ϕ1 = (10,5); ϕ2 = (30,15); ϕ3 = (45,10); ϕ4 = (60,20); ϕ5 = (75,25), where the first component is the SAE value while the second one represents the D rate. In particular, centroid ϕ1 is associated with low rate of SAE and low D rate, which leads to a low TI; ϕ2 has low-medium rate of SAE and medium D rate, which means low-medium TI; ϕ3 has medium rate of SAE and low-medium D rate (medium TI); ϕ4 represents medium-high rate of SAE and medium-high D rate (medium-high TI); ϕ5 identifies a cluster with high rate of SAE and high D rate (high TI). The cluster obtained by centroid ϕh will be denoted by Ch, for each h = 1,2,3,4,5. Moreover, by denoting the observations of SAE and D rates by the variables x and y, respectively, we also denote components of the centroid ϕh = (ϕh,x,ϕh,y), for each h = 1,2,3,4,5.

Clusters are identified by the nearness of the target agent toxicity with the centroids. At this aim, we apply three different concepts of distance: an Euclidean one–in accord to the original model of Voronoi-, the maximum and the minimum. Formally, for any given target agent j = 1,2,…,37 with SAE rate xj and D rate yj, we define

According to the specific metric selected, we derive the clusters of target agents as follows:

For what concerns the costs of the target agents, we have implemented two simple clusterings based on two variables. First, we have grouped the investigated drugs into three groups on the basis of 1-month cost patterns: cost less than 7,000$ (Group A), cost ranging from 7,000 to 11,000$ (Group B) and cost greater than 11,000$ (Group C). In the same way, drugs were grouped according to their costs extimated for the complete treatment for each patient within 3 groups: cost less than 40,000$ (Group D), cost ranging from 40,000$ to 80,000$ (Group E) and cost greater than 80,000$ (Group F).

Results

At the end of text analysis, we have obtained 4,803 studies concerning the use of molecular targeted drugs in cancer patients (the list of drugs is reported in the first column of Table 1).

thumbnail
Table 1. List of target agents employed in oncological patients.

Their characteristics are related to drug efficacy in terms of median Progression-Free Survival (PFS) and drug toxicity in terms of rate of all-grade, severe adverse events and discontinuation rate. BCC = Basal-cell Carcinoma; GIST = Gastrointestinal Stromal Tumor; NSCLC = Non Small Cell Lung Cancer; RCC = Renal Cell Carcinoma.

https://doi.org/10.1371/journal.pone.0183639.t001

Therefore, 2,914 of the 4,083 original papers have been excluded because of phase I studies, observational, in vitro, reviews or letters about targeted therapies. Of the 1,889 remained studies, 1,852 were excluded because dealing with phase II or because not containing data on the SAE and D rates.

As a result, we have found 23 target agents that are used in 37 different therapeutic settings [2763] (Table 1).

The identification of the relevant papers is described in Fig 1, where it is presented a block diagram of the PRISMA procedure.

Table 2 contains the main statistical indicators of the dataset. The mean/std. dev. ratio allows additional considerations about the heterogeneity within the clusters, which is low, supporting that each cluster includes similar drugs both in terms of SAE and D rates.

Concerning skewness, it is relevant to note that only the rate of all grade adverse events is negative (-2.06) with a curve of distribution characterized by a longer left tail with a median of patients developing at least an adverse event (95%) that overcross the mean of patients (86%). Further information can be added by observing the leptokurtic distribution of all grade adverse events (curtosis is 3.95), while the distribution of SAE is platykurtic (curtosis is -1.38).

It is also important to observe the response rates reported by target agents, which range from 1% to 80% (Table 2). Such a result underlines the extreme variety of actions of these new generation agents that can improve patient survival without reducing tumour sizes.

Fig 2A, 2B and 2C show the clusters based on Euclidean distance, maximum distance and minimum distance, respectively. A spatial representation of the dynamic fields related to cluster analysis by Euclidean distance has been obtained by Voronoi diagram as reported in Fig 3.

thumbnail
Fig 2.

Cluster analysis based on Toxicity Index (TI) considering Euclidean distance (A), maximum distance (B) and minimum distance (C). The “+” represent the centroids.

https://doi.org/10.1371/journal.pone.0183639.g002

thumbnail
Fig 3. Voronoi tesselation based on Toxicity Index (TI) considering Euclidean distance.

https://doi.org/10.1371/journal.pone.0183639.g003

The results of cluster analysis with Euclidean distance show a major similarity with the findings obtained by the maximum distance. In particular, such clustering criteria place in two different clusters only two drugs (Regorafenib, charaterized by SAE and D rates of 54 and 44.8, respectively, and Pembrolizumab, with SAE and D rates of 75 and 6.9, respectively. They belong to cluster 4 based on Euclidean distance and to cluster 5 according to the maximum distance). Differently, the clusters based on minimum distance are markedly different from both the other analyses.

It is interesting to note that the highest cost for a month and per PFS are represented by the combination of Cobimetinib and Vemurafenib and the lowest by Erlotinib (when used for patients with pancreatic cancer). The mean and median montly costs are 9,366 $ and 8,627 $, respectively. On the other hand, the mean and median costs per PFS are 73,154 $ and 49,500 $, respectively (Table 3).

thumbnail
Table 3. List of target agents approved for their use in cancer patients and related costs.

BCC = Basal-cell Carcinoma; GIST = Gastrointestinal Stromal Tumor; NSCLC = Non Small Cell Lung Cancer; RCC = Renal Cell Carcinoma.

https://doi.org/10.1371/journal.pone.0183639.t003

Both Fig 4A and 4B show that heterogeneous cost distribution that doesn’t clearly follow the cluster division based on TI. However, some illustrations of the relationship between toxicity and costs can be carried out at the single clusters level. For instance, as for the 1-month cost, the higher rate of drugs from Group C belongs to Cluster 5, whilst the higher percentage of drugs from Group A are included in Cluster 3. Concerning the total cost estimated for a single patient for the whole treatment, the higher rate of drugs belonging to Group D belongs to Cluster 4, whilst the higher percentage of drugs from Group F are in Cluster 5. The complete distribution of costs within the 5 clusters is reported in Table 4 and Fig 5.

thumbnail
Fig 4.

Cluster analysis based on Euclidean distance considering the drug costs for 1-month (A) or for the median total duration of therapy (B) for a single oncological patient. Green points represent drugs with low cost (Group A), violet points drugs with medium cost (Group B) and pink with high cost for 1-month of treatment (Group C).

https://doi.org/10.1371/journal.pone.0183639.g004

thumbnail
Fig 5. The distribution of different clusters into the three cost categories related to the amount for median Progression-Free Survival (PFS).

https://doi.org/10.1371/journal.pone.0183639.g005

Discussion

Our paper concerns the study of the relationship between the toxicity and cost of newly approved target agents in the Oncology field. All the drugs approved by FDA have been considered. Variables related to SAE and D rates have been collected from published phase III studies.

Cluster analysis has been employed to explore such a relationship. Specifically, three different clustering criteria based on the Euclidean distance–in accord to the standard Voronoi tessellation definition- and maximum and minimum distances have been considered.

To interpret the outcomes of the analysis, we need to provide an intuitie description of the clustering criteria.

The minimum distance is the one that underestimate the toxicity level, in that it may place a drug in a low-toxicity cluster even if some related parameters are of remarkable high level.

Differently, the maximum distance is more “cautios” and overestimates the level of toxicity, since it may insert an agent into a high-toxicity cluster even when some toxicity parameters exhibit a low value.

The “fair” situation is captured by the Euclidean distance, which is the one used in the original Voronoi model. The comparison among the results of the clustering proedures suggests that taking a definition of toxicity that may imply its overestimation is closer to fairness than dealing with an understimation criterion.

It is important to note that the toxicity associated with oncological drugs implicates a high-cost management. In this regard, previous studies have tried to quantify this amount. For example, Roncato et al. [64] evaluated the economic burden of Irinotecan-related toxicity in patients with metastatic colorectal cancer, revealing that the mean predicted cost per patient was 4,886 €. On the other hand, Arondekar et al. [65] investigated the costs of AEs in 2,621 patients with metastatic melanoma by employing multivariate generalized linear models (GLMs) with a log-link function and gamma distribution. They reported a 30-day incremental cost of over 9,000 $ for metabolic AEs, 8,450 $ for hematologic, 6,476 $ for cardiovascular and 6,338 $ for gastrointestinal AEs [65].

Similarly, Bilir et al. [66] studied the economic burden of toxicities associated with treating metastatic melanoma in the United States. They registered that the highest mean in patient costs for an AE were associated with acute myocardial infarction, sepsis, and coma, ranging from 31,682 $ to 47,069 $. In addition, the mean cost for hospitalization due to other AEs ranged from 19,122 $ to 26,861 $ [66].

The quantification of the economic impact related to the toxicity of target agents will represent a major step forward in the phases of drug approval and cost establishement, representing a fundamental parameter that must be considered during these processes.

In the last years, several techniques of drug reimboursement have been introduced in the pharmacoeconomic scenario and are currently employed in the oncological field. These modalities include: (1) payment by results, which consists in the total refund by the manyfacturer for non-responding patients; (2) risk sharing, which provides for a partial refund for non-responding patients after a clinical/radiological evalutation; (3) cost sharing, which sets an initial discount for all treated patients. These techniques have become even more fundamental after the introduction of immunotherapy in the therapeutic armamentarium of cancer patients. In fact, these agents are characterized by both relevant cost and high efficacy, supporting the research for new tools aimed to optimize the use of economic resources in the health system. In this respect, Russi et al. [67] proposed a new cost-containmet strategy for the use of immunotherapic agent ipilimumab for patients with melanoma in Italy. This model included, by one side, drug-day and centralization of compounding (accounting for a reduction of -11.1% of drug cost) and, by the other side, payback systems designed by AIFA (resulting in additional -6.2%) [67].

Our study present several limitations. First of all it is a systematic review realized starting from clinical trials and not from individual patients’ data. Thus, data on drug toxicity might be influenced by confounding factors such as the presence of different tumors, patients’ comorbidities or simultaneous treatments. Furthermore, patients eligible for clinical trials mostly show fair organ functions, leading to a potential underestimation of drug toxicity compared to clinical practice. Finally, we are awared that the various toxicities considered in our analysis may have a different impact on patient QoL and a wide range of clinical consequences, although we considered only SAEs that lead to patient hospitalization and/or medical interventions and the D rate.

In face of these limitations, at a macroscopic level, our analysis highlights that there is a not straightforward relationship between the toxicity of target agents and their relative costs for 1-month or the whole treatment duration. However, we can notice that the number of target agents with high costs results more relevant in the clusters associated with the worst drug-tolerability (high SAE and D rates), although they belong also to the cluster characterized by better safety (low SAE and D rates).

Interestingly, data on kurtosis and skewness underline that a high percentage of cancer patients treated with molecularly target agents do experience at least one all grade adverse event. The toxicity of these drugs, altough lower than that associated with chemotherapy, suggest that the costs of management of adverse events must be considered during the phases of approval and price negotiation.

To sum up, the relationship between the cost and the efficacy and toxicity of new generation drugs does not follows a regular path. However, the constructed database and the findings here obtained can be efficiently used for the development of a unified theory on the cost management of treating cancer patients and on the study of the impact of these agents on their QoL.

Supporting information

S1 File. PRISMA 2009 checklist.

List of the indications provided by the “PRISMA statment” for the realization of meta-analyses and systematic review.

https://doi.org/10.1371/journal.pone.0183639.s001

(DOC)

Acknowledgments

We thank Dr. Matteo Santoni for his support in the revision of the oncological data employed in this analysis.

References

  1. 1. Soni A. Trends in the Five Most Costly Conditions among the U.S. Civilian Institutionalized Population, 2002 and 2012. Statistical Brief 470. Rockville, Md: Agency for Healthcare Research and Quality; 2015.
  2. 2. http://www.fda.gov; accessed on December 10th, 2016
  3. 3. Bradley CJ, Yabroff KR, Warren JL, Zeruto C, Chawla N, Lamont EB. Trends in the Treatment of Metastatic Colon and Rectal Cancer in Elderly Patients. Med Care. 2016;54: 490–497. pmid:26900834
  4. 4. Shih YC, Smieliauskas F, Geynisman DM, Kelly RJ, Smith TJ. Trends in the Cost and Use of Targeted Cancer Therapies for the Privately Insured Nonelderly: 2001 to 2011. J Clin Oncol. 2015;33: 2190–2196. pmid:25987701
  5. 5. Ekwueme DU, Yabroff KR, Guy GP Jr, Banegas MP, de Moor JS, Li C, et al. Medical costs and productivity losses of cancer survivors United States, 2008–2011. MMWR Morb Mortal Wkly Rep. 2014;63: 505–510. pmid:24918485
  6. 6. Guy GP Jr, Ekwueme DU, Yabroff KR, Dowling EC, Li C, Rodriguez JL, et al. Economic burden of cancer survivorship among adults in the United States. J Clin Oncol. 2013;31: 3749–3757. pmid:24043731
  7. 7. Guy GP Jr, Yabroff KR, Ekwueme DU, Smith AW, Dowling EC, Rechis R, et al. Estimating the health and economic burden of cancer among those diagnosed as adolescents and young adults. Health Aff (Millwood). 2014;33: 1024–1031.
  8. 8. Guy GP Jr, Yabroff KR, Ekwueme DU, Virgo KS, Han X, Banegas MP, et al. Healthcare Expenditure Burden Among Non-elderly Cancer Survivors, 2008–2012. Am J Prev Med. 2015;49: S489–497. pmid:26590644
  9. 9. Townsend RJ. Post-marketing drug research and development. Drug Intell Clin Pharm. 1987;21: 134–136. pmid:3816576
  10. 10. Weinstein MC, Stason WB. Foundations of costo-effectiveness analysis for health and medical practices. N Engl J Med. 1977;296: 716–721. pmid:402576
  11. 11. Zanfina A, Hansoo K, Ella Z, Christopher MR, Bruce H, Danny L. Overview of pharmacoeconomic modelling methods. Br J Clin Pharmacol. 2013;75: 944–950. pmid:22882459
  12. 12. Řezanková Hana. Cluster Analysis of Economic Data. STATISTIKA 94(1); 2014.
  13. 13. Eisen MB, Spellman PT, Brown PO, Botstein D. Genetics Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci USA. pp.14863–14868; 1998.
  14. 14. Lionel P, Alessandra B, Giuseppe M, Patrick SB, Françoise D, Petrus JP, et al. Transferability of health cost evaluation across locations in oncology: cluster and principal component analysis as an explorative tool. BMC Health Serv Res. 2014;14: 537. pmid:25399725
  15. 15. Liao M, Li Y, Kianifard F, Obi E, Arcona S. Cluster analysis and its application to healthcare claims data: a study of end-stage renal disease patients who initiated hemodialysis. BMC Nephrol. 2016;17: 25. pmid:26936756
  16. 16. Requia WJ, Koutrakis P, Roig HL, Adams MD, Santos CM. Association between vehicular emissions and cardiorespiratory disease risk in Brazil and its variation by spatial clustering of socio-economic factors. Environ Res. 2016;150: 452–460. pmid:27393825
  17. 17. Blanco MR, Martin JS, Kahlscheuer ML, Krishnan R, Abelson J, Laederach A, et al. Single Molecule Cluster Analysis dissects splicing pathway conformational dynamics. Nat Methods. 2015;12: 1077–1084. pmid:26414013
  18. 18. Gerber S, Horenko I. Improving clustering by imposing network information. Sci Adv. 2015;1: e1500163. pmid:26601225
  19. 19. Bailly S, Destors M, Grillet Y, Richard P, Stach B, Vivodtzev I, et al. scientific council and investigators of the French national sleep apnea registry (OSFP). Obstructive Sleep Apnea: A Cluster Analysis at Time of Diagnosis. PLoS One. 2016;11: e0157318. pmid:27314230
  20. 20. Wong NS, Huang S, Chen L, Zhao P, Tucker JD, Yang LG, et al. Spatiotemporal clusters of primary and secondary syphilis cases in south China: an observational study. Lancet. 2016;388 Suppl 1: S90.
  21. 21. Voronoi GF. Nouvelles applications des paramtres continus la thorie de formes quadratiques, Journal fÄur die reine und angewandte Mathematik. 1908;134: 198–287.
  22. 22. Liu XT, Zheng XQ, Li DB. Voronoi Diagram-Based Research on Spatial Distribution Characteristics of Rural Settlements and Its A®ecting FactorsA Case Study of Changping District, Beijing. Journal of Ecology and Rural Environment 2,007; 2009.
  23. 23. Vaz E, de Noronha Vaz T, Galindo PV, Nijkamp P. Modelling innovation support systems for regional developmentanalysis of cluster structures in innovation in Portugal. Entrepreneurship and Regional Development. 2014;26: 23–46.
  24. 24. https://howmuch.net/articles/us-economy-summarized-in-one-diagram; accessed on December 10th, 2016
  25. 25. http://www.relativelyinteresting.com/world-economy-visualized-one-brilliant-diagram; accessed on December 10th, 2016
  26. 26. Moher D, Liberati A, Tetzlaff J, Altman DG for the PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339: 25–35.
  27. 27. Ryan CJ, Smith MR, de Bono JS, Molina A, Logothetis CJ, de Souza P, et al. Abiraterone in metastatic prostate cancer without previous chemotherapy. N Engl J Med. 2013;368: 138–48. pmid:23228172
  28. 28. de Bono JS, Logothetis CJ, Molina A, Fizazi K, North S, Chu L, et al. Abiraterone and increased survival in metastatic prostate cancer. N Engl J Med. 2011;364: 1995–2005. pmid:21612468
  29. 29. Sequist LV, Yang JC, Yamamoto N, O'Byrne K, Hirsh V, Mok T, et al. Phase III study of afatinib or cisplatin plus pemetrexed in patients with metastatic lung denocarcinoma with EGFR mutations. J Clin Oncol. 2013;31: 3327–3334. pmid:23816960
  30. 30. Friedman HS, Prados MD, Wen PY, Mikkelsen T, Schiff D, Abrey LE, et al. Bevacizumab alone and in combination with irinotecan in current glioblastoma. J Clin Oncol. 2009;27: 473–4740.
  31. 31. Escudier B, Pluzanska A, Koralewski P, Ravaud A, Bracarda S, Szczylik C, et al. Bevacizumab plus interferon alfa-2a for treatment of metastatic renal cell carcinoma: a randomised, double-blind phase III trial. Lancet. 2007; 370: 2103–2111. pmid:18156031
  32. 32. Hurwitz H, Fehrenbacher L, Novotny W, Cartwright T, Hainsworth J, Heim W, et al. Bevacizumab plus irinotecan, fluorouracil, and leucovorin for metastatic colorectal cancer. N Engl J Med. 2004;350: 2335–2342. pmid:15175435
  33. 33. Bennouna J, Sastre J, Arnold D, Österlund P, Greil R, Van Cutsem E, et al. Continuation of bevacizumab after first progression in metastatic colorectal cancer (ML18147): a randomised phase 3 trial. Lancet Oncol. 2013;14: 29–37. pmid:23168366
  34. 34. Elisei R, Schlumberger MJ, Müller SP, Schöffski P, Brose MS, Shah MH, et al. Cabozantinib in progressive medullary thyroid cancer. J Clin Oncol. 2013 (29):3639–3646. pmid:24002501
  35. 35. Vermorken JB, Mesia R, Rivera F, Remenar E, Kawecki A, Rottey S, et al. Platinum-based chemotherapy plus cetuximab in head and neck cancer. N Engl J Med. 2008;359: 1116–1127. pmid:18784101
  36. 36. Larkin J, Ascierto PA, Dréno B, Atkinson V, Liszkay G, Maio M, et al. Combined vemurafenib and cobimetinib in BRAF-mutated melanoma. N Engl J Med. 2014;371: 1867–1876. pmid:25265494
  37. 37. Shaw AT, Kim DW, Nakagawa K, Seto T, Crinó L, Ahn MJ, et al. Crizotinib versus chemotherapy in advanced ALK-positive lung cancer. N Engl J Med. 2013;368: 2385–2394. pmid:23724913
  38. 38. Beer TM, Armstrong AJ, Rathkopf DE, Loriot Y, Sternberg CN, Higano CS, et al. Enzalutamide in metastatic prostate cancer before chemotherapy. N Engl J Med. 2014;371: 424–33. pmid:24881730
  39. 39. Scher HI, Fizazi K, Saad F, Taplin ME, Sternberg CN, Miller K, et al. Increased survival with enzalutamide in prostate cancer after chemotherapy. N Engl J Med. 2012;367: 1187–1197. pmid:22894553
  40. 40. Moore MJ, Goldstein D, Hamm J, Figer A, Hecht JR, Gallinger S, et al. Erlotinib plus gemcitabine compared with gemcitabine alone in patients with advanced pancreatic cancer: a phase III trial of the National Cancer Institute of Canada Clinical Trials Group. J Clin Oncol. 2007;25: 1960–1966. pmid:17452677
  41. 41. Rosell R, Carcereny E, Gervais R, Vergnenegre A, Massuti B, Felip E, et al. Erlotinib versus standard chemotherapy as first-line treatment for European patients with advanced EGFR mutation-positive non-small-cell lung cancer (EURTAC): a multicentre, open-label, randomised phase 3 trial. Lancet Oncol. 2012;13: 239–246. pmid:22285168
  42. 42. Cappuzzo F, Ciuleanu T, Stelmakh L, Cicenas S, Szczésna A, Juhász E, et al. Erlotinib as maintenance treatment in advanced non-small-cell lung cancer: a multicentre, randomised, placebo-controlled phase 3 study. Lancet Oncol. 2010;11: 521–529. pmid:20493771
  43. 43. Baselga J1, Campone M, Piccart M, Burris HA 3rd, Rugo HS, Sahmoud T, et al. Everolimus in postmenopausal hormone-receptor-positive advanced breast cancer. N Engl J Med. 2012;366: 520–529. pmid:22149876
  44. 44. Schlumberger M, Tahara M, Wirth LJ, Robinson B, Brose MS, Elisei R, et al. Lenvatinib versus placebo in radioiodine-refractory thyroid cancer. N Engl J Med. 2015;372: 621–630. pmid:25671254
  45. 45. Brahmer J, Reckamp KL, Baas P, Crinò L, Eberhardt WE, Poddubskaya E, et al. Nivolumab versus Docetaxel in Advanced Squamous-Cell Non-Small-Cell Lung Cancer. N Engl J Med. 2015;373: 123–135. pmid:26028407
  46. 46. Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, et al. Nivolumab versus Docetaxel in Advanced Nonsquamous Non-Small-Cell Lung Cancer. N Engl J Med. 2015;373: 1627–1639. pmid:26412456
  47. 47. Robert C, Long GV, Brady B, Dutriaux C, Maio M, Mortier L, et al. Nivolumab in previously untreated melanoma without BRAF mutation. N Engl J Med. 2015;372: 320–330. pmid:25399552
  48. 48. Motzer RJ, Escudier B, McDermott DF, George S, Hammers HJ, Srinivas S, et al. Nivolumab versus Everolimus in Advanced Renal-Cell Carcinoma. N Engl J Med. 2015;373: 1803–1813. pmid:26406148
  49. 49. Finn RS, Crown JP, Lang I, Boer K, Bondarenko IM, Kulyk SO, et al. The cyclin-dependent kinase 4/6 inhibitor palbociclib in combination with letrozole versus letrozole alone as first-line treatment of oestrogen receptor-positive, HER2-negative, advanced breast cancer (PALOMA-1/TRIO-18): a randomised phase 2 study. Lancet Oncol. 2015;16: 25–35. pmid:25524798
  50. 50. Turner NC, Ro J, André F, Loi S, Verma S, Iwata H, et al. Palbociclib in Hormone-Receptor-Positive Advanced Breast Cancer. N Engl J Med. 2015;373: 209–219. pmid:26030518
  51. 51. Robert C, Schachter J, Long GV, Arance A, Grob JJ, Mortier L, et al. Pembrolizumab versus Ipilimumab in Advanced Melanoma. N Engl J Med. 2015;372: 2521–2532. pmid:25891173
  52. 52. Fuchs CS, Tomasek J, Yong CJ, Dumitru F, Passalacqua R, Goswami C, et al. Ramucirumab monotherapy for previously treated advanced gastric or gastro-oesophageal junction adenocarcinoma (REGARD): an international, randomised, multicentre, placebo-controlled, phase 3 trial. Lancet. 2014;383: 31–39. pmid:24094768
  53. 53. Garon EB, Ciuleanu TE, Arrieta O, Prabhash K, Syrigos KN, Goksel T, et al. Ramucirumab plus docetaxel versus placebo plus docetaxel for second-line treatment of stage IV non-small-cell lung cancer after disease progression on platinum-based therapy (REVEL): a multicentre, double-blind, randomised phase 3 trial. Lancet. 2014;384: 665–673. pmid:24933332
  54. 54. Tabernero J, Yoshino T, Cohn AL, Obermannova R, Bodoky G, Garcia-Carbonero R, et al. Ramucirumab versus placebo in combination with second-line FOLFIRI in patients with metastatic colorectal carcinoma that progressed during or after first-line therapy with bevacizumab, oxaliplatin, and a fluoropyrimidine (RAISE): a randomised, double-blind, multicentre, phase 3 study. Lancet Oncol. 2015;16: 499–508. pmid:25877855
  55. 55. Grothey A, Van Cutsem E, Sobrero A, Siena S, Falcone A, Ychou M, et al. Regorafenib monotherapy for previously treated metastatic colorectal cancer (CORRECT): an international, multicentre, randomised, placebo-controlled, phase 3 trial. Lancet. 2013;381: 303–312. pmid:23177514
  56. 56. Migden MR, Guminski A, Gutzmer R, Dirix L, Lewis KD, Combemale P, et al. Treatment with two different doses of sonidegib in patients with locally advanced or metastatic basal cell carcinoma (BOLT): a multicentre, randomised, double-blind phase 2 trial. Lancet Oncol. 2015;16: 716–728. pmid:25981810
  57. 57. Escudier B, Lassau N, Angevin E, Soria JC, Chami L, Lamuraglia M, et al. Phase I trial of sorafenib in combination with IFN alpha-2a in patients with unresectable and/or metastatic renal cell carcinoma or malignant melanoma. Clin Cancer Res. 2007;13: 1801–1809. pmid:17363536
  58. 58. Motzer RJ, Hutson TE, Tomczak P, Michaelson MD, Bukowski RM, Oudard S, et al. Overall survival and updated results for sunitinib compared with interferon alfa in patients with metastatic renal cell carcinoma. J Clin Oncol. 2009;27: 3584–3590. pmid:19487381
  59. 59. Demetri GD, van Oosterom AT, Garrett CR, Blackstein ME, Shah MH, Verweij J, et al. Efficacy and safety of sunitinib in patients with advanced gastrointestinal stromal tumour after failure of imatinib: a randomised controlled trial. Lancet. 2006;368: 1329–1338. pmid:17046465
  60. 60. Verma S, Miles D, Gianni L, Krop IE, Welslau M, Baselga J, et al. Trastuzumab emtansine for HER2-positive advanced breast cancer. N Engl J Med. 2012;367: 1783–1791. pmid:23020162
  61. 61. Hudes G, Carducci M, Tomczak P, Dutcher J, Figlin R, Kapoor A, et al. Temsirolimus, interferon alfa, or both for advanced renal-cell carcinoma. N Engl J Med. 2007;356: 2271–2281. pmid:17538086
  62. 62. Long GV, Stroyakovskiy D, Gogas H, Levchenko E, de Braud F, Larkin J, et al. Combined BRAF and MEK inhibition versus BRAF inhibition alone in melanoma. N Engl J Med. 2014;371: 1877–1888. pmid:25265492
  63. 63. Van Cutsem E, Tabernero J, Lakomy R, Prenen H, Prausová J, Macarulla T, et al. Addition of aflibercept to fluorouracil, leucovorin, and irinotecan improves survival in a phase III randomized trial in patients with metastatic colorectal cancer previously treated with an oxaliplatin-based regimen. J Clin Oncol. 2012;(28): 3499–3506. pmid:22949147
  64. 64. Roncato R, Cecchin E, Montico M, De Mattia E, Giodini L, Buonadonna A, et al. Cost Evaluation of Related Toxicities Associated With the UGT1A1*28 Patient Genotype. Clin Pharmacol Ther. 2017; pmid:28074472
  65. 65. Arondekar B, Curkendall S, Monberg M, Mirakhur B, Oglesby AK, Lenhart GM, et al. Economic burden associated with adverse events in patients with metastatic melanoma. J Manag Care Spec Pharm. 2015;(2): 158–164. pmid:25615005
  66. 66. Bilir SP, Ma Q, Zhao Z, Wehler E, Munakata J, Barber B. Economic Burden of Toxicities Associated with Treating Metastatic Melanoma in the United States. Am Health Drug Benefits. 2016;(4): 203–213. pmid:27688833
  67. 67. Russi A, Chiarion-Sileni V, Damuzzo V, Di Sarra F, Pigozzo J, Palozzo AC. Case study on an Ipilimumab cost-containment strategy in an Italian hospital. Int J Technol Assess Health Care. 2017;13: 1–7.