Skip to main content
Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Multivariate Meta-Analysis of Preference-Based Quality of Life Values in Coronary Heart Disease

  • Jelena Stevanović ,

    Affiliation University of Groningen, Department of Pharmacy, Unit of Pharmacoepidemiology and Pharmacoeconomics (PE2), Groningen, The Netherlands

  • Petros Pechlivanoglou,

    Affiliations Toronto Health Economics and Technology Assessment (THETA), Toronto, Canada, University of Toronto, Faculty of Medicine, Institute of Health Policy, Management and Evaluation, Toronto, Canada

  • Marthe A. Kampinga,

    Affiliation University of Groningen, University Medical Center Groningen, Department of Cardiology, Thorax Center, Groningen, The Netherlands

  • Paul F. M. Krabbe,

    Affiliation University of Groningen, University Medical Centre Groningen, Department of Epidemiology, Groningen, The Netherlands

  • Maarten J. Postma

    Affiliation University of Groningen, Department of Pharmacy, Unit of Pharmacoepidemiology and Pharmacoeconomics (PE2), Groningen, The Netherlands



There are numerous health-related quality of life (HRQol) measurements used in coronary heart disease (CHD) in the literature. However, only values assessed with preference-based instruments can be directly applied in a cost-utility analysis (CUA).


To summarize and synthesize instrument-specific preference-based values in CHD and the underlying disease-subgroups, stable angina and post-acute coronary syndrome (post-ACS), for developed countries, while accounting for study-level characteristics, and within- and between-study correlation.


A systematic review was conducted to identify studies reporting preference-based values in CHD. A multivariate meta-analysis was applied to synthesize the HRQoL values. Meta-regression analyses examined the effect of study level covariates age, publication year, prevalence of diabetes and gender.


A total of 40 studies providing preference-based values were detected. Synthesized estimates of HRQoL in post-ACS ranged from 0.64 (Quality of Well-Being) to 0.92 (EuroQol European”tariff”), while in stable angina they ranged from 0.64 (Short form 6D) to 0.89 (Standard Gamble). Similar findings were observed in estimates applying to general CHD. No significant improvement in model fit was found after adjusting for study-level covariates. Large between-study heterogeneity was observed in all the models investigated.


The main finding of our study is the presence of large heterogeneity both within and between instrument-specific HRQoL values. Current economic models in CHD ignore this between-study heterogeneity. Multivariate meta-analysis can quantify this heterogeneity and offers the means for uncertainty around HRQoL values to be translated to uncertainty in CUAs.


A large number of health-related quality of life (HRQoL) measures for patients with coronary heart disease (CHD) is available in the literature[14]. Those measures either describe the HRQoL of patients suffering from CHD overall or distinguish across patients suffering from one of the underlying forms of CHD, specifically stable angina or post-acute coronary syndrome (post-ACS). This interest in estimating the level of HRQoL in CHD is mainly due to its increasing economic and clinical burden [5], the number of CHD prevention and treatment strategies available, and the necessity to assess the impact of a treatment on HRQoL for use as input parameter in cost-utility analyses (CUAs) [6,7].

From the abundance of HRQoL measurements in CHD, only the preference-based HRQoL values can be directly applied in CUA [6,8]. These values express the individual’s preference for living with CHD compared to other health states on an interval scale where the value of zero is assigned to death, and the value of one to full health [7]. Preference-based values can be generated with direct elicitation techniques, such as the time trade-off (TTO), the standard gamble (SG) and the rating scale (RS). Another approach is based on multi-attribute questionnaires, such as the EuroQol 5D (EQ-5D), Short form 6D (SF-6D), health utility index (HUI) and the quality of well-being (QWB) scale [7].

There is significant variation in the published literature with respect to the preference-based HRQoL value of patients with CHD [1,911]. Methodological differences between direct preference-based techniques such as the exact specifications of the questions on individuals’ preferences, have been shown to have considerable impact on HRQoL values [7]. Some of the differences in HRQoL values measured with preference-based multi-attribute instruments reflect the variation across instruments on the sensitivity of different health attributes across different severity levels as well as the use of different direct valuation techniques [7]. Finally, HRQoL values can largely vary due to differences in study-level covariates such as patients’ characteristics (e.g. underlying CHD forms, age, and comorbidities), types of treatment applied or time points of measuring HRQoL relative to the disease onset or treatment initiation.

All the aforementioned differences in the underlying methodology indicate that the choice of the HRQoL value to be applied in CUA needs to consider the impact of both instrument-specific properties and study-level covariates. Notably, when selecting a HRQoL value from the published literature, an evidence synthesis can provide better estimates around the mean and variance of HRQoL to inform CUA than a single study value. The application of meta-analysis on HRQoL values is straightforward when all values are measured with the same instrument. However, a number of studies provide multiple and correlated HRQoL values measured in the same population but using different instruments. Conducting separate univariate meta-analyses for each HRQoL is inappropriate as ignoring the within-study correlation might lead to biased mean and standard error (SE) estimates [12,13]. Instead, multivariate meta-regression analysis is recommended [12,13]. Therefore, in this study we aim to systematically summarize and synthesize the published preference-based HRQoL values in CHD and its underlying disease-subgroups (i.e. stable angina and post-ACS) for developed countries. To account for the underlying differences in the instruments used to measure the HRQoL, and the correlation between instrument-specific values both within and between studies, the synthesis of values is conducted on an instrument-specific level. Additionally, the impact of study-level covariates on HRQoL is explored in regression analysis.


Data collection

This study was conducted following the PRISMA guidelines and a checklist for their application in provided in S1 Appendix. Relevant studies reporting HRQoL in CHD were independently screened and systematically reviewed by two team members [JS and PP]. Studies were searched using MEDLINE and EMBASE. The search terms used were: (“coronary disease” or “coronary heart disease” or “myocardial infarction” or “angina” or “acute coronary syndrome”) and (“utility” or “quality of life” or “outcome assessment”) and ("Health Utilities Index" or "quality of well-being" or "rating scale" or "standard gamble" or "time trade-off" or "15D" or "SF-6D" or "EQ-5D" or "HALex"). See S2 Appendix for details of search strategy for MEDLINE and EMBASE. The search was limited to studies applying to developed countries published between 1990 and November 2014. The last search was conducted on the 15th of December 2014. By including only studies from developed countries, we aimed to limit the variation on HRQoL associated with the relation between socio-economic status and HRQoL [14]. Additionally, the references of the identified articles and other systematic reviews were searched for relevant studies not included in the above-mentioned databases (snowballing). Studies were considered eligible for this analysis if they: 1) applied a preference-based instrument of measuring HRQoL (TTO, SG, RS, EQ-5D, SF-6D, SF-15D, HUI, QWB and HALex) 2) reported mean preference-based HRQoL values measured three months or more after the initiation of CHD-treatment or after the onset of CHD, 3) reported standard deviations (SDs) and sample sizes or confidence intervals (CIs)/SEs of those measurements. Duplicate studies were excluded as well as editorials, letters, clinical conference abstracts, reviews and studies that reported median but not mean HRQoL values. Disagreements were resolved through discussion.

Data from the eligible studies were extracted in duplicate by two team members [JS and PP]. Any uncertainties were resolved by discussion. Data were extracted regarding study origin (authors, publication year, country), study design, participants (age, study sample, percentage of men, percentage of diabetics, underlying form of CHD) as well as the HRQoL (mean value, SD or CI/SE of the mean), type of instrument for measuring HRQoL and correlation coefficients between instrument-specific values. Moreover, for the HRQoL measured with the EQ-5D, we recorded a ‘tariff’ applied to the EQ-5D questionnaire data to generate preferences. Tariffs present valuation sets for EQ-5D health states derived using the TTO technique in nationality-specific population samples [7].

Assumptions and data adjustments

We distinguished between two underlying CHD subgroups: stable angina and post-ACS. The stable angina and the post-ACS groups comprised of stable angina patients and patients with unstable angina or myocardial infarction, respectively, in whom HRQoL was measured at least three months after diagnosis or treatment initiation. Our analysis was limited to HRQoL values measured three months after onset of CHD or treatment initiation hypothesizing that the impact of the acute disease onset or a treatment effect on HRQoL will be stabilized by then. Additionally, all the values identified, including the ones subgrouped to stable angina, post-ACS and the ones for which information on patients’ characteristics were insufficient to provide their allocation to either of the two underlying CHD subgroups, were analysed together as a general CHD group.

Furthermore, no distinction was made between the HRQoL values measured in patient subgroups other than the ones reflecting underlying CHD subgroups (e.g. different treatment or socio-economic subgroups). In cases where studies provided HRQoL values in a subgroup classification that was not of interest, the HRQoL values across subgroups were synthesized to provide a weighted mean and variance estimate for a specific CHD form per study.

Statistical model

A multivariate meta-analysis was used to estimate synthesized, instrument-specific HRQoL estimates in post-ACS, stable angina and general CHD [12]. This approach accounts for the correlation (both within and between studies) between HRQoL values assessed with different instruments and was extended to a multivariate meta-regression analysis to account for the impact of study-level covariates where appropriate. The general structure of the model applied is presented below in matrix form.


Here yi stands for a vector of size p whose elements comprise the instrument-specific HRQoL values for study i, Xi is a matrix of p instruments and k covariates, βi is the vector of regression coefficients of size k, δi is a vector of random-effects terms of size p and εi is a vector of random sampling errors of size p. We assumed that δi~MVN(0,Δ), where (2)

Here Δ represents the between-study variance–covariance matrix and its elements are , the between-study instrument-specific variance, and ρτ(jj′), the between-study correlation coefficient assessed when measuring the HRQoL values with j and j′ instruments. Additionally, it was assumed that εi~MVN(0,Si), where (3)

The matrix Si is the within-study variance–covariance matrix with elements , the within-study instrument-specific variance and ρjj′, the within-study correlation coefficient.

A common problem in multivariate meta-regression is the presence of missing data for variables of interest in eligible studies. In our analysis, missing data were anticipated for some of the yi elements and their corresponding variances, as well as for some within-study correlation coefficients. Missing values in yi may occur when HRQoL in a particular study was not estimated with all the instruments included in the meta-regression. We resolved this by setting the missing values in yi as equal to zero and their corresponding variances equal to an arbitrary large number (1,000) (11). In this way the contribution of these values to the summarized HRQoL estimate was insignificant. The problem related to missing values of ρjj′ was resolved by retrieving correlation estimates from a more general population without severe comorbidities. Elements of ρjj′ that still remained missing were assumed to be equal to zero [13]. In order to observe the impact of ignoring the presence of correlation and to account for possibly different values of correlation coefficients, we undertook a sensitivity analysis by assuming correlation coefficients to take values of 0 and 0.5 [15].

In the regression analysis, the covariates incorporated in Xi were examined for their statistical significance and their impact on reducing some of the between-study heterogeneity on those HRQoL values. Age, publication year, prevalence of diabetes and gender were the covariates examined. Following reasons were employed when choosing covariates: age and gender were previously shown to impact HRQoL [16]; diabetes is a commonly present comorbidity in patients with CHD, and is indicated to be associated with a reduced level of HRQoL (Coffey et al, 2002)[17]; publication year was explored to assess a possible improvement in HRQoL through time. There are no guidelines to suggest the minimal number of studies per outcome of interest (i.e. an instrument-specific HRQoL value) required for the regression analysis to be plausible in the multivariate setting. For this reason, we adopted the guidelines for the univariate setting that suggest a data set sample size of approximately 10 measurements may be sufficient for conducting a regression analysis with one covariate at a time [15]. The regression analysis was limited to those outcomes where at least 10 measurements were available.

In order to indicate the extent of heterogeneity in the true population level of HRQoL that is unexplained by study-level covariates and random sampling error in the multivariate setting, we calculated the and statistics, recently suggested by Jackson et al [18]. We used to measure the impact heterogeneity for all HRQoL estimates jointly and the statistic to measure the level of heterogeneity both jointly and separately for instrument-specific HRQoL estimates [18]. For the estimation of the , the R2 statistic was used as a basis. In the multivariate setting, the R2 statistic can be interpreted as the ratio of the volumes of CIs for summarized estimates under the random effect model and the volumes of CIs for summarized estimates under the fixed effects models [18]. Under such a notation of the R2 statistic, Jackson et al. suggested that the can be estimated as [18]. Furthermore, the statistic, was estimated as , where the H2 statistic represents the ratio of a generalized version of Cohran’s Q statistic and its associated degrees of freedom [18].

The multivariate meta-regression analysis was performed using the package mvmeta [19] in the statistical software R (version 2.15.3) [20].


Study characteristics

The process of study selection and extraction is presented in a PRISMA flow chart (Fig 1). A total of 40 eligible studies representing over 30,575 patients were identified after the inclusion and exclusion criteria were applied. A list of all potentially-eligible studies with reasons for exclusion is presented in S3 Appendix. The main characteristics of these studies are detailed in Table 1 [14,911,16,2152]. The studies were published between 1991 and 2014, with most of them between 2005 and 2010. Of the 40 studies included, 10 referred to the UK, 8 to the US, 6 to the multiple country settings, 4 to Germany, 3 to Canada and Finland, 2 to Norway and Sweden, and 1 to each of Australia and Korea. Various study designs were implemented, ranging from randomised clinical trial to different observational study designs. Of the HRQoL values present in those 40 studies, 31% were observed in patients with stable angina and 29% in patients with post-ACS. The remaining 40% of the HRQoL values were associated with patients suffering from any form of CHD (including stable angina and post-ACS). The majority of patients were men (71%) with an average age of 65.35 years. There was large variation in patients’ characteristics, such as the presence and prevalence of various comorbidities (e.g. prevalence of diabetes was in range 7–38%), and treatment under evaluation (e.g. surgical procedures, pharmacological treatment or cardiovascular rehabilitation) across the studies. When reported, the time of HRQoL assessment from disease onset or treatment initiation was between 4 months and 10 years.

Fig 1. PRISMA flow diagram summarizing the study selection process.

HRQoL, health-related quality of life; SD, standard deviation; SE, standard error; CI, confidence interval.

Table 1. Summary of studies reporting preference-based values in developed countries in coronary heart disease.

The most commonly applied instrument for measuring HRQoL values was the EQ-5D (63.5%), while 15D, QWB, SF-6D, HUI, SG, TTO, RS and HALex were less prevalent (7.7, 7.7, 5.8, 5.8, 3.8, 1.9, 1.9 and 1.9%, respectively). The values measured with the EQ-5D instrument varied by the TTO “tariffs” utilized (i.e. UK, US, Europe and Korea). The scoring of most of the EQ-5D values was based on the UK “tariff” (53%) while US, European and Korean “tariff” were less present (19, 8, 8 and 3%, respectively). Three studies provided no explicit information on the EQ-5D scoring “tariff” used, however, in order to allow for the evidence synthesis these values were grouped together with the UK “tariffs”. The values measured with the HUI instrument were presented in the studies as both mark 2 (i.e. HUI2) and mark 3 (i.e. HUI3).

Finally, the correlation coefficients between the instrument-specific HRQoL values, necessary for conducting a multivariate meta-analysis on the data set formed, were reported in only one of the studies included in the data set [31]. Therefore, some of the correlation coefficients were retrieved from other studies on cardiovascular patients or general populations without severe comorbidities (S1 Table) [31,53,5457]. Nevertheless, a great number of within the instrument-specific correlation coefficients remained missing.

Multivariate meta-analysis estimates in post-ACS, stable angina, and general CHD

Table 2 summarizes the instrument-specific estimates synthesized through multivariate meta-analysis in the post-ACS, stable angina subgroups, and general CHD assessed on the full data set. The values for estimates synthesized in post-ACS ranged from 0.64 (QWB) to 0.92 (EQ-5D European”tariff”), while in stable angina estimates ranged from 0.64 (SF-6D) to 0.89 (SG). In general CHD, the values ranged from 0.60 (HALex) to 0.89 (SG). Between-study SDs and variance-covariance matrices for HRQoL in the post-ACS and stable angina subgroups, and general CHD, when these parameters could be estimated, are reported in S2S4Tables.

Table 2. Post-acute coronary syndrome, stable angina, and general CHD parameter estimates for HRQoL and multivariate heterogeneity statistics using multivariate meta-analysis.

In this evidence synthesis, some of the instrument-specific HRQoL values included in the data set were present only as single inputs. Notably, the output of the multivariate meta-analysis in the aforementioned cases reflected the initial instrument-specific HRQoL inputs. Because the EQ-5D UK”tariff” values were the only instrument-specific values available as multiple inputs in both post-ACS and stable angina subgroups, a relatively fair comparison of the level of summarized HRQoL between the two subgroups would only be possible for this instrument-specific subgroup. This comparison indicated slightly lower estimates in post-ACS (i.e. 0.76) than the ones in stable angina (i.e. 0.78).

Large variations are noticeable across instrument-specific estimates of HRQoL in CHD presented in Table 2. The highest level of HRQoL was observed for the SG, TTO and 15D estimates, which were followed by slightly lower EQ-5D and HUI estimates, while the RS, SF-6D, QWB and HALex were the instruments with lowest HRQoL estimates.

Interestingly, substantial unexplained between-study but within-instrument heterogeneity was observed in all the multivariate meta-analysis models with the most excessive levels of heterogeneity observed in general CHD assessed on the full dataset (Table 2). There was a general agreement between both and statistics on the level of heterogeneity.

Regression analysis

The EQ-5D UK “tariff” values were the only instrument-specific values available with more than 10 observations per instrument used and therefore in line with our requirement for regression analysis. This led to reducing the analysis from a multivariate to a univariate meta-regression. Table 3 presents the EQ-5D UK “tariff” estimates synthesized through a univariate meta-regression where the impact of disease subgroup, age, publication year, and prevalence of diabetes and of men was examined on the HRQoL. Here, increasing age was found to generally reduce the level of HRQoL while prevalence of diabetes and higher proportion of men increased its level. The impact of publication year was inconclusive. However, none of the covariates examined was found to provide a significant improvement in the model fit nor did they reduce the between-study heterogeneity (Table 3).

Table 3. Parameter estimates and heterogeneity statistics for the EQ-5D UK “tariff” estimates using univariate meta-regression.

Sensitivity analysis on the correlation coefficients between instrument-specific values was undertaken. The result of this sensitivity analysis was that the model was overall robust to different values of the correlation coefficients (S5 Table). Moreover, the SEs of instrument-specific estimates were generally insensitive to ignoring the correlation between the instrument-specific values or setting the values of correlation coefficients to 0.5.


This is the first study that systematically summarized and synthesized instrument-specific preference-based HRQoL values in CHD, and its underlying disease-forms, post-ACS and stable angina in developed countries. Pooled mean HRQoL values were estimated and a large variation was observed both within and between the instrument-specific values. This variation could be explained by the large underlying heterogeneity in the study populations, and the observed and unobserved variation between the HRQoL instruments. Other factors possibly include the impact of treatment applied, initial (acute) disease severity level, national and socio-economic characteristics, various comorbidities present or the time of assessment. Moreover, the fact that TTO “tariffs” derived in nationality-specific population samples for the preference-based scoring of the EQ-5D vary across countries [58], suggests possible larger variations in the HRQoL values in CHD patients from various national or multinational settings. Additional arguments emphasize that unobservable differences in cultural or socio-economic status may also be present in representatives of general population samples selected for the assessment of tariffs [59]. The consequence of this would then be a greater underlying variability in HRQoL values in CHD assessed with instruments utilizing those tariffs. In essence, the aforementioned concerns may have a direct impact on the generalizability of country-specific HRQoL values to various national or multinational settings.

The regression analysis indicated no significant association between available study-level covariates and HRQoL estimates. Caution is needed in the interpretation of those findings, especially when low power for testing the effect of study-level covariates on the pooled HRQoL estimate is present—namely, only 22 EQ-5D UK “tariff” values were available for the regression-analysis. However, the reduction and increase in HRQoL observed with advancing age and higher proportion of men, respectively is in line with other published information [60]. Surprisingly, studies with a higher proportion of patients with diabetes had a higher average HRQoL estimate what contrasts the finding by Xie et al. [61]. This may be due to the missing information of the prevalence of diabetes across the studies as well as an example of ecological fallacy.

The variation between the instruments in the HRQoL estimates observed in our study is in agreement with the findings from other studies that demonstrated the differences across instrument-specific HRQoL values [6264](Fryback et al 2009)[65]. Similarly to the study by Johnson et al, we observed higher levels of HRQoL when summarizing the EQ-5D US “tariffs” compared to the UK “tariffs”[58]. Additionally, SG values commonly exceed TTO values and RS values, a finding that was also confirmed in our study [66,67]. Furthermore, our synthesized HUI3 estimates in CHD were lower compared to the EQ-5D estimates, but similar to the findings of O’Brien et al. in patients at increased risk of sudden cardiac death and receiving implantable defibrillator therapy[63]. In our study, both the summarized and study-level SF-6D values were lower than EQ-5D values in CHD what contrasts the observations of Brazier et al.[1,45]. We observed the lowest level of HRQoL in CHD for estimates measured with the QWB and the HALex, what is in line with the patterns of values in general US population measured with six preference-based instruments by Fryback et al.[65] Differences such as the valuation technique, bounds of scale and sensitivity to change after treatment are only some of potential reasons for the variation between the instrument-specific HRQoL estimates [6264].

For the evidence synthesis we applied multivariate meta-analysis given that when information on various instrument-specific values is sparse, it allows for “borrowing of strength” from the values available by accounting for the correlation between them [12,13]. Though such an approach may provide more precise summarized estimates [12,13] than a meta-analysis where the correlation is ignored, this did not hold in our study due to a high between-study variation.

Potentials for direct comparisons of our analysis to other synthesized HRQoL values are limited due to the lack of studies meta-analysing preference-based values in CHD. A meta-analysis of 84 studies identified to address HRQoL in cardiac patients by Kinney et al. may be one potential comparator to our study [68]. Kinney et al. investigated the effect of pharmacological, surgical, nursing or other treatment on HRQoL and found a small positive effect of treatment (i.e. standardised mean difference (d) = 0.31). Despite certain similarity in the patient populations investigated between the two studies can be acknowledged, numerous differences such as the study inclusion criteria (i.e. any measurement of HRQoL including the ones of single health attributes), choice of study effect size (i.e. standardised mean difference), the period of data collection (i.e. 1987–1991) and the methodology used for conducting meta-analysis (i.e. fixed-effect model) hamper adequate comparisons.

Another comparator to our study may be a review by Dyer et al. on the EQ-5D values in cardiovascular disease (CVD)[69]. Dyer et al. summarized and stratified the EQ-5D values across different CVD subgroups (e.g. ischemic heart disease (IHD) such as angina/myocardial infarction/CHD, heart failure etc.) and, when feasible, across three severity level categories defined by the percentage of patients in a given group in class III/IV of NYHA or CCS class[69]. Their stratification of the EQ-5D values with IHD collected at baseline resulted in the range of values from 0.45 for moderate/severe angina to 0.80 for mild angina. The authors did not synthesise these values across different severity levels due to the high heterogeneity observed (i.e. I2 of 82–96%), but suggested more rigorous study inclusion criteria and the possibility to expand their data set with more recent publications (i.e. studies published after 2008) as a method to reduce some of the heterogeneity observed[69]. However, the more rigorous inclusion criteria that our study proposed such as the inclusion of only mean HRQoL values measured in patients in stable or post-acute disease state, and incorporating HRQoL values from a wider publication range (i.e. 1990–2014) in the data set, did not reduce the high heterogeneity observed across studies. Notably, the heterogeneity indices observed in the study by Dyer et al. and the ones observed between the EQ-5D values in our study cannot be directly compared[69]. Differences between the two data sets and the method for disease stratification (i.e. post-ACS and stable angina subgroups vs. CCS class categories reported in ICH) are limiting such a comparison.

Our analysis is confronted with certain limitations. The main limitation of our study is that we analysed study-level and not patient-level data. Analysing patient-level data might provide significant improvements in our analysis. If detailed information on patients currently nonclassified specific CHD from was available, this would allow for a more accurate disease-specific allocation of HRQoL values. Conducting the multivariate meta-analysis on such a data set could possibly lead to estimates with lower level of between-study heterogeneity. Another limitation of our study was that we conducted the meta-regression analysis only on the subset of the EQ-5D UK “tariff” values due to a relatively small number of studies providing other instrument-specific values. This regression analysis was also limited with the respect to the variety of covariates investigated. Covariates such as patients’ socioeconomic status, presence of comorbidities other than diabetes or the impact of treatment applied were not investigated in the regression analysis due to their scarce information across the studies [70]. Expectedly, this study was confronted with the missing information on within-study correlation coefficients. This was solved by retrieving the correlation coefficients reported in other studies on cardiovascular patients or general populations. The sensitivity of the study results on the correlation coefficients utilized was tested in the sensitivity analysis. Furthermore, the publication bias was not formally assessed using a funnel plot due to the small number of instrument-specific HRQoL values included in this study as well as considerable heterogeneity. Also, publication bias is not expected in our meta-analysis given that the HRQoL values are commonly measured as secondary study outcomes and, therefore, are not expected to impact the decision to publish. Finally, information on HRQoL in CHD measured with non-preference-based and disease-specific instruments was not included in our analysis.

Importantly, our study did not aim to investigate what the most appropriate and reliable instrument to measure HRQoL in CHD is, but rather to summarize and synthesize all the available evidence of preference-based instrument-specific values. The decision on the most robust instrument-specific estimate to be applied in a CUA depends not only on the appropriateness and reliability of an instrument to measure HRQoL in CHD but also on its agreement with instrument-specific values available for other health states modelled in the CUA. Furthermore, some decision-makers might argue that considering the previously discussed reasons for country- and centre-specific variability in HRQoL values, one should simply choose a single country-specific and CHD-form specific HRQoL value. However, in the case where multiple country-specific values exist or even a single such value is unavailable, the decision on the most robust value becomes more complex and needs to rely on an evidence-synthesis exercise Moreover, although distinguishing between underlying CHD-forms seems as more clinically relevant, CUAs in both primary and secondary prevention of CHD often model a general CHD health state [7174]. An evidence synthesis of all available HRQoL values may again be considered to select a robust HRQoL estimate in CHD. Such an estimate could then reflect more appropriately the complex nature of CHD and its various manifestations. This motivated us to consider an evidence-synthesis of HRQoL values in overall CHD.

Finally, characterizing the between study heterogeneity not only provides a better mean estimate for HRQoL values used in CUA but it also provides a better understanding on the uncertainty around the HRQoL value and how this translates into uncertainty around the CUA outcomes. This uncertainty, as we showed in our study, is considerable and as it is mostly found between studies, it is ignored when a single value from an individual study is selected. Dias et al. proposed that in the presence of between-study heterogeneity, using the predictive distribution is the appropriate way to characterize parameter uncertainty when embedding synthesized evidence in CUA [75]. Researchers using the findings from this study for economic evaluation purposes will therefore have to rely in generating values that incorporate both within- and between-study standard deviation (predictive distribution) provided in the results section of this article.


This study represents the first evidence synthesis of instrument-specific preference-based HRQoL values in post-ACS, stable angina, and CHD in general. Considerable differences in mean HRQoL estimates were observed both within and between the instruments. These differences characterized by large between-study heterogeneity may be explained by both the observed and unobserved methodological differences across instruments and underlying study-level characteristics. Current CUAs in CHD ignore this between-study study heterogeneity. Therefore, multivariate meta-analysis can facilitate quantifying this heterogeneity for HRQoL estimates and offer the means for uncertainty around HRQoL values to be translated to uncertainty in economic models.

Supporting Information

S2 Appendix. Search strategy for MEDLINE and EMBASE.


S1 Table. Correlation coefficients between the HRQoL values assessed with different instruments.


S2 Table. Between-study SDs and variance-covariance matrix in post-ACS model.


S3 Table. Between-study SDs and variance-covariance matrix in stable angina model.


S4 Table. Between-study SDs and variance-covariance matrix in CHD model.


S5 Table. Parameter estimates and multivariate heterogeneity statistics in the sensitivity analysis on different correlation coefficients between HRQoL instruments in CHD.


Author Contributions

Conceived and designed the experiments: JS PP MAK PFMK MJP. Performed the experiments: JS PP. Analyzed the data: JS PP MJP. Contributed reagents/materials/analysis tools: JS PP MJP. Wrote the paper: JS PP MAK PFMK MJP.


  1. 1. Garster NC, Palta M, Sweitzer NK, Kaplan RM, Fryback DG. Measuring health-related quality of life in population-based studies of coronary heart disease: comparing six generic indexes and a disease-specific proxy score. Quality of Life Research. 2009;(9):1239–1247. pmid:19760103
  2. 2. Kim J, Henderson RA, Pocock SJ, Clayton T, Sculpher MJ, Fox KAA. Health-related quality of life after interventional or conservative strategy in patients with unstable angina or non–ST-segment elevation myocardial infarction: one-year results of the third Randomized Intervention Trial of unstable Angina (RITA-3). J Am Coll Cardiol. 2005;(2):221–228. pmid:15653019
  3. 3. Norris CM, Spertus JA, Jensen L, Johnson J, Hegadoren KM, Ghali WA. Sex and gender discrepancies in health-related quality of life outcomes among patients with established coronary artery disease. Circulation: Cardiovascular Quality and Outcomes. 2008;(2):123–130.
  4. 4. Nowels D, McGloin J, Westfall JM, Holcomb S. Validation of the EQ-5D quality of life instrument in patients after myocardial infarction. Quality of life research. 2005;(1):95–105. pmid:15789944
  5. 5. World Health Organization. World Health Organization. Fact sheet No 310 'Top ten causes of death'. 2008; Available: Accessed 16 November 2012.
  6. 6. Drummond M. Introducing economic and quality of life measurements into clinical studies. Ann Med. 2001;(5):344–349. pmid:11491193
  7. 7. Drummond MF, Sculpher MJ, Torrance GW. Methods for the economic evaluation of health care programmes.: Oxford University Press, USA; 2005.
  8. 8. National Institute for Health and Care Excellence. Guide to the methods of technology appraisal 2013. 2013; Available: Accessed 08 October 2013.
  9. 9. Kiessling A, Zethraeus N, Henriksson P. Cost of lipid lowering in patients with coronary artery disease by case method learning. Int J Technol Assess Health Care. 2005;(02):180–186.
  10. 10. Kramer L, Hirsch O, Schlößler K, Träger S, Baum E, Donner-Banzhoff N. Associations between demographic, disease related, and treatment pathway related variables and health related quality of life in primary care patients with coronary heart disease. Health and quality of life outcomes. 2012;(1):1–10.
  11. 11. Ose D, Rochon J, Campbell SM, Wensing M, van Lieshout J, Uhlmann L, et al. Secondary prevention in patients with coronary heart diseases: what factors are associated with health status in usual primary care? PloS one. 2012;(12):e51726. pmid:23300560
  12. 12. Jackson D, Riley R, White IR. Multivariate meta‐analysis: Potential and promise. Stat Med. 2011;(20):2481–2498. pmid:21268052
  13. 13. Mavridis D, Salanti G. A practical introduction to multivariate meta-analysis. Stat Methods Med Res. 2012;.
  14. 14. Niedzwiedz CL, Katikireddi SV, Pell JP, Mitchell R. Socioeconomic inequalities in the quality of life of older Europeans in different welfare regimes. Eur J Public Health. 2014;(3):364–370. pmid:24568754
  15. 15. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to meta-analysis.: Wiley; 2011.
  16. 16. Sullivan PW, Ghushchyan V. Preference-based EQ-5D index scores for chronic conditions in the United States. Medical Decision Making. 2006;(4):410–420. pmid:16855129
  17. 17. Coffey JT, Brandle M, Zhou H, Marriott D, Burke R, Tabaei BP, et al. Valuing health-related quality of life in diabetes. Diabetes Care. 2002;(12):2238–2243. pmid:12453967
  18. 18. Jackson D, White IR, Riley RD. Quantifying the impact of between‐study heterogeneity in multivariate meta‐analyses. Stat Med. 2012;(29):3805–3820. pmid:22763950
  19. 19. CRAN project. Multivariate meta-analysis and meta-regression 0.3.1. Package ‘mvmeta’. 2012; Available: Accessed 16 November 2012.
  20. 20. R. The R foundation for statistical computing, Rversion 2.14.0. 2011.
  21. 21. Al‐Ruzzeh S, Epstein D, George S, Bustami M, Wray J, Ilsley C, et al. Economic Evaluation of Coronary Artery Bypass Grafting Surgery With and Without Cardiopulmonary Bypass: Cost‐Effectiveness and Quality‐Adjusted Life Years in a Randomized Controlled Trial. Artif Organs. 2008;(11):891–897. pmid:18959683
  22. 22. Ascione R, Reeves BC, Taylor FC, Seehra HK, Angelini GD. Beating heart against cardioplegic arrest studies (BHACAS 1 and 2): quality of life at mid-term follow-up in two randomised controlled trials. Eur Heart J. 2004;(9):765–770. pmid:15120887
  23. 23. BAKHAI A, FERRIERES J, IÑIGUEZ A, SARTRAL M, BELGER M, SCHMITT C, et al. Clinical Outcomes, Resource Use, and Costs at 1 Year in Patients with Acute Coronary Syndrome Undergoing PCI. J Interv Cardiol. 2012;.
  24. 24. Bøhmer E, Kristiansen IS, Arnesen H, Halvorsen S. Health and cost consequences of early versus late invasive strategy after thrombolysis for acute myocardial infarction. European Journal of Cardiovascular Prevention & Rehabilitation. 2011;(5):717–723.
  25. 25. Burström K, Johannesson M, Diderichsen F. Swedish population health-related quality of life results using the EQ-5D. Quality of Life Research. 2001;(7):621–635. pmid:11822795
  26. 26. Chong CAKY, Li S, Nguyen GC, Sutton A, Levy MH, Butler T, et al. Health-state utilities in a prisoner population: a cross-sectional survey. Health and quality of life outcomes. 2009;(Articl).
  27. 27. Cohen DJ, Van Hout B, Serruys PW, Mohr FW, Macaya C, Den Heijer P, et al. Quality of life after PCI with drug-eluting stents or coronary-artery bypass surgery. N Engl J Med. 2011;(11):1016–1026. pmid:21410370
  28. 28. Denvir M, Lee A, Rysdale J, Walker A, Eteiba H, Starkey I, et al. Influence of socioeconomic status on clinical outcomes and quality of life after percutaneous coronary intervention. J Epidemiol Community Health. 2006;(12):1085–1088. pmid:17108307
  29. 29. Dunning J, Waller JR, Smith B, Pitts S, Kendall SW, Khan K. Coronary artery bypass grafting is associated with excellent long-term survival and quality of life: a prospective cohort study. Ann Thorac Surg. 2008;(6):1988–1993. pmid:18498808
  30. 30. Ellis JJ, Eagle KA, Kline-Rogers EM, Erickson SR. Validation of the EQ‐5D in patients with a history of acute coronary syndrome*. Current Medical Research and Opinion. 2005;(8):1209–1216 pmid:16083530
  31. 31. Fryback DG, Dasbach EJ, Klein R, Klein BEK, Dorn N, Peterson K, et al. The Beaver Dam Health Outcomes study Initial Catalog of Health-state Quality Factors. Medical Decision Making. 1993;(2):89–102. pmid:8483408
  32. 32. Griffin S, Barber J, Manca A, Sculpher M, Thompson S, Buxton M, et al. Cost effectiveness of clinically appropriate decisions on alternative treatments for angina pectoris: prospective observational study. BMJ. 2007;(7594):624. pmid:17339236
  33. 33. Kattainen E, Sintonen H, Kettunen R, Merilainen P. Health-related quality of life of coronary artery bypass grafting and percutaneous transluminal coronary artery angioplasty patients: 1-year follow-up. Int J Technol Assess Health Care. 2005;(2):172–179. pmid:15921056
  34. 34. Lacey E, Walters S. Continuing inequality: gender and social class influences on self perceived health after a heart attack. J Epidemiol Community Health. 2003;(8):622–627. pmid:12883071
  35. 35. Lee HT, Shin J, Lim YH, Kim KS, Kim SG, Kim JH, et al. Health-Related Quality of Life in Coronary Heart Disease in Korea: The Korea National Health and Nutrition Examination Survey 2007 to 2011. Angiology. 2014.
  36. 36. Loponen P, Luther M, Korpilahti K, Wistbacka JO, Huhtala H, Laurikka J, et al. HRQoL after coronary artery bypass grafting and percutaneous coronary intervention for stable angina. Scandinavian Cardiovascular Journal. 2009;(2):94–99. pmid:18819033
  37. 37. Nichol G, Llewellyn-Thomas HA, Thiel EC, Naylor CD. The relationship between cardiac functional capacity and patients' symptom-specific utilities for angina: some findings and methodologic lessons. Med Decis Making. 1996;(1):78–85. pmid:8717602
  38. 38. Pettersen KI, Kvan E, Rollag A, Stavem K, Reikvam A. Health-related quality of life after myocardial infarction is associated with level of left ventricular ejection fraction. BMC cardiovascular disorders. 2008;(1):28.
  39. 39. Puskas JD, Williams WH, Mahoney EM, Huber PR, Block PC, Duke PG, et al. Off-pump vs conventional coronary artery bypass grafting: early and 1-year graft patency, cost, and quality-of-life outcomes. JAMA. 2004;(15):1841–1849. pmid:15100202
  40. 40. Saarni SI, Härkänen T, Sintonen H, Suvisaari J, Koskinen S, Aromaa A, et al. The impact of 29 chronic conditions on health-related quality of life: a general population survey in Finland using 15D and EQ-5D. Quality of Life Research. 2006;(8):1403–1414. pmid:16960751
  41. 41. Schweikert B, Hunger M, Meisinger C, Konig HH, Gapp O, Holle R. Quality of life several years after myocardial infarction: comparing the MONICA/KORA registry to the general population. Eur Heart J. 2009;(4):436–443. pmid:19019995
  42. 42. Schweikert B, Hahmann H, Steinacker JM, Imhof A, Muche R, Koenig W, et al. Intervention study shows outpatient cardiac rehabilitation to be economically at least as attractive as inpatient rehabilitation. Clinical research in cardiology. 2009;(12):787–795. pmid:19821135
  43. 43. Serruys PW, Unger F, Sousa JE, Jatene A, Bonnier HJRM, Schönberger JPAM, et al. Comparison of coronary-artery bypass surgery and stenting for the treatment of multivessel disease. N Engl J Med. 2001;(15):1117–1124. pmid:11297702
  44. 44. Shah P, Najafi AH, Panza JA, Cooper HA. Outcomes and quality of life in patients≥ 85 years of age with ST-elevation myocardial infarction. Am J Cardiol. 2009;(2):170–174. pmid:19121431
  45. 45. Sharples L, Hughes V, Crean A, Dyer M, Buxton M, Goldsmith K, et al. Cost-effectiveness of functional cardiac testing in the diagnosis and management of coronary artery disease: a randomised controlled trial. The CECaT trial.: Gray Pub. 2007.
  46. 46. Shrive FM, Ghali WA, Johnson JA, Donaldson C, Manns BJ. Use of the US and UK Scoring Algorithm for the EuroQol-5D in an Economic Evaluation of Cardiac Care. Med Care. 2007;(3):269–273. pmid:17304086
  47. 47. Stafford M, Soljak M, Pledge V, Mindell J. Socio-economic differences in the health-related quality of life impact of cardiovascular conditions. Eur J Public Health. 2012;(3):301–305. pmid:21398378
  48. 48. Tsevat J, Goldman L, Lamas GA, Pfeffer MA, Chapin CC, Connors KF, et al. Functional status versus utilities in survivors of myocardial infarction. Med Care. 1991;(11):1153–1159. pmid:1943274
  49. 49. Visser M, Fletcher A, Parr G, Simpson A, Bulpitt C. A comparison of three quality of life instruments in subjects with angina pectoris: the Sickness Impact Profile, the Nottingham Health Profile, and the Quality of Well Being Scale. J Clin Epidemiol. 1994;(2):157–163. pmid:8113824
  50. 50. Weintraub WS, Boden WE, Zhang Z, Kolm P, Zhang Z, Spertus JA, et al. Cost-Effectiveness of Percutaneous Coronary Intervention in Optimally Treated Stable Coronary PatientsCLINICAL PERSPECTIVE. Circulation: Cardiovascular Quality and Outcomes. 2008;(1):12–20.
  51. 51. Werdan K, Ebelt H, Nuding S, Höpfner F, Hack G, Müller-Werdan U. Ivabradine in combination with beta-blocker improves symptoms and quality of life in patients with stable angina pectoris: results from the ADDITIONS study. Clinical Research in Cardiology. 2012;1–9.
  52. 52. Winkelmayer WC, Benner JS, Glynn RJ, Schneeweiss S, Wang PS, Brookhart MA, et al. Assessing health state utilities in elderly patients at cardiovascular risk. Medical decision making. 2006;(3):247–254. pmid:16751323
  53. 53. Lalonde L, Clarke AE, Joseph L, Mackenzie T, Grover SA. Comparing the psychometric properties of preference-based and nonpreference-based health-related quality of life in coronary heart disease. Quality of Life Research. 1999;(5):399–409. pmid:10474281
  54. 54. Franks P, Hanmer J, Fryback DG. Relative disutilities of 47 risk factors and conditions assessed with seven preference-based health status measures in a national US sample: toward consistency in cost-effectiveness analyses. Med Care. 2006;(5):478–485. pmid:16641667
  55. 55. Honkalampi T, Sintonen H. Do the 15D scores and time trade-off (TTO) values of hospital patients' own health agree? Int J Technol Assess Health Care. 2010;(01):117–123.
  56. 56. Moock J, Kohlmann T. Comparing preference-based quality-of-life measures: results from rehabilitation patients with musculoskeletal, cardiovascular, or psychosomatic disorders. Quality of Life Research. 2008;(3):485–495. pmid:18288590
  57. 57. Bosch JL, Hunink MM. Comparison of the Health Utilities Index Mark 3 (HUI3) and the EuroQol EQ-5D in patients treated for intermittent claudication. Quality of Life Research. 2000;(6):591–601. pmid:11236850
  58. 58. Johnson JA, Luo N, Shaw JW, Kind P, Coons SJ. Valuations of EQ-5D health states: are the United States and United Kingdom different? Med Care. 2005;(3):221–228. pmid:15725978
  59. 59. Havranek EP, Steiner JF. Valuation of health states in the US versus the UK: two measures divided by a common language? Med Care. 2005;(3):201–202. pmid:15725976
  60. 60. Emery CF, Frid DJ, Engebretson TO, Alonzo AA, Fish A, Ferketich AK, et al. Gender differences in quality of life among cardiac patients. Psychosom Med. 2004;(2):190–197. pmid:15039503
  61. 61. Xie J, Wu EQ, Zheng ZJ, Sullivan PW, Zhan L, Labarthe DR. Patient-reported health status in coronary heart disease in the United States: age, sex, racial, and ethnic differences. Circulation. 2008;(5):491–497. pmid:18625894
  62. 62. Van Stel HF, Buskens E. Comparison of the SF-6D and the EQ-5D in patients with coronary heart disease. Health Qual Life Outcomes. 2006;20.
  63. 63. O'Brien BJ, Spath M, Blackhouse G, Severens J, Dorian P, Brazier J. A view from the bridge: agreement between the SF‐6D utility algorithm and the Health Utilities Index. Health Econ. 2003;(11):975–981. pmid:14601159
  64. 64. Brazier J, Roberts J, Tsuchiya A, Busschbach J. A comparison of the EQ‐5D and SF‐6D across seven patient groups. Health Econ. 2004;(9):873–884. pmid:15362179
  65. 65. Fryback DG, Dunham NC, Palta M, Hanmer J, Buechner J, Cherepanov D, et al. US norms for six generic health-related quality-of-life indexes from the National Health Measurement study. Med Care. 2007;(12):1162–1170. pmid:18007166
  66. 66. Bleichrodt H. A new explanation for the difference between time trade‐off utilities and standard gamble utilities. Health Econ. 2002;(5):447–456. pmid:12112493
  67. 67. Bleichrodt H, Johannesson M. Standard gamble, time trade-off and rating scale: experimental results on the ranking properties of QALYs. J Health Econ. 1997;(2):155–175. pmid:10169092
  68. 68. Kinney MR, Burfitt SN, Stullenbarger E, Rees B, DeBolt MR. Quality of life in cardiac patient research: a meta-analysis. Nurs Res. 1996;(3):173–180. pmid:8637799
  69. 69. Dyer MTD, Goldsmith KA, Sharples LS, Buxton MJ. A review of health utilities using the EQ-5D in studies of cardiovascular disease. Health and Quality of Life Outcomes 2010 8:13 pmid:20109189
  70. 70. Pinquart M, Sörensen S. Influences of socioeconomic status, social network, and competence on subjective well-being in later life: a meta-analysis. Psychol Aging. 2000;(2):187. pmid:10879576
  71. 71. Gillespie P, O'Shea E, Murphy AW, Byrne MC, Byrne M, Smith SM, et al. The cost-effectiveness of the SPHERE intervention for the secondary prevention of coronary heart disease. Int J Technol Assess Health Care. 2010;(03):263–271.
  72. 72. Pignone M, Earnshaw S, Tice JA, Pletcher MJ. Aspirin, statins, or both drugs for the primary prevention of coronary heart disease events in men: a cost–utility analysis. Ann Intern Med. 2006;(5):326–336.
  73. 73. Pletcher MJ, Lazar L, Bibbins-Domingo K, Moran A, Rodondi N, Coxson P, et al. Comparing impact and cost-effectiveness of primary prevention strategies for lipid-lowering. Ann Intern Med. 2009;(4):243–254. pmid:19221376
  74. 74. Greving J, Visseren F, de Wit G, Algra A. Statin treatment for primary prevention of vascular disease: whom to treat? Cost-effectiveness analysis. BMJ. 2011.
  75. 75. Dias S, Welton NJ, Sutton AJ, Ades AE. Evidence synthesis for decision making 5: the baseline natural history model. Med Decis Making. 2013;(5):657–670. pmid:23804509