The Health Care Empowerment Model offers direction for the investigation of patient-controlled engagement and involvement in health care. At the core of the model is the construct of Health Care Empowerment (HCE), for which there exist no validated measures. A set of 27 candidate self-report survey items was constructed to capture five hypothesized inter-related facets of HCE (informed, engaged, committed, collaborative, and tolerant of uncertainty). The full item set was administered to 644 HIV-infected persons enrolled in three ongoing research studies. Exploratory and confirmatory factor analyses resulted in a two factor solution comprising four items each on two subscales: (1) HCE: Informed, Committed, Collaborative, and Engaged HCE ICCE) and (2) HCE Tolerance of Uncertainty (HCE TU). Subscale scores were evaluated for relationships with relevant constructs measured in the three studies, including depression, provider relationships, medication adherence, and HIV-1 viral load. Findings suggest the utility of this 8-item Health Care Empowerment Inventory (HCEI) in efforts to measure, understand, and track changes in the ways in which individuals engage in health care.
Citation: Johnson MO, Rose CD, Dilworth SE, Neilands TB (2012) Advances in the Conceptualization and Measurement of Health Care Empowerment: Development and Validation of the Health Care Empowerment Inventory. PLoS ONE 7(9): e45692. https://doi.org/10.1371/journal.pone.0045692
Editor: Hamid Reza Baradaran, Tehran University of Medical Sciences, Islamic Republic of Iran
Received: June 21, 2012; Accepted: August 21, 2012; Published: September 19, 2012
Copyright: © Johnson et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This publication was supported by National Institutes of Health (NIH) grant numbers R01MH0790700, K24MH087220, R01NR011087, RC1DA028224 and UL1RR024131. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the NIH. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The construct of Health Care Empowerment (HCE) emerged out of a need for a broader conceptualization of engagement in medical treatment that encompasses multiple facets of participation in health care . Specifically, HCE is defined as the process and state of being 1) engaged, 2) informed, 3) collaborative, 4) committed to one’s health care and 5) tolerant or resilient to uncertainties in treatment outcomes. The HCE construct is housed within the larger HCE model, which is informed by multiple theoretical frameworks, including Social Action Theory, Stress and Coping Theory, Social Problem Solving Theory, and multiple derivations of the Health Belief Model , , . The HCE Model frames a dynamic interplay of contextual factors (e.g., stigma, age, gender), personal resources (e.g., insurance, implicit beliefs about treatment, problem-solving and communication skills), and intrapersonal processes (e.g., depression, anxiety, positive affect, hope) which determine the level of HCE in an individual facing ongoing medical treatment. Because the HCE Model includes a range of hypothesized influences on engagement in medical care, there is potential for studies using an HCE framework to advance our understanding of the drivers of health disparities in such areas as cardiovascular disease, diabetes, and HIV. Consequently, the HCE Model has the potential to inform interventions to mitigate such disparate outcomes in disease incidence and related morbidity and mortality. While there are other constructs and measures in the literature that shed light on factors that may impact engagement in medical care, such as the Patient Activation Measure , the newly developed Model of Health Care Empowerment is unique in its focus on multiple, inter-related dimensions of engagement in care that are derived from the patient perspective.
A primary obstacle to further exploration of HCE is a lack of psychometrically sound measures of the construct. There is preliminary evidence that a self-report measure of HCE can shed light on individuals’ health-related beliefs and behaviors , but until a strong measurement approach is developed, further work in this area will be limited. We sought to develop a measure of HCE that is aligned with the conceptual framework of the HCE Model. The HCE Model and the newly developed measure were constructed to be applicable across health care contexts, in which complicated psychosocial and environmental factors can impact engagement and outcomes of medical care. In this paper, we describe the development and preliminary validation of a self-report measure of the HCE construct. The development process of the HCE measure was situated within the context of treatment for HIV infection, a setting in which timely and active engagement in care are critical to optimize survival and minimize morbidity.
Active engagement in clinical care and high levels of adherence to antiretroviral treatment (ART) are essential for those with HIV to live longer, healthier lives. As few as 19% of HIV-infected persons in the US have an undetectable viral load.  The cascade of missed opportunities for treatment begin with lack of HIV testing and move to lack of linkage to care, retention in care, initiation and adherence to ART. Giordano and colleagues documented that inconsistent engagement and retention in care (as measured by appointment-keeping over time) was associated with death among a large cohort of HIV+ adults . Further, effective ART regimens promote viral suppression, which reduces the chances of HIV transmission to sex partners, and minimizes the emergence of drug-resistant virus. Adherence to ART is difficult due to factors such as the complexity of the regimens, side effects, HIV-related stigma, and competing priorities and demands , making HIV treatment a rich setting for the development and evaluation of a new measure of Health Care Empowerment.
The purposes of the current paper are to (a) describe the development of the Health Care Empowerment Inventory (HCEI), a brief, self-report measure of HCE and (b) present evidence of the HCEI’s relationship to variables that are hypothesized correlates as suggested by the HCE Model.
Development of Survey Items
The authors began by generating multiple items to assess each of the descriptors of HCE: engaged, informed, committed, collaborative, and tolerant of uncertainty. Initially, 8–9 items for each descriptor were written for a total of 42 items. A commonly-used 5-level Likert response format was selected in which choices ranged from Strongly Disagree to Strongly Agree. Upon review and feedback from colleagues and experienced research interviewers, items were eliminated for redundancy, lack of clarity, or misalignment with the target construct. Wording on the remaining items was refined to optimize readability. The resulting 27-item set was included in ongoing studies of HIV-infected persons, as described below.
A convenience sample of HIV-infected adults 18 years old or older enrolled in one of three research studies was used for the scale development activities. Sample 1 (N = 275) includes data from a longitudinal cohort study of HIV-infected adult men who are in primary relationships with other men (HIV-negative or HIV-positive) collected between January 2009 and April 2012. Sample 2 (N = 370) includes combined cross-sectional data from two research studies of similar samples of HIV-infected adult men and women in the San Francisco Bay Area collected between August 2008 and April 2012. Participants were recruited from community settings through advertisements, flyers, word of mouth referral, and clinic outreach. Data are included from a single time-point in each of the studies (Total N = 645).
Recruitment for the studies included outreach to clinics and agencies, and posting of advertisements and flyers in the San Francisco Bay Area. HIV-positive serostatus (presence of HIV antibodies, indicating HIV infection) was verified by HIV antibody testing or provision of documentation by potential participants, and ART regimens were verified by examination of prescribed medication vials or official medication lists from the dispensing pharmacy. Participants provided written informed consent and all procedures were approved by the Committee on Human Research at the University of California, San Francisco. Combinations of interviewer-administered, Audio Computer-Assisted Self-Interviewing (ACASI) and Computer-Assisted Personal Interviewing (CAPI) were used to optimize self-report, to minimize data collection errors, and to facilitate efficient data management.  The HCE items were self-administered in all three studies. Screening, data collection, and phlebotomy procedures occurred in private areas of research facilities or clinics, and all participants were compensated for their involvement.
The following measures were administered to the participants in the three studies.
Health care empowerment.
The 27-item version of the HCE measure, as described above was administered to each study participant.
Hypothesized Correlates of HCE
To perform convergent validity analysis, we included the following measures:
Adherence self-efficacy, or confidence in one’s ability to comply with a treatment plan, has been consistently linked to medication adherence over time. ,  The HIV-ASES scale assesses patient confidence in carrying out health-related behaviors (e.g., asking physician questions, keeping appointments, adhering to medication).  This measure includes 2 subscales: Integration and Perseverance; α = .92 and 76 respectively.
Opportunity for shared decision-making.
The 3-item Decision-Making Opportunity Scale (DMO)  assesses how often a provider (a) discusses pros and cons of each medical care choice; (b) elicits statements of patient preference; and (c) takes patient preference into account when making treatment decisions (α = .62). Higher scores indicate a patient’s perception of greater opportunity for involvement as enabled by the provider.
Personal knowledge by provider.
A single item: “My provider really knows me as a person.” In previous work, higher agreement with this statement was linked to greater ART uptake and adherence .
The Center for Epidemiologic Studies Depression Scale (CES-D)  was administered to measure depressed mood in the past week. The CES-D consists of 20 items rated on a 4-point scale of symptom frequency during the previous week (α = .92).
Hypothesized Outcomes of HCE
Although the current analyses were restricted to cross-sectional data, we explored associations with variables that are hypothesized consequences of HCE with the recognition that causality cannot be evaluated with the current study data.
ART medication adherence.
Adherence to antiretroviral medications was assessed using 2 well-validated measures of self-report. The adherence measure developed to assess adherence in the AIDS Clinical Trials Group (ACTG)  solicits detailed information about self-reported adherence over the prior 3 days. Adherence scores on this scale have been correlated with viral load. ,  Second, a visual analog scale (VAS) was administered,  which assesses 30-day adherence reporting separately for each drug along a continuum anchored by “0%” to “100%.” This measure has shown to be correlated with other adherence measures such as electronic medication monitors. ,  The 3-day adherence measure was dichotomized as 100% vs. <100% adherence and the 30-day VAS adherence is reported as a continuous variable. For both adherence measures, if a respondent was not taking ART but had a CD4 value less than 500, adherence was set to zero as current guidelines indicate that the person should be on ART .
CD4+ cell count and viral load.
HIV viral load was determined using the COBAS® AmpliPrep/COBAS® TaqMan® HIV test kit (Roche Molecular Systems, Inc.), which has a threshold for undetectability ≤20 copies/mL. A detectable viral load indicates incomplete viral suppression, or inadequately controlled HIV infection, and the higher the viral load (transformed to log10 for analysis purposes) the more virus present in the blood with higher numbers indicating poorly controlled HIV. CD4+ cell count provides a gauge of immune functioning, with lower counts typically indicating longer infection and/or greater immune system deterioration. In healthy persons, the normal range of CD4+ cell count is 500–1500 cells per cubic millimeter of blood, and current HIV treatment guidelines recommend ART for all HIV-seropositive persons with CD4+ cell count below 500.  For participants in one of the three studies, laboratory assay data were not available. For that subset of respondents (n = 198), we used self-reported CD4 data, which has been shown to be reliable when compared to medical record abstracted data .
One-way frequency tables were generated to characterize the samples of both studies. Study 1 data were subjected to exploratory factor analysis (EFA) using the WLSMV estimator with geomin rotation in Mplus 6. The number of factors chosen was based on Cattell’s scree plot, parsimony, and the Mplus global model fit indices described below . Following exploratory factor analysis of the original 27-item preliminary HCE item set, a reduced number of items were chosen to comprise a brief health care empowerment inventory suitable for use in time-limited settings. This reduced inventory was then subjected to confirmatory factor analysis using Mplus to assess global model fit of the new inventory . Factor variances were set at unity to set the scale of the latent factors. Satisfactory global factor analysis model fit was determined by two of the following three approximate model fit criteria being met: Bentler’s Comparative Fit Index (CFI) greater than or equal to.95, the root mean square error of approximation (RMSEA) being less than or equal to.06, and the standardized mean square residual (SRMR) being less than.08 in EFA or the weighted root mean square residual being less than 1.00 in CFA , . Internal reliability for each subscale in the new HCE instrument was generated using Raykov’s ρ, which is conceptually similar to Cronbach’s coefficient alpha, but relaxes the often unrealistic assumption of equal factor loadings. Confidence intervals for ρ were computed via a logit transformation . Validity and reliability analyses for Sample 2 mirrored those for Study 1, except that validity analyses began with confirmatory factor analyses of the factor-item structure derived in Sample 1.
To assess convergent and divergent validity, Sample 1 and Sample 2 data were pooled and correlations of HCE subscales with available measures of clinical status (e.g., HIV RNA viral load, CD4 T-cell counts) and related behavioral measures (e.g., self-reported self-efficacy for maintaining adherence to antiretroviral medications) were computed with 95% confidence intervals in Stata 12. For multi-category nominal-level correlates (race/ethnicity and education) means of the HCE subscales were compared across groups. To evaluate whether the reduced item subset of the new HCE scale explained a sufficiently substantial proportion of the variance of all items, the sum of all items was regressed onto the new subscales. Due to the clustered dyadic data in Study 1, all confidence intervals and inferences were based on robust Huber-White standard errors that properly account for nesting of individuals within dyads.
Characteristics of the sample are provided in Table 1. Sample 1 participants were older and comprised of a lower proportion of African Americans, reported higher levels of education and antiretroviral therapy use, were more likely to be employed, and were less likely to report recent injection drug use. Due to differences in study eligibility criteria, Sample 2 participants included more women, and were more likely to have lower CD4+ cell counts and detectable viral loads.
Sample 1 Validity and Reliability Analyses
The scree plot suggested the presence of two common factors with eigenvalues of 14.12 and 2.46, respectively, in the EFA analysis, which accounted for 61% of the shared variance among the 27 items. All remaining eigenvalues were less than 1.22. As well, global factor analysis model fit statistics indicated satisfactory approximate model-data fit with the two-factor solution: χ2(298) = 706.79, p<.0001; RMSEA = .07; CFI = .97, and SRMR = .05. Examination of the factor loadings suggested that the first factor was composed of items tapping into the dimensions of being informed, committed, collaborative, and engaged (HCE ICCE). By contrast, the second factor was composed of items measuring tolerance for uncertainty (HCE TU). The two factors were correlated at r = .39.
One item each was selected to represent being informed, committed, collaborative, and engaged in an HCE ICCE subscale, whereas four items from the tolerance for uncertainty factor were chosen to represent the HCE TU subscale (Table 2). To assess global model fit of these items to the data, a confirmatory factor analysis was fitted and demonstrated satisfactory approximate model-data fit: χ2(19) = 74.15, p<.0001; RMSEA = .10; CFI = .96, and WRMR = .97. The factors were correlated at r = .42 in the CFA solution. Internal reliability for HCE ICCE (ρ = .78; 95% CI = .73,.83) and HCE TU (ρ = .86; 95% CI = .82,.89) were both within acceptable ranges, suggesting strong internal consistency reliability.
Sample 2 Validity and Reliability Analyses
To fully validate the factor structure generated in Sample 1, it was necessary to fit the final CFA factor structure from Study 1 to a new study’s data, those of Sample 2. A CFA testing the newly-created HCE scale’s factor structure to Study 2′s data demonstrated satisfactory approximate model-data fit: χ2(19) = 115.66, p<.0001; RMSEA = .12; CFI = .98, and WRMR = .90. The two factors were correlated at r = .76 in this study. Internal reliability for HCE ICCE (ρ = .87; 95% CI = .84,.90) and HCE TU (ρ = .90; 95% CI = .88,.92) were also within acceptable ranges, suggesting strong internal consistency reliability.
Sample 1 and Sample 2 Convergent and Divergent Validity Analyses
The two new HCE subscales accounted for 93% of the variance in the original set of 27 items. Appendix S1 lists the item set for the newly-derived brief measure. Convergent validity analyses showed that HCE ICCE was positively associated with the patient’s perception that the provider knows them as a person, CD4+ cell count, higher ART adherence, adherence self-efficacy, and perceived opportunities for shared decision-making. HCE ICCE was negatively associated with HIV viral load and depressive symptoms (Table 3). HCE TU was positively associated with age, patient perception that the provider knows them as a person, CD4+ cell count, ART adherence, adherence self-efficacy, length of time since HIV diagnosis, and perceived opportunities for shared decision-making. HCE Tolerance was negatively associated with full time employment status and viral load (Table 3). Women reported higher HCE TU than men, and individuals with higher levels of education tended to have higher HCE ICCE scores. Latino participants had a lower mean level of HCE TU than Black and “Other” race/ethnicity participants and participants who were fully employed reported significantly lower mean levels of HCE TU than unemployed participants. Persons on ART reported significantly higher mean levels of both HCE ICCE and HCE TU (Table 3).
The results of the factor analyses and convergent validity analysis suggest that a two-factor structure of HCE fit the data well in the two research samples, and that health care empowerment can be measured with a parsimonious 8-item inventory, comprised of two 4-item subscales, that is suitable for use in time-limited settings. As predicted by the HCE Model, scores on the HCE Inventory (HCEI) were linked in expected directions to depression, provider relationships, treatment adherence, and indicators of clinical status such as CD4 and viral load. The inventory is brief and can be administered in clinical or other community settings and may alert providers to potential suboptimal engagement in care. Because responses were associated with medication adherence, the HCEI may provide an informative signal of adherence problems in contexts where full evaluation of treatment adherence may not be feasible or settings in which nonadherence may be under-reported due to strong social desirability pressures. Scores on both subscales of the HCEI were negatively associated with HIV-1 viral load, suggesting that the higher one’s perception of HCE, the more likely one will have a low or undetectable viral load (i.e. successful treatment and virologic control). Upon future investigation, it may be that HCE scores early in treatment may be a predictive indicator of subsequent poor engagement in care (i.e., failure to attend clinic visits and suboptimal uptake, adherence and persistence with treatment) leading to virologic failure (poor suppression of HIV-1 replication) and higher morbidity and mortality.
Development and initial validation of the HCEI took place within the context of treatment for HIV, but the scale was designed to be applicable across populations and illness contexts. The larger HCE Model accommodates a wide range of illness- and population-specific variables such as disease-related stigma and treatment-specific beliefs. It will be important to establish reliability and validity of the HCEI in other disease contexts in which active engagement in treatment is critical, such as diabetes, cancer, and cardiovascular disease.
There is some indication that empowered patients may be perceived as difficult or demanding by providers . As a result, some patients may temper their assertions in clinical encounters by stifling questions or withholding requests for medical tests, additional opinions, or the pursuit of alternative treatment approaches. The availability of a measure of empowerment in health care allows future investigations into the differential and overlapping roles of patients and providers in establishing health care empowerment. Specifically, the HCEI allows investigation of provider perspectives, reactions, and interactions with patients possessing varying levels of empowerment. Likewise, the HCEI allows investigation of engagement in care across cultures, generations, and genders, where there may be considerable variability in the normative power differentials between patients and providers.
As with any study employing secondary data analysis, findings should be generalized with caution. The studies used convenience samples from one geographic area and relied primarily on self-reported measures such as medication adherence. Data are cross-sectional and thus cannot be used to determine causality and we are not able to evaluate the predictive value of HCEI scores over time. The relatively modest sample sizes and limited variability of gender, age, race, and ethnicity preclude specific analysis of subgroups and findings should thus be considered preliminary. It is also possible that HCEI scores are subject to social desirability reporting biases, which were not assessed in the samples. In spite of these limitations, the resulting brief measure of health care empowerment shows strong psychometric properties, and preliminary validation evidence offers highly promising opportunities for use of the measure in clinical and research settings.
Future work is needed to examine longitudinal patterns of HCEI scores and predictive associations with treatment-seeking, treatment adherence and persistence, and clinical outcomes. Among such outcomes are health-related quality of life, functional impairment, satisfaction with care, and indicators of disease outcomes including morbidity and mortality. The availability of a psychometrically sound measure offers opportunity to investigate potential empowerment-related drivers of disparities in health-related outcomes that exist across populations. Future work is needed to evaluate test-retest reliability of the measure and to identify HCE Model hypothesized determinants and consequences of HCEI scores through associations with other constructs such as personality factors, socioeconomic status, and positive affect over time. Finally, the HCEI provides a device to capture changes in response to interventions designed to increase patient empowerment in health care. In summary, the HCEI offers a useful tool that has the potential to serve as a research and clinical indicator of level of treatment engagement among people living with HIV and other chronic health conditions that require active participation in health care.
Conceived and designed the experiments: MOJ. Performed the experiments: MOJ CDR. Analyzed the data: TBN SED. Contributed reagents/materials/analysis tools: MOJ CDR. Wrote the paper: MOJ CDR SED TBN.
- 1. Johnson MO (2011) The shifting landscape of health care: toward a model of health care empowerment. Am J Public Health 101: 265–270.
- 2. D'Zurilla TJ, Goldfried MR (1971) Problem solving and behavior modification. Journal of Abnormal Psychology 78: 107–126.
- 3. Lazarus RS, Folkman S (1984) Stress, appraisal, and coping. New York: Springer Pub. Co. xiii, 445 p.
- 4. Ewart CK (2004) How integrative behavioral theory can improve health promotion and disease prevention. In: Boll TJ, editor. Handbook of Clinical Health Psychology. Washington, D.C.: American Psychological Association. 249–289.
- 5. Hibbard JH, Stockard J, Mahoney ER, Tusler M (2004) Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res 39: 1005–1026.
- 6. Johnson MO, Sevelius JM, Dilworth SE, Saberi P, Neilands TB (2012) Preliminary support for the construct of health care empowerment in the context of treatment for human immunodeficiency virus. Patient Prefer Adherence 6: 395–404.
- 7. Gardner EM, McLees MP, Steiner JF, Del Rio C, Burman WJ (2011) The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis 52: 793–800.
- 8. Giordano TP, Gifford AL, White AC Jr, Suarez-Almazor ME, Rabeneck L, et al. (2007) Retention in care: a challenge to survival with HIV infection. Clin Infect Dis 44: 1493–1499.
- 9. Johnson MO, Catz SL, Remien RH, Rotheram-Borus MJ, Morin SF, et al. (2003) Theory guided, empirically supported avenues for intervention on HIV medication nonadherence: Findings from the Healthy Living Project. AIDS Patient Care STDS 17: 645–656.
- 10. Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, et al. (1998) Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science 280: 867–873.
- 11. Sevelius JM, Carrico A, Johnson MO (2010) Antiretroviral therapy adherence among transgender women living with HIV. J Assoc Nurses AIDS Care 21: 256–264.
- 12. Johnson MO, Neilands TB, Dilworth S, Morin SF, Remien RH, et al. (2007) The Role of Self-Efficacy in HIV Treatment Adherence: Validation of the HIV Treatment Adherence Self-Efficacy Scale (HIV-ASES). Journal of Behavioral Medicine 30: 359–370.
- 13. Harvey RM, Kazis L, Lee AF (1999) Decision-making preference and opportunity in VA ambulatory care patients: association with patient satisfaction. Res Nurs Health 22: 39–48.
- 14. Beach MC, Duggan PS, Moore RD (2007) Is patients’ preferred involvement in health decisions related to outcomes for patients with HIV? J Gen Intern Med 22: 1119–1124.
- 15. Radloff LS (1977) The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement 1: 385–401.
- 16. Chesney MA, Ickovics JR, Chambers DB, Gifford AL, Neidig J, et al. (2000) Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG). AIDS Care 12: 255–266.
- 17. Chesney MA, Ickovics J. Adherence to combination therapy in AIDS clinical trials.; 1997; Washington, D.C.
- 18. Walsh JC, Pozniak AL, Nelson MR, Mandalia S, Gazzard BG (2002) Virologic rebound on HAART in the context of low treatment adherence is associated with a low prevalence of antiretroviral drug resistance. Journal of Acquired Immune Deficiency Syndromes 30: 278–287.
- 19. Walsh JC, Mandalia S, Gazzard BG (2002) Responses to a 1 month self-report on adherence to antiretroviral therapy are consistent with electronic data and virological treatment outcome. Aids 16: 269–277.
- 20. Oyugi JH, Byakika-Tusiime J, Charlebois ED, Kityo C, Mugerwa R, et al. (2004) Multiple Validated Measures of Adherence Indicate High Levels of Adherence to Generic HIV Antiretroviral Therapy in a Resource-Limited Setting. Journal of Acquired Immune Deficiency Syndromes 36: 1100–1102.
- 21. DHHS (2011) Guidelines for the use of antiretroviral agents in HIV-infected adults and adolescents. Department of Health and Human Services and the Henry J. Kaiser Family Foundation.
- 22. Kalichman SC, Rompa D, Cage M (2000) Reliability and validity of self-reported CD4 lymphocyte count and viral load test results in people living with HIV/AIDS. International Journal of STD & AIDS 11: 579–585.
- 23. McDonald RP (1985) Factor Analysis and Related Methods. Hillsdale, New Jersey: Lawrence Erlbaum and Associates.
- 24. Gerbing DW, Hamilton JG (1996) Viability of exploratory factor analysis as a precursor to confirmatory factor analysis. Structural Equation Modeling 3: 62–72.
- 25. Hu L-t, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 6: 1–55.
- 26. Yu CY (2002) Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. [Doctoral Dissertation]. Los Angles, CA: University of California, Los Angeles.
- 27. Raykov T, Marcoulides GA (2011) Introduction to Psychometric Theory. New York: Routledge.
- 28. Frosch DL, May SG, Rendle KAS, Tietbohl C, Elwyn G (2012) Authoritarian Physicians and Patients’ Fear of Being Labeled “Difficult” Among Key Obstacles to Shared Decision Making. Health Affairs 31: 1030–1038.