Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Self-efficacy measurement instruments for individuals with coronary artery disease: A systematic review

  • José Alexandre Barbosa de Almeida ,

    Contributed equally to this work with: José Alexandre Barbosa de Almeida, Karolinne Souza Monteiro, Lucien Peroni Gualdi

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft

    Current address: Rehabilitation Sciences Graduate Program, Federal University of Rio Grande do Norte, Santa Cruz, RN, Brazil

    Affiliation Rehabilitation Sciences Graduate Program, Federal University of Rio Grande do Norte, Santa Cruz, RN, Brazil

  • Rêncio Bento Florêncio ,

    Roles Data curation, Formal analysis, Methodology, Writing – review & editing

    ‡ RBF and JCL also contributed equally to this work.

    Affiliation Professor of department of Physical Therapy Graduate, Centro Universitário Natalense, Natal, RN, Brazil

  • Jéssica Costa Leite ,

    Roles Data curation, Formal analysis, Methodology, Writing – review & editing

    ‡ RBF and JCL also contributed equally to this work.

    Affiliation Professor of department of Physical Therapy Graduate, Centro Universitário UNIFACISA, Campina Grande, PB, Brazil

  • Karolinne Souza Monteiro ,

    Contributed equally to this work with: José Alexandre Barbosa de Almeida, Karolinne Souza Monteiro, Lucien Peroni Gualdi

    Roles Data curation, Formal analysis, Methodology, Project administration, Supervision, Visualization, Writing – review & editing

    Current address: Rehabilitation Sciences Graduate Program, Federal University of Rio Grande do Norte, Santa Cruz, RN, Brazil

    Affiliation Professor of department of Physical Therapy and Rehabilitation Sciences Graduate Program, Federal University of Rio Grande do Norte, Santa Cruz, RN, Brazil

  • Lucien Peroni Gualdi

    Contributed equally to this work with: José Alexandre Barbosa de Almeida, Karolinne Souza Monteiro, Lucien Peroni Gualdi

    Roles Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing

    lucien.gualdi@ufrn.br

    Current address: Rehabilitation Sciences Graduate Program, Federal University of Rio Grande do Norte, Santa Cruz, RN, Brazil

    Affiliation Professor of department of Physical Therapy and Rehabilitation Sciences Graduate Program, Federal University of Rio Grande do Norte, Santa Cruz, RN, Brazil

Abstract

Introduction

Over the past decade, there has been a heightened interest in evaluating self-efficacy among patients with coronary artery disease (CAD). A significant number of instruments have been developed and validated, yet the need remains to assess the quality of their studies and their properties.

Objectives

To evaluate the measurement properties and link the content extracted from self-efficacy instrument items for individuals with CAD to the International Classification of Functioning, Disability, and Health (ICF).

Methodology

The study was conducted following the Cochrane systematic review guidelines and COnsensus norms for Selection of health Measuring INstruments (COSMIN), registered under CRD42021262613. The search was carried out on MEDLINE (Ovid), Web of Science, EMBASE, and PsycINFO, including studies involving the development and validation of self-efficacy instruments for individuals with CAD, without language or date restrictions. Data extraction was performed in May 2022 and updated in January 2023 and all the steps of this review were carried out by two different collaborators and reviewed by a third when there were divergences. Modified Grading of Recommendations, Assessment, Development and Evaluation (GRADE) recommended by COSMIN was used to determine the quality of evidence as high, moderate, low, or very low. Instrument categorization was carried out per COSMIN recommendations, according to the construct of interest and study population into three categories (A, B, or C).

Results

A total of 21 studies from 12 instruments were identified. The best-rated instruments received a recommendation of B, which means, additional validation studies are needed. Barnason Efficacy Expectation Scale (BEES) showed high-quality evidence for structural, construct, criterion, and internal consistency validity; Cardiac Self-Efficacy Scale (CSES) demonstrated high quality for content, structural, cross-cultural validity, and internal consistency; Self-efficacy for Appropriate Medication Use (SEAMS) achieved a high level for structural, criterion, and internal consistency validity; Cardiovascular Management Self-Efficacy Scale exhibited high-level validity for structural, criterion, construct, and internal consistency. The CSES showed content linkage with all domains of the ICF, as well as the highest number of linkages with the categories.

Conclusions

Instruments with a B-level recommendation hold potential for use. More studies assessing measurement properties are needed to reinforce or improve these recommendations. The CSES stands out as the most comprehensive instrument concerning the ICF.

Introduction

Self-efficacy is related to the individuals’ confidence in their ability to gather cognitive, motivational, emotional, and behavioral resources necessary to achieve a goal, deal with a specific situation, or perform a task [1]. It also encompasses elements of motivation, planning, organization, and awareness of skills necessary for dealing with illnesses, reflecting a sense of self-responsibility throughout pathological processes [1, 2]. Consequently, it becomes a crucial factor for health promotion and management of chronic conditions such as coronary artery disease (CAD) [13]. Moreover, it is linked to improved quality of life, mental well-being, and enhanced adherence to rehabilitation processes [4, 5].

Several general self-efficacy measurement instruments, whether or not related to specific disease conditions [6], assess specific individual conditions or behaviors associated with or without diseases (e.g., eating behavior, physical activity, and medication adherence) [79], or evaluate individuals in relation to their diseases (e.g., asthma, stroke, and coronary artery disease (CAD) [1013]), are available in the literature. While these instruments are well-established, there is a need to assess their methodological rigor to guide the selection of the most suitable instrument for clinical practice and cardiovascular rehabilitation, considering their quality.

CAD remains one of the leading causes of mortality and morbidity worldwide [14]. It is estimated that by 2030, the current prevalence rate of 1,655 per 100,000 population will exceed 1,845 [14]. It is characterized by the onset of symptoms such as chest pain, dyspnea, and a sensation of pressure or tightness at varying levels of exertion. Conventional treatment involves the individual’s adherence to cardiovascular rehabilitation programs and lifestyle changes, aimed at delaying and preventing future complications, as well as improving physical fitness through resistance and aerobic training [15].

Since the level of self-efficacy can influence adherence to rehabilitation [16], it becomes necessary to have instruments that assess self-efficacy within this population, aiming to enhance treatment and rehabilitation programs adherence [13]. In this context, evaluating self-efficacy instruments for individuals with CAD may contribute to understanding the available tools for clinical practice and research, as well as assisting healthcare professionals in individual interventions.

Therefore, this systematic review aims to evaluate the clinimetric properties of self-efficacy instrument items for people with CAD and to relate their content to the International Classification of Functioning, Disability and Health (ICF) [17].

Materials and methods

The systematic review was conducted following the Cochrane systematic review guidelines [18] and the COnsensus norms for Selection of health Measuring INstruments (COSMIN) [1921] guidelines. The protocol was registered in the International Prospective Registry of Systematic Reviews (PROSPERO) under the registration number CRD42021262613 [22].

Search strategy

The search was conducted in May 2022 in MEDLINE (Ovid), Web of Science, EMBASE, and PsycINFO databases, considering: (1) the construct of interest (cardiac self-efficacy); (2) target population (individuals with CAD); (3) type of instrument (questionnaire or scale); and (4) measurement properties; the latter was assessed using validated search filters for measurement studies previously applied in previous reviews and recommended by COSMIN [23].

Additional searches for relevant studies were conducted manually by checking the reference lists of primary studies and review articles. Searches were repeated prior to the final analysis in January 2023 using a date filter so that we could find studies published after our first search. The search strategies are provided in S1 File.

Study selection

Studies that developed and validated clinimetric properties of self-efficacy measurement instruments for individuals with CAD were included, with no restrictions on publication date or language.

Clinical trials or validation studies using measures reported by third parties, theses, dissertations, and those published as abstracts were excluded. Additionally, studies of instruments that had self-efficacy as part of their construct (e.g., self-management, self-care, self-control) were also excluded, limiting the scope to self-efficacy instruments for patients with CAD or with participant reports of the same diagnosis in the study.

The search results were imported into the reference management tool Mendeley (https://www.mendeley.com). Duplicates were removed prior to the selection process, and the reference list was exported to the systematic review platform Rayyan Qatar Computing Research Institute (https://rayyan.qcri.org) [24].

Two independent authors (JABA and KSM) selected the studies simultaneously based on titles and abstracts. After this step, the same authors conducted independent and simultaneous full-text readings and documented reasons for excluding ineligible studies. In cases of disagreement, a meeting was held for discussion and consultation with a third reviewer (LPG).

Data extraction

Data extraction was carried out by two authors (JABA and LPG) following COSMIN and Cochrane [1820]. The extracted information included title, authors, year of publication, general instrument characteristics (construct, subscales, number of items, version, score), study design, target population, sample size, individual characteristics (e.g., age range, gender, research location, country, language, selection methods), and clinimetric properties. A third reviewer (KSM) was consulted for reviewing the extracted data.

Study quality

The methodological quality of the studies was assessed by two independent authors (RBF and JCL) using the COSMIN RoB Checklist [25, 26]. This tool considers 10 measurement properties and consists of boxes with 3 to 35 items addressing aspects of comprehensiveness, relevance, and inclusiveness of the items included in the instrument. Each box assigns a methodological quality score for instrument development: (1) content validity, (2) structural validity, (3) internal consistency, (4) cross-cultural validity, (5) measurement invariance, (6) reliability, (7) measurement error, (8) criterion validity, (9) construct validity, and (10) responsiveness. Each item has four response options: inadequate (I), doubtful (D), adequate (A), and very good (V) [25]. Disagreements were resolved by a third author (KSM).

The content extracted from the measurement instruments was linked using the Comprehensive International Classification of Functioning, Disability and Health (ICF) Core Set following recommendations of Cieza et al. (2016) [17, 2729] conducted by two separate authors (JABA and RBF). Subsequently, a third author (JCL) reviewed the contents in case of discrepancies.

Data synthesis

Initially, a narrative synthesis of the results was prepared. In cases where the same instrument was validated for different populations, the assessment of measurement properties was performed considering a single instrument, with the particularity of each version being discussed. A combination of measurement properties determined the overall evidence of the instrument. Studies were grouped based on the similarity of instrument versions.

The results were assessed in groups or summarized in relation to the measurement property criteria to determine whether they were sufficient (+), insufficient (-), inconsistent (±), or indeterminate (?). The criteria were also subjectively evaluated by the reviewers (JABA and LPG), according to COSMIN criteria [19]. Additionally, the Modified Grading of Recommendations, Assessment, Development and Evaluation (GRADE) recommended by COSMIN was used to determine the quality of evidence as high, moderate, low, or very low [19, 30].

Subsequently, the instruments were categorized and justified according to COSMIN recommendations [21], considering the construct of interest and study population into three categories: (A) the instrument is recommended for use and the results are reliable; (B) when it can be recommended but requires further validation studies; and (C) the instrument should not be recommended due to insufficient properties.

Results

A total of 4420 references were identified from the EMBASE (n = 1126), MEDLINE (n = 995), PsycoINFO (n = 564), and Web of Science (n = 1735) databases. 1304 duplicates were removed, leaving a total of 3116 for screening. Considering eligibility criteria, 3072 studies were excluded. Out of the remaining 44 studies, 28 were excluded due to not being available in full text (n = 6), having self-efficacy in only one of the instrument domains (n = 5), not including participants with a diagnosis of CAD (n = 13), and being clinical trials (n = 3), resulting in 16 studies included. Additionally, a search in the reference lists of included studies was conducted and 5 studies were included in the results, totaling 21 articles for the review (Fig 1).

Characteristics of included studies and instruments

The included studies were published from 1998 to 2021. All of them aimed to develop or validate self-efficacy instruments specific to cardiovascular diseases or general ones that included individuals with CAD in their processes. The 21 included articles correspond to 12 self-efficacy measurement instruments in different versions available in the English language. Among the 21, 6 studies regards to instrument development, and 15 to validation.

The number of participants ranged from 18 to 726, totaling 5,393, with male predominance in 20 studies. The studies were conducted in the United States (n = 5) [12, 3134], China (n = 3) [8, 35, 36], Australia (n = 2) [37, 38], Italy (n = 2) [39, 40], Jordan (n = 2) [41, 42], South Korea (n = 1) [43], Iran (n = 1) [44], Thailand (n = 1) [45], Sweden (n = 1) [13], and Brazil (n = 2) [46, 47]. The Brazilian studies refer to the same instrument, one aiming to adapt and assess measurement properties [47], and the other to evaluate construct validity [46]. Barnason et al. (2002) did not report the country where the study was conducted [48]. The number of items per instrument ranged from 8 to 22, and factor structures were seen as unidimensional, bidimensional, and tridimensional. Table 1 presents the general characteristics of the included studies.

The included instruments assessed 8 different specific conditions that encompassed CAD in their participants, such as: 1) exercise self-efficacy: Cardiac Exercise Self-Efficacy Scale (Persian version CESE) [44], Exercise Self-Efficacy Scale (ESE) [37, 41, 43], Self-Efficacy for Exercise Scale Chinese version (SEE-C) [8]; 2) cardiac self-efficacy: Cardiac Self-Efficacy Scale (CSES) [12, 13, 35, 42, 45], and Scale to Measure Self-Efficacy and Self-Management in People With Coronary Heart Disease (HH-SESM Scale) [38]; 3) diet and nutrition self-efficacy: Cholesterol-Lowering Diet Self-Efficacy Scale [31], Food Pyramid Self Efficacy Scale (FPSES) [32]; 4) medication self-efficacy: Self-Efficacy for Appropriate Medication Use (SEAMS) [33, 46, 47]; 5) perceived general self-efficacy: General Perceived Self-Efficacy Scale (GSE) [40]; 6) cardiovascular management self-efficacy: Cardiovascular Management Self-Efficacy Scale [39]; 7) efficacy expectations: Barnason Efficacy Expectation Scale (BEES) [48]; 8) Tai Chi practice self-efficacy: Tai Chi Exercise Self-Efficacy (TCSE Performance) [34, 36].

Furthermore, the CSES [12, 13, 35, 42, 45] and ESE [37, 41, 43] showed the highest number of versions. Therefore, the CSES was considered the instrument with the broadest dissemination and is the oldest instrument included [12]. Regarding feasibility, the studies were not clear or did not provide data on factors such as time required for completion, instrument length, intellectual level required to respond, and facilitators. Concerning completion time, only the Arabic version of ESE [41] and the Thai CSES version [45] reported needing 20 and 15 minutes, respectively. No study reported whether a license is required for their use.

Although structural, content, and internal consistency validities were assessed in most studies, criterion, construct, cross-cultural validities, reliability, measurement error, and responsiveness were evaluated in a limited number of studies, either due to a complete or partial absence of data. Regarding reliability, the lack of data can negatively affect the reproducibility of consistent results. Measurement invariance was not assessed as no study presented such a property.

Methodological quality of the studies

The data obtained from the methodological assessment of the studies are summarized in Table 2. Nine out of the ten clinimetric properties were evaluated, with the exception of measurement invariance, which was not mentioned by any study.

thumbnail
Table 2. Methodological assessment of measurement properties.

https://doi.org/10.1371/journal.pone.0299041.t002

The general requirements for development were satisfactorily met (e.g., clear description of the construct, clear description of the target population for which the instrument is intended, and its context of use). However, the studies either did not provide or did not demonstrate clarity in at least one requirement, leading to their classification as "inadequate" (Table 2).

Content validity was assessed as adequate in four studies: Chinese [35], Swedish [13], and Thai [45] versions of the CSES, and FPSES [32]. Eight studies showed unsatisfactory assessment or did not report the factorial evaluation of their instruments for structural validity [31, 32, 34, 37, 38, 40, 46, 47]. In the analysis of internal consistency, all studies were categorized as "very good," with Cronbach’s alpha values ranging from 0.68 to 0.97. Steca et al.’s study (2015) [39] was the only one that presented a value below α = 0.70 for one of the instrument domains [19]. Only nine studies reported following COSMIN recommendations for the cross-cultural adaptation phase of their instruments, and were considered "very good" [13, 34, 35, 4247] (Table 2).

Regarding reliability, no study received a good methodological evaluation. All studies were considered "inadequate" in at least one of the eight assessed requirements. This is due to not reporting data on the Kappa agreement coefficient test and intraclass correlation coefficient.

Measurement error was deemed "adequate" only in the studies by Fors et al. (2014) [13] and Taylor-Piliae and Froelicher (2004) [34]. As for criterion validity, ten studies received a good assessment [8, 31, 33, 34, 36, 37, 39, 41, 45, 48].

The construct validity of the studies was conducted through hypothesis testing, mainly focusing on convergent and discriminant validity. Only one study reported parameters through divergent validity [44]. Nine studies were classified as "inadequate" due to lack of clarity or absence of measurement property data [8, 31, 32, 34, 36, 37, 40, 41, 46, 47]. For responsiveness, only two studies provided relevant information for this property and were considered "adequate" [37, 39].

Summary of quality and level of evidence

Only one instrument demonstrated low quality in its internal consistency [39]. Content validity, structural validity, cross-cultural validity, criterion validity, and construct validity showed mixed qualities. Reliability, measurement error, and responsiveness exhibited low overall quality. Table 3 provides a summary of the evaluated measurement properties.

  • Bandura’s Exercise Self-Efficacy Scale (ESE): assessed in three versions adapted for distinct populations. Content validity was unsatisfactory in all versions. Structural validity was deemed unsatisfactory in the Australian version [37] (with factor loadings > 0.40). Internal consistency received an inadequate assessment in the South Korean version [43] for not providing Cronbach’s alpha for each domain. Cross-cultural validity and construct validity received mixed evaluations, and only the South Korean version [43] was considered three-dimensional. The overall quality of evidence for the instrument was mixed. Only internal consistency was deemed high. Structural, criterion, and construct validities were rated as moderate, and content validity was rated as low. Therefore, it was categorized as a level C recommendation.
  • Barnason Efficacy Expectation Scale (BEES) [48]: Content validity was considered inconsistent. Structural validity (factor loading > 0.40), internal consistency (Cronbach’s alpha 0.92), and construct validity were deemed sufficient. The latter indicated that the instrument is unidimensional. The instrument provided insufficient data for reliability, measurement error, and responsiveness. The quality of evidence received mixed ratings, with internal consistency, structural validity, criterion validity, and construct validity rated as high. However, content validity was considered low. Therefore, it was categorized as a level B recommendation.
  • Cardiac Exercise Self-Efficacy Scale Persian Version (CESE) [44]: Structural validity (factor loading > 0.45) and construct validity were considered sufficient. Its exploratory analysis identified a 4-factor structure (knowledge, overcoming barriers, time management, and recovery). However, it did not provide Cronbach’s alpha values for each domain, resulting in an inadequate rating. Cross-cultural validity was satisfactory. The quality of evidence for the instrument received mixed ratings, with structural validity, cross-cultural validity, and construct validity considered high, while internal consistency and content validity were rated low by the assessors. The instrument was categorized as a level C recommendation.
  • Cardiac Self-Efficacy Scale (CSES): The instrument was evaluated in its original version [12] and four adaptations for different populations. Content validity was considered satisfactory in all versions. Structural validity was considered inconsistent only in the original version [12] and satisfactory in all four adaptations [13, 42, 35, 45]. The original model [12] and the Arabic version [45] presented as bidimensional, while the other adapted versions presented as tridimensional models. The versions showed discrepancies in assessing internal consistency, as the Chinese [35] and Swedish [13] versions did not report individual Cronbach’s alpha values for their three domains. Construct validity received mixed evaluations. The quality of evidence for the instrument received mixed ratings, with high content validity, structural validity, cross-cultural validity, and internal consistency. The instrument was categorized as a level B recommendation.
  • Cardiovascular Management Self-Efficacy Scale [39]: Structural validity (tridimensional model with factor loadings from 0.86 to 0.95), construct validity, criterion validity, and internal consistency received satisfactory ratings, but content validity obtained an insufficient rating. The quality of evidence for the instrument received mixed ratings, with only structural validity, criterion validity, construct validity, and internal consistency receiving high evaluations. The instrument was classified as a level B recommendation.
  • Cholesterol-Lowering Diet Self-Efficacy Scale [31]: Content validity was considered inconsistent, structural validity (no data provided in the study) and construct validity were rated as unsatisfactory, while internal consistency (Cronbach’s alpha >0.93) and criterion validity were rated as satisfactory. The quality of evidence for the instrument received mixed ratings, with six properties considered low, including content validity and structural validity. Therefore, the instrument was classified as level C evidence.
  • Food Pyramid Self-Efficacy Scale (FPSES) [32]: The instrument received satisfactory ratings for content validity and internal consistency (Cronbach’s alpha 0.92). However, structural validity (no factor analysis performed) and criterion validity were considered unsatisfactory. The quality of evidence for measurement properties received mostly low ratings, with high ratings only for content validity and internal consistency. Therefore, the instrument was classified as level C recommendation.
  • General Perceived Self-Efficacy Scale (GSE) [40]: The validated instrument received unsatisfactory ratings for content, criterion, and construct validity. It received a satisfactory rating only for internal consistency (Cronbach’s alpha 0.85). Structural validity was considered inconsistent. The quality of evidence for measurement properties received mixed evaluations, but predominantly low, with high ratings only for cross-cultural validity and internal consistency. Therefore, the instrument was classified as level C recommendation.
  • Scale to Measure Self-Efficacy and Self-Management in People With Coronary Heart Disease (HH-SESM Scale) [38]: The developed instrument received inconsistent ratings for content and structural validity, with a satisfactory rating only for internal consistency (Cronbach’s alpha 0.83 for self-efficacy subscale). In terms of evidence quality, the instrument received predominantly low ratings, including content and structural validity, with high rating only for internal consistency. Therefore, the instrument was classified as level C recommendation.
  • Self-Efficacy for Appropriate Medication Use (SEAMS): In the evaluation of the original version [33] of the instrument and the Brazilian version, found in two studies [46, 47], structural validity, criterion validity, and internal consistency were considered satisfactory. However, content validity for both versions was considered insufficient, but they differed in terms of construct validity assessment. The original version [33] was evaluated as unsatisfactory. The original study has factor loadings > 0.40 and is considered four-dimensional [33], while the Brazilian version is bidimensional [46, 47]. Regarding evidence quality, the grouped instrument received mixed evaluations, being rated as high only in terms of structural validity, cross-cultural validity, criterion validity, and internal consistency. Content validity was classified as low. Therefore, the instrument was classified as level B recommendation.
  • Self-Efficacy for Exercise Scale Chinese Version (SEE-C) [8]: The instrument received an unsatisfactory rating for content validity, moderate ratings for cross-cultural and construct validity (factor loading > 0.64, and considered unidimensional). Structural validity, criterion validity, and internal consistency (Cronbach’s alpha > 0.90) received satisfactory evaluations. Regarding evidence quality, the instrument received mixed assessments, receiving high ratings only for structural validity, criterion validity, and internal consistency. Content validity was considered low. Therefore, the instrument was classified as a level C recommendation.
  • Tai Chi Exercise Self-Efficacy Performance (TCSE): The validated instruments received satisfactory ratings in terms of internal consistency (Cronbach’s alpha > 0.95) and construct validity (factor loading > 0.40, considered bidimensional). They received mixed ratings in terms of content validity (varying from insufficient for the US version [34] to unsatisfactory for the Chinese version [36]), structural validity, and cross-cultural validity. In terms of the quality assessment of aggregated evidence, the instrument received mixed ratings, with high ratings for construct validity and internal consistency. Content validity and structural validity were considered moderate. Therefore, the instrument was classified as a level C recommendation.

Linking of items from measurement instruments with the international classification of functioning, disability and health

Table 4 presents the results of linking the extracted items from the measurement instruments to the ICF. It was not possible to link the FPSES instrument [32], as it is not available in its study or on the web. We did not receive a response from the authors after email contact. Only five items could not be linked as they corresponded to personal factors and were present in the versions of the ESE instrument [37, 41, 43], and the HH-SESM Scale [38].

thumbnail
Table 4. Linkage of content extracted from instrument items to ICF codes.

https://doi.org/10.1371/journal.pone.0299041.t004

A total of 321 concepts were identified from the 276 items of the 19 instruments. Regarding the process of linking to the ICF, categories were related to the majority of the instruments (originals and their adapted versions). The component body functions (b) was linked to all 19 instruments, the component body structures (s) was linked to 6 instruments, the component activities and participation (d) was linked to 18 instruments, and finally, the component environmental factors (e) was linked to 17 instruments. The chapters with the highest number of links were the chapters on mental functions (b1) and functions of the cardiovascular, hematological and immunological systems, and the respiratory system (b4).

The instrument with the highest number of concept links to the ICF was the Cardiac Self-Efficacy Scale (CSES), although there was a slight divergence in its 5 versions included in the study, with the Arabic version [33] having 25 (the highest number of linkages), the original [12], Swedish [41], and Thai [44] versions having 23, and the Chinese version having the lowest number of linkages, totaling 21.

Discussion

This systematic review identified twenty-one studies regarding the development and/or validation of 12 instruments that assess cardiac self-efficacy, medication, exercise, cardiac surgery, rehabilitation, nutrition, lifestyle, and risk factors in subjects with CAD. Instruments were classified as evidence levels B and C. Among the included instruments the CSES was the most disseminated as well as the instrument with the highest number of concept links to the ICF.

Following the COSMIN guidelines, all studies exhibit methodological failures in several significant information regarding measurement properties. These findings corroborate with a systematic review performed by Frei et al (2009) [49], in which they identified a large number of self-efficacy instruments for subjects with chronic diseases. However, all of them demonstrated significant limitations in their development and validation [49].

Considering the modified GRADE [19] no instrument was classified as evidence level A. The BEES, CSES, SEAMS, and CMSES were categorized as level B, suggesting they may be recommended for use when assessing the target population. A systematic review performed by Kavradim et al (2020) [50] focusing solely on self-efficacy instruments for cardiac purposes in general population with cardiovascular diseases found similar results which corroborates with our findings to the CSES and CMSES. Another review performed by Lamarche, Tejpal, and Mangin (2018) [51] assessing self-efficacy instruments in medication management found that SEAMS instrument [33] is the most appropriate self-efficacy scale.

The validity of content, considered the most important measurement property of an instrument according to COSMIN [26], is evaluated in relation to its target population, data collection, moderator, interviews, recording, transcription, sample size, and data analysis [26]. It was observed that the majority of studies presented inconsistent data on the assessed items [8, 31, 33, 34, 36, 3844, 4648]. These results are similar with the review by Kavradim et al (2020), which classified CSES with high quality and CMSES with low quality for validity content [50].

Structural validity provides evidence through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) [19]. However, such data were not found in some instruments [31, 32, 34, 38], leading to their downgraded classifications. The CSES and CMSES instruments demonstrated high quality for structural validity, consistent with the review by Kavradim et al (2020) [50]. It was also observed divergence in dimensions and item numbers between the different versions of CSES [12, 13, 35, 42, 45] and ESE [37, 41, 43]. These differences may be related to cultural, educational, and socioeconomic factors of each country.

All studies measured internal consistency using Cronbach’s alpha, but only a minority conducted test-retest reliability analyses. These data corroborate with the findings of Frei et al (2009) [49], Kavradim et al (2020) [50], and Lamarche, Tejpal, and Mangin (2018) [51]. We recommend that validation processes include relevant tests to the instrument’s purpose, and every validation should incorporate test-retest reliability analysis, preferably using intraclass correlation coefficients [25].

Regarding the ICF, the CSES instrument in all its versions showed the highest number of linkages of its items with the four ICF categories and codes [50]. This may be related to the diversity of content assessed in its items, which can increase the range of codes, making it the most comprehensive instrument included in the review. As the ICF classification is a reference in clinical practice, teaching, and research language, this data becomes relevant [29, 50].

All item contents that could not be linked to the ICF referred to factors not yet covered by it and were present in all ESE instrument versions [37, 41, 43], and the HH-SESM Scale [38]. This reinforces the reported importance of identifying these contents in linkage studies to strengthen the inclusion of additional factors in the ICF in the future [51, 52].

The findings of this review show that all instruments assessing self-efficacy for individuals with CAD have some shortcomings in their measurement properties. Therefore, it is recommended to develop more robust self-efficacy instruments for individuals with CAD with fewer biases that could compromise the measured results.We believe that the results of this review can contribute to the selection of appropriate instruments for assessing self-efficacy levels in CAD in different contexts.

Moreover, considering the evidence level found in this review, we consider that the use of such instruments in clinical practice, research and teaching may be carefully assessed as improvements in measurement properties are needed for better evaluation. In this way, the choice of health professionals, researchers and academics should be based on validated instruments according to the target population as well as those with appropriate measurement properties and greater content linkage with the ICF for language standardization.

It is worth highlighting that this is the first systematic review assessing self-efficacy instruments for CAD as well as linking self-efficacy instruments to the ICF. This study was also conducted in accordance with the recommendations of Cochrane [18] and COSMIN [19, 25] by two independent authors without any language or time restriction. Furthermore, the PRISMA 2020 Main Checklist was adopted resulting in a more transparent, comprehensive, and accurate review (S1 Checklist). Although we have limited the inclusion criteria to self-efficacy instruments for coronary patients, the heterogeneity of the included instruments may have made the discussion of measurement properties more challenging. Another limitation may be related to the lack of patient and public involvement in its development.

Conclusion

Despite the large number of instruments assessing self-efficacy in individuals with CAD, none of them showed strong properties regarding the procedures adopted for their development and measurement validity. The best evidence level found was categorized as B which means a potential to be recommended. However, further clinimetric studies in accordance with COSMIN are required for evaluating self-efficacy in individuals with CAD. Regarding the linkage with the ICF, CSES had the highest number of linkages with ICF codes in the categories of body functions and structures, activities and participation, and environmental factors. In this way, the CSES may be considered the most comprehensive instrument assessed in this study, considering the importance of the ICF in standardizing clinical language.

References

  1. 1. Bandura A. Health promotion by social cognitive means. Health Education and Behavior. 2004;31: 143–164. pmid:15090118
  2. 2. Bandura A. Self-efficacy Encyclopedia fo human behavior. 1994;4: 71–81.
  3. 3. Roest AM, Martens EJ, Denollet J, De Jonge P. Prognostic association of anxiety post myocardial infarction with mortality and new cardiac events: A meta-analysis. Psychosomatic Medicine. 2010;72: 563–569. pmid:20410247
  4. 4. Joekes K, Van Elderen T, Schreurs K. Self-efficacy and overprotection are related to quality of life, psychological well-being and self-management in cardiac patients. Journal of Health Psychology. 2007;12: 4–16. pmid:17158836
  5. 5. Katch H. The role of self-efficacy in cardiovascular disease self-management: a review of effective programs. Patient Intelligence. 2010; 33.
  6. 6. Luszczynska A, Scholz U, Schwarzer R. The general self-efficacy scale: Multicultural validation studies. Journal of Psychology: Interdisciplinary and Applied. 2005;139: 439–457. pmid:16285214
  7. 7. Birkett NJ, Hotz S. A self-efficacy scale for heart-healthy eating. Can J Public Health. 1994;85. Recuperado: https://pubmed.ncbi.nlm.nih.gov/7922967/
  8. 8. Wong EML, Leung DYP, Sit JWH, Chan AWK, Chair SY. Prospective Validation of the Chinese Version of the Self-Efficacy for Exercise Scale among Middle-Aged Patients with Coronary Heart Disease. Rehabilitation nursing: the official journal of the Association of Rehabilitation Nurses. 2020;45: 74–79. pmid:32118864
  9. 9. Saffari M, Zeidi IM, Fridlund B, Chen H, Pakpour AH. A Persian Adaptation of Medication Adherence Self-Efficacy Scale (MASES) in Hypertensive Patients: Psychometric Properties and Factor Structure. High Blood Pressure and Cardiovascular Prevention. 2015;22: 247–255. pmid:25986076
  10. 10. Holley S, Knibb R, Latter S, Liossi C, Mitchell F, Radley R, et al. Development and validation of the Adolescent Asthma Self-Efficacy Questionnaire (AASEQ). Eur Respir J. 2019;54: 1–10. pmid:31048348
  11. 11. Topçu S, Oguz S. Translation and validation study for the stroke self ‐ efficacy questionnaire in stroke survivors. International Journal of Nursing Practice. 2018; 1–8. pmid:29575417
  12. 12. Sullivan MD, Lacroix AZ, Russo J, Katon WJ. Self-efficacy and self-reported functional status in coronary heart disease: A six-month prospective study. Psychosomatic Medicine. 1998;60: 473–478. pmid:9710293
  13. 13. Fors A, Ulin K, Cliffordson C, Ekman I, Brink E. The Cardiac Self-Efficacy Scale, a useful tool with potential to evaluate person-centred care. European journal of cardiovascular nursing: journal of the Working Group on Cardiovascular Nursing of the European Society of Cardiology. 2015;14: 536–543. pmid:25149667
  14. 14. Khan MAB, Hashim MJ, Mustafa H, Baniyas MY, Khalid S, Mohamad B, et al. Global Epidemiology of Ischemic Heart Disease: Results from the Global Burden of Disease Study. Cureus. 2020;12. pmid:32742886
  15. 15. Tales de C, Mauricio M, Almir Sergio F, Anderson D da S, Artur HH, Carlos Alberto Cordeiro H, et al. Diretrizes Diretriz Brasileira de Reabilitação Cardiovascular– 2020 Diretrizes. Arquivos Brasileiros de Cardiologia. 2020;114: 943–987. pmid:32491079
  16. 16. Flammer A. Self-Efficacy. International Encyclopedia of the Social & Behavioral Sciences: Second Edition. 2015;4: 504–508.
  17. 17. Cieza A, Brockow T, Ewert T, Amman E, Kollerits B, Chatterji S, et al. Linking health-status measurements to the International Classification of Functioning, Disability and Health. Journal of Rehabilitation Medicine. 2002;34: 205–210. pmid:12392234
  18. 18. Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M, et al. Cochrane handbook for systematic reviews of interventions version 6.4. Cochrane. 2023. Recuperado: https://training.cochrane.org/handbook/current
  19. 19. Mokkink LB, Prinsen CA, Patrick DL, Alonso J, Bouter LM, de Vet HC, et al. COSMIN manual for systematic reviews of PROMs, user manual. 2018; 1–78. Recuperado: https://www.cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf
  20. 20. MOKKINK LB et al. COSMIN Risk of Bias checklist for systematic reviews of PatientReported Outcome Measures. Quality of Life Research. 27: 1171–1179. pmid:29260445
  21. 21. Prinsen CAC, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research. 2018;27: 1147–1157. pmid:29435801
  22. 22. Alexandre J, Almeida B, Florêncio RB, Lemos DA, Leite JC, Monteiro KS, et al. Self-efficacy instruments for individuals with coronary artery disease: a systematic review protocol. 2022. pmid:35882460
  23. 23. Search filter for finding studies on measurement properties. 2018 p. 1–2. Recuperado: https://www.cosmin.nl/tools/guideline-conducting-systematic-review-outcome-measures/
  24. 24. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Systematic Reviews. 2016;5: 1–10. pmid:27919275
  25. 25. Mokkink LB. COSMIN Risk of Bias checklist [PDF File]. Amsterdam Public Health Research Institute. 2018; 1–37. Recuperado: www.cosmin.nl
  26. 26. Terwee CB, Prinsen CAC, Chiarotto A, De Vet HCW, Westerman MJ, Patrick DL, et al. COSMIN standards and criteria for evaluating the content validity of health‐related Patient‐Reported Outcome Measures: a Delphi study. Qual Life Res. 2017;27: 1159–1170.
  27. 27. Cieza A, Geyh S, Chatterji S, Kostanjsek N, Üstün B, Stucki G. ICF linking rules: An update based on lessons learned. Journal of Rehabilitation Medicine. 2005;37: 212–218. pmid:16024476
  28. 28. de Castro SS, Castaneda L, de Araúj ES, Buchalla CM. Aferição de funcionalidade em inquéritos de saúde no Brasil: Discussão sobre instrumentos baseados na Classificação Internacional de Funcionalidade, Incapacidade e Saúde (CIF). Revista Brasileira de Epidemiologia. 2016;19: 679–687. pmid:27849281
  29. 29. Cieza A, Fayed N, Bickenbach J, Prodinger B, Cieza A, Fayed N, et al. Refinements of the ICF Linking Rules to strengthen their potential for establishing comparability of health information Refinements of the ICF Linking Rules to strengthen their potential for. 2016;8288. pmid:26984720
  30. 30. TERWEE CB, et al. COSMIN methodology for evaluating the content validity of patientreported outcome measures: a Delphi study. Quality of Life Research.
  31. 31. Burke LE, Dunbar-Jacob J, Sereika S, Ewart CK. Development and testing of the Cholesterol-Lowering Diet Self-Efficacy Scale. European Journal of Cardiovascular Nursing. 2003;2: 265–273. pmid:14667482
  32. 32. Moseley MJ. Reliability and validity of the Food Pyramid Self Efficacy Scale: Use in Coronary Artery Bypass Patients. Progress in Cardiovascular Nursing. 1999;14: 130–142. pmid:10689724
  33. 33. Risser J, Jacobson TA, Kripalani S. Development and Psychometric Evaluation of the Self-Efficacy for Appropriate Medication Use Scale (SEAMS) in Low-Literacy Patients With Chronic Disease. Journal of nursing measurement. 2007;15: 32–44. pmid:18232619
  34. 34. Taylor-Piliae RE, Froelicher ES. Measurement properties of Tai Chi exercise self-efficacy among ethnic Chinese with coronary heart disease risk factors: A pilot study. European Journal of Cardiovascular Nursing. 2004;3: 287–294. pmid:15572017
  35. 35. Zhang X, Zhan Y, Liu J, Chai S, Xu L, Lei M, et al. Chinese translation and psychometric testing of the cardiac self-efficacy scale in patients with coronary heart disease in mainland China. Health and Quality of Life Outcomes. 2018;16: 1–8. pmid:29530024
  36. 36. Liu T, Chan AWK, Taylor-Piliae RE, Choi K-C, Chair S-Y. Psychometric Properties of the Translated Tai Chi Exercise Self-Efficacy Scale for Chinese Adults with Coronary Heart Disease or Risk Factors. International journal of environmental research and public health. 2021;18. pmid:33807477
  37. 37. Everett B, Salamonson Y, Davidson PM. Bandura’s exercise self-efficacy scale: Validation in an Australian cardiac rehabilitation setting. International Journal of Nursing Studies. 2009;46: 824–829. pmid:19261281
  38. 38. Mares M, Salamonson Y, Maneze D, Elmir R, Everett B. Development and Validation of a Scale to Measure Self-efficacy and Self-management in People With Coronary Heart Disease. The Journal of cardiovascular nursing. 2020;Publish Ah. pmid:37707975
  39. 39. Steca P, Greco A, Cappelletti E, D’Addario M, Monzani D, Pancani L, et al. Cardiovascular Management Self-efficacy: Psychometric Properties of a New Scale and Its Usefulness in a Rehabilitation Context. Annals of Behavioral Medicine. 2015;49: 660–674. pmid:25776579
  40. 40. Zotti AM, Balestroni G, Cerutti P, Ferrario SR, Angelino E, Miglioretti M. Application of the general perceived self-efficacy scale in cardiovascular rehabilitation. Monaldi Arch Chest Dis. 2007;68: 178–183. pmid:18361215
  41. 41. Darawad MW, Hamdan-Mansour AM, Khalil AA, Arabiat D, Samarkandi OA, Alhussami M. Exercise Self-Efficacy Scale: Validation of the Arabic Version Among Jordanians With Chronic Diseases. Clinical Nursing Research. 2018;27: 890–906. pmid:28024409
  42. 42. Shajrawi A, Khalil H, Al-Smadi AM, Al Dweik G, Slater P. A cross-cultural translation and adaptation of the Arabic Cardiac Self-Efficacy Questionnaire for patients with coronary heart disease. International Journal of Nursing Practice. 2020;26: 1–11. pmid:32078751
  43. 43. Shin YH, Jang HJ, Pender NJ. Psychometric evaluation of the exercise self-efficacy scale among Korean adults with chronic diseases. Research in Nursing and Health. 2001;24: 68–76. pmid:11260587
  44. 44. Rajati F, Rajati M. Validity and reliability of the Iranian version of the cardiac exercise self-efficacy scale. ARYA Atherosclerosis. 2019;15: 113–122. pmid:31452659
  45. 45. Saengsiri A-O, Thanasilp S, Preechawong S. a Psychometric Evaluation of the Thai Version of the Cardiac Self-Efficacy Questionnaire for Patients With Coronary Artery Disease. J Health Res. 2013;27. Recuperado: http://www.jhr.cphs.chula.ac.th
  46. 46. Pedrosa RB dos S, Rodrigues RCM, Oliveira HC, Alexandre NMC. Construct Validity of the Brazilian Version of the Self-Efficacy for Appropriate Medication Adherence Scale. Journal of nursing measurement. 2016;24: E18–31. pmid:27103240
  47. 47. Pedrosa RB dos S, Rodrigues RCM. Adaptation and evaluation of the measurement properties of the Brazilian version of the self-efficacy for appropriate medication adherence scale. Revista Latino-Americana de Enfermagem. 2016;24: e2692. pmid:27192417
  48. 48. BARNASON S, ZIMMERMAN L, ATWOOD J, NIEVEEN , SCHMADERER M. Development of a Self-Efficacy Instrument for Coronary Artery Bypass Graft Patients. Journal of nursing measurement. 2002;10: 123–133. pmid:12619533
  49. 49. Frei A, Svarin A, Steurer-Stey C, Puhan MA. Self-efficacy instruments for patients with chronic diseases suffer from methodological limitations—A systematic review. Health and Quality of Life Outcomes. 2009;7: 86. pmid:19781095
  50. 50. Turan Kavradim S, Yangöz ŞT, Canli Ozer Z, Boz I. Instruments to assess self-efficacy among people with cardiovascular disease: A COSMIN systematic review. International Journal of Clinical Practice. 2020;74: 1–15. pmid:33166049
  51. 51. Lamarche L, Tejpal A, Mangin D. Self-efficacy for medication management: A systematic review of instruments. Patient Preference and Adherence. 2018;12: 1279–1287. pmid:30050290
  52. 52. Geyh S, Schwegler U, Peter C, Müller R. Representing and organizing information to describe the lived experience of health from a personal factors perspective in the light of the International Classification of Functioning, Disability and Health (ICF): a discussion paper. Disability and Rehabilitation. 2019;41: 1727–1738. pmid:29509044