Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Experience of Embodiment Scale: An examination of its psychometric properties in women from the Republic of Cyprus

  • Viren Swami,

    Roles Data curation, Writing – original draft

    Affiliations School of Psychology, Sport, and Sensory Sciences, Anglia Ruskin University, Cambridge, United Kingdom, Centre for Psychological Medicine, Perdana University, Kuala Lumpur, Malaysia

  • Christophe Maïano,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Cyberpsychology Laboratory and Department of Psychoeducation and Psychology, Université du Québec en Outaouais, Saint-Jérôme, Canada

  • Marios Argyrides,

    Roles Conceptualization, Methodology, Project administration, Writing – review & editing

    Affiliation Department of Psychology, Neapolis University, Pafos, Cyprus

  • Elly Anastasiades

    Roles Investigation, Methodology, Project administration, Writing – review & editing

    e.loizou@nup.ac.cy

    Affiliation School of Psychology, Sport, and Sensory Sciences, Anglia Ruskin University, Cambridge, United Kingdom

Abstract

The Experience of Embodiment Scale (EES) is a recently developed instrument that assesses experiences of living in the body. Here, we prepared a novel Greek translation of the EES and examined its psychometric properties. We initially prepared a Greek translation of the EES using a 5-step procedure recommended for test adaptation studies. Next, in a cross-sectional study, we asked a sample of 933 women from Cyprus to complete the Greek EES, alongside additional, previously validated measures assessing body appreciation, psychological well-being (self-esteem, life satisfaction), eating restriction, perfectionism, and internalisation of appearance ideals. Our analyses showed that EES factorial models based on confirmatory factor analysis (CFA) roundly had poor fit. Conversely, models based on exploratory structural equation modelling (ESEM)–which accounts for the fact that EES items cross-load across factors–had adequate fit to the data. Additionally, we found that both higher-order and bifactor-ESEM models that controlled for the uniqueness of negatively worded items had adequate fit. The bifactor-ESEM model had the best fit of all the models tested, and was invariant across ethnicity (Greeks and Greek-Cypriots) and was unaffected by differential item functioning based on age and body mass index. Additionally, construct validity of the final, optimal model was adequate, especially for its G-factor, as indicated by significant associations with additional constructs in expected directions. These results suggest that a bifactor-ESEM model of the Greek EES has adequate psychometric properties. Our work highlights important psychometric issues relating to the manner in which the EES should (or could) be conceptualised and modelled, which should be considered more fully in future work.

Introduction

In its broadest sense, embodiment is a philosophical construct that refers to the “perceptual experience of engagement of the body in the world” [1] (p. 175), or the ways in which individuals live in and experience the world through their bodies. Although the construct of embodiment is central to understandings of body image, it had been relatively infrequently studied until the important work of Piran and colleagues [26], which sought to better understand the nature and antecedents of experiences of embodiment. Through extensive qualitative and cross-sectional research anchored in the experiences of North American girls and women, Piran [2, 3] developed the multidimensional experience of embodiment construct, which places embodiment on a continuum ranging from positive to negative experiences. Further, the experience of embodiment was conceptualised as being shaped by the quality of experiences along five dimensions, namely body connection and comfort, agency and functionality, attuned self-care, inhabiting the body as a subjective site, and experience of expression of bodily desires.

Based on this body of work, Piran and colleagues [7] went on to develop the Experience of Embodiment Scale (EES), the first instrument to specifically assess experiences of embodiment. To do so, they developed a pool of 48 novel items, of which 14 were excluded based on initial response patterns with data from sample of Canadian women (N = 92). Next, data from a new sample of Canadian women (N = 412) were subjected to exploratory factor analysis (EFA), which resulted in the extraction of six factors: Positive Body Connection and Comfort (PBCC; 6 items), Body Unencumbered Adjustment (BUA; 8 items), Agency and Functionality (AF; 7 items), Experience and Expression of Sexual Desire (EESD; 4 items), Attuned Self-Care (ASC; 6 items), and Resisting Objectification (RO; 3 items). Additionally, bifactor analysis suggested that it was possible to extract a stable general (G) factor and six specific (S) factors, with all but three items (#7, 18, and 19) loading onto the G-factor [7].

In a third study with women from the United States (N = 343), Piran et al. [7] tested three competing confirmatory factor analytic (CFA) models to determine the factor structure of the EES: a unidimensional model of EES scores, a higher-order model with six lower-order factors, and a bifactor model with a G-factor and six S-factors [7]. While the unidimensional model had poor fit, both the higher-order and bifactor-CFA models had adequate fit. Estimating the residual covariance of two items (#1 and 2) improved fit of the higher-order model, with all six lower-order factors adequately loading onto the higher-order factor. In contrast, seven items had weak loadings on the G-factor in the bifactor model and this, alongside the correspondence of the higher-order model with earlier qualitative research [2], led Piran and colleagues [7] to select the higher-order model as their preferred conceptualisation of the EES. Apart from the RO subscale (McDonald’s ω = .58), subscale scores on this model had adequate composite reliability (McDonald’s ω ≥ .78) and, across studies, the EES had adequate patterns of convergent and discriminant validity.

Given that these findings were largely anchored in the experiences of North American girls and women, it is unclear to what extent the 6-factor model of the EES will be recoverable in other national contexts. Indeed, to date, only one other study has examined the psychometric properties of the EES outside of North America [8]. Based on the results of an EFA using a novel Swedish translation of the EES with Swedish women (N ~ 295), Kling and colleagues [8] extracted a 6-factor model, with three factors (EESD, RO, and BCC) mirroring those reported by Piran and colleagues [7] and three remaining factors showing some deviation from the original model (e.g., all PBCC items and several BUA items formed a single factor). In Swedish men (N ~ 234), a 5-factor solution was preferred, with the AF and EESD factors notably being combined. In both cases, Kling and colleagues [8] also reported that it was possible to extract a higher-order model.

Issues to consider

In view of these findings, the higher-order, 6-factor model of EES appears to be preferred by scholars, with studies utilising this model in analyses [9]. However, before this model is accepted as the optimal configuration of EES scores, particularly in cross-national research, further research on the psychometric properties of the EES in diverse national contexts is needed. In so doing, several inter-related issues should be considered.

Cross-loading items.

The first of these issues relates to how cross-loading items should be dealt with. While there is no consensus in the literature concerning a minimum value above which a factor pattern coefficient is considered salient, even cross-loadings as low as .10 may sometimes exert salient effects on factor modelling [10]. This is particularly important because cross-loadings were common and substantive in both the original development study [7], as well as in the test adaptation work in Sweden [8]. For instance, examination of the item-factor loadings in the EFA reported by Piran and colleagues [7] shows that 11 of the 34 EES items cross-loaded on more than one factor at ≥ .25 and a majority (21 items) cross-loaded at ≥ .20. Likewise, although Kling et al. [8] did not report a full factor loading matrix, they noted that nine items had cross-loadings greater than .25.

This, in turn, has implications for how scholars should cross-validate the EES in test adaptation studies. Specifically, CFA may have lower utility as a method of cross-validation because CFA only allows items to load on to their respective hypothesised latent factor, while forcing cross-loadings to be zero [1113]; that is, CFA assumes “pure” factors where these factors only load onto their a priori latent factors. However, given that a majority of EES items show at least some overlap across conceptually related facets, failure to account for cross-loadings will likely lead to biased estimates of factor correlations and associations between these factors and other variables [12, 14, 15], as well as at least some model misspecification [16]. Even apparently well-fitting CFA models–such as Piran and colleagues’ [7] 6-factor model–could hide these misspecifications given their ability to absorb unmodelled cross-loadings through an inflation of factor correlations, without letting them impact model fit, e.g., [13, 17].

Instead of relying on CFA, or indeed an EFA-to-CFA approach, an alternative method for assessing factorial validity where cross-loadings are assumed to be substantive is exploratory structural equation modelling (ESEM) [12, 1719]. ESEM was specifically designed to integrate the best elements of both EFA and CFA, including the relaxation of the zero cross-loadings requirement of CFA (a feature typically limited to EFA), while also allowing researchers to obtain goodness-of-fit statistics, residual correlations, standard error estimates, tests of measurement invariance, and tests of associations between latent constructs (i.e., features typically limited to CFA). Moreover, through its “target” rotation method (i.e., where cross-loadings are “targeted” to be close to zero while all main loadings are freely estimated) [12, 17], ESEM allows for a theory-driven approach that can be used in a confirmatory manner. As a result, ESEM provides a different approach to address the aforementioned limitations of CFA for the assessment of factorial validity [17].

Higher-order modelling.

There also remains scope to re-examine the utility of both higher-order and bifactor modelling of the EES. In their work, Piran and colleagues [7] in fact found that a 6-factor bifactor-CFA (henceforth B-CFA) model had superior fit to a 6-factor high-order CFA model (henceforth HO-CFA), although the former was de-valued on theoretical grounds (i.e., some items, including all RO items, did not load on the G-factor). While both bifactor and higher-order models postulate the co-existence of a general factor with specific factors, a unique feature of bifactor models is in their assumption that general factors have direct (rather than indirect) effects on the indicators (items). As such, all items are loaded on a specific factor and one general factor, with the variance of indicators partitioned into three sources, namely the specific factor, the general factor, and measurement error. In contrast, in higher-order models, associations between the indicators and the higher-order factor are indirect and associations between the indicators and the unique part of the higher-order factor are also mediated by the lower-order factors.

However, such an assumption in higher-order models is often viewed as empirically implausible and problematic [20, 21]. Indeed, emerging consensus suggests that bifactor models should be preferred over higher-order models unless there are strong conceptual and theoretical justifications for the latter [22]. With regards to the EES, Piran and colleagues’ [7] suggestion that the specific factors in their HO-CFA model can be conceptualised as subscale scores representing domains of the experience of embodiment is not in and of itself an adequate justification for favouring a higher-order model over a bifactor model. In fact, we suggest that it is in fact the bifactor model that provides greater theoretical and empirical plausibility [13]. Before any firm conclusions can be drawn, however, it should be noted that bifactor models can be constructed using both CFA and ESEM (henceforth B-ESEM). As such, and following on from the discussion above, there is a need to assess whether a B-ESEM model presents optimal fit for EES data.

Negatively worded items.

A third issue that requires further consideration is the inclusion of negatively worded items. Notably, all items on the BUA factor were negatively worded and four of the six EES factors included both positively and negatively worded items. Although negatively worded items can sometimes be useful for minimising acquiescence, affirmation, or agreement biases, they also require greater cognitive effort when responding [23]. This, in turn, often leads to methods effects that result in spurious covariances among items. Such method effects can be viewed as “noise” variance that should be controlled in analyses or modelled as correlated uniqueness (CU) among the indicators [24]. Previous studies, however, have not controlled for negatively worded items in the EES, which may have resulted in biased parameter estimates.

Differential item functioning.

Finally, much more can also be done to better understand whether respondent characteristics affect the probability of endorsing a given item on the EES (i.e., whether EES items are affected by differential item functioning or DIF). Two characteristics that are worthy of investigation in this regard are age and body mass index (BMI). In terms of the former, embodiment itself is a lived process that is likely to be affected by the physical state of one’s corporeal body, which in turn means that experiences of embodiment may be affected by age [25]. In terms of the latter, it is possible that navigating societies that objectify women based on BMI may affect experiences of embodiment. In Swedish women, for instance, Kling and colleagues [8] reported a negative association between EES scores and women’s BMI. In light of these issues, a fuller understanding of the role of age and BMI on item responses to the EES would be useful.

The present study

In the present study, we sought to examine–with the above issues in mind–the psychometric properties of a novel Greek translation of the EES in a sample of women from Cyprus (officially the Republic of Cyprus), an island country in the Mediterranean Sea. Briefly, after almost eight decades under British rule, the majority Greek Cypriot population of Cyprus began pursuing a policy of énosis (union with Greece) in the 1950s, while the minority Turkish Cypriot population advocated for a policy of taksim (the partition of Cyprus and the creation of a Turkish polity in the north). When the island ultimately achieved independence rather than énosis in 1960, some of those disappointed by the failure of the énosis movement revived a campaign that resulted, in 1974, in a coup d’état against the elected president. This action precipitated the Turkish invasion of Cyprus, which led to the present-day partition of the island into the Republic of Cyprus (which has de jure sovereignty over the entire island but effectively controls about 60% of the island in the south and west) and the Turkish Republic of Northern Cyprus (considered an illegal occupation by the international community).

Because our sample in the present study is culturally novel, a number of analytic strategies are available to us. For instance, recent test adaptation work has utilised an EFA-to-ESEM/CFA strategy [26], in which an initial EFA is followed up with comparisons of fit of HO-CFA, HO-ESEM, B-CFA, and B-ESEM models. While such a strategy would normally be useful in test adaptation work, it is also atheoretical in its attempt to identify the best-fitting model for a dataset. In contrast, one could also accept that there is a need to balance theory and empiricism, while emphasising conceptual clarity. In this view, we accept as a starting point that the EES measures six facets of the experience of embodiment that are theoretically plausible [7]. That is, we honour the underlying research that has facilitated the development of the EES [26] and accept that the 6-factor model of EES scores offers a theoretically plausible account of the experience of embodiment, irrespective of the cultural or national context.

However, we also suggest that the EES factors are unlikely to be “pure” measures of their respective facets, but rather that the EES taps six highly inter-correlated factors that show substantive overlap at the level of the items and lower-order facets. As such, an alternative analytic strategy would be to begin by comparing the utility of 6-factor CFA and ESEM models, with and without CU, of the EES. Assuming that one or more of these models has adequate fit in the Cypriot setting, it would provide empirical support for the theoretical propositions that underlay the development of the EES. Next, we also cross-validate the optimal model and consider multidimensional functioning (i.e., higher-order and bifactor models), which would provide the most rigorous test of the factorial validity of the EES to date. This analytic framework has been employed previously [27] and allows us to honour the theoretical foundations of the EES while ensuring that empirical considerations are not minimised [28].

Based on the discussion above, we hypothesised that a 6-factor B-ESEM that accounts for CU would provide optimal fit to the data. Beyond an assessment of factorial validity, we also sought to extend knowledge in several ways. First, we considered the extent to which the optimal model of EES scores would demonstrate measurement invariance across ethnicity, which would give an additional degree of confidence that the optimal model is robust. Second, we considered the extent to which EES items may function differently based on respondent age and BMI. Given that the EES was designed to be reflective of the experiences of adult women, irrespective of their age and BMI [7], we should not expect to see DIF based on these respondent characteristics. Finally, we also conducted an examination of the construct validity of the EES in Cypriot women based on the availability of instruments that have been validated for use in Greek-speaking populations. Specifically, based on previous findings [7, 8, 29], we assessed: (a) convergent validity (expectation of a positive and moderate-to-high correlation with body appreciation); (b) concurrent validity (expectation of positive and moderate associations with self-esteem and life satisfaction, and negative and moderate associations with internalisation of appearance ideals and eating restriction); and (c) discriminant validity (expectation of a weak or negligible relationship with perfectionism).

Materials and methods

Participants

The total sample consisted of 933 respondents who identified as women. Only women were recruited because the EES was originally developed for, and validated with, women [7]. Participants ranged in age from 18 to 69 years (M = 37.31, SD = 9.75) and in self-reported BMI from 15.57 to 53.78 kg/m2 (M = 25.14, SD = 5.57). Most of the sample (62.1%) of the sample identified as Greek and 37.9% identified as Greek Cypriot. Of the sample, 0.5% had completed secondary education, 17.6% had completed college, 42.6% had an undergraduate degree, and 39.3% had a postgraduate degree. No further demographic data were collected.

Measures

Experience of embodiment.

Participants were asked to complete a novel Greek translation of the 34-item EES [7], with items rated on a 5-point scale ranging from 1 (strongly disagree; Greek: διαφωνώ απόλυτα) to 5 (strongly agree; Greek: συμφωνώ απόλυτα). To prepare a Greek translation of the EES, we followed the 5-step procedure recommended by Beaton et al. [30]. Specifically, two translators–one informed, and one uninformed–first independently forward-translated the EES instructions, items, and response options from English to Greek. Next, the two translations were examined by a third, independent translator who resolved any discrepancies and produce a synthesised translation. Third, the synthesised translation was then back-translated by two translators naïve to the EES back into English. Fourth, the forward- and back- translations were compared by an expert committee comprising all the translators, as well as all authors of the present study, who resolved any minor inconsistencies between versions. In the fifth and final stage, the translated EES was pre-tested in a sample of 16 women who broadly matched the target sample. Participants in the pre-test study provided qualitative feedback regarding their level of understanding, as well as suggestions for improvements to enhance comprehension (based on open-ended questions). This feedback was returned to the committee, who agreed that no further revisions were necessary. The EES items in English and Greek are reported in the Appendix within the (S1 Appendix).

Body appreciation.

Participants completed the 10-item from the Body Appreciation Scale-2 (BAS-2) [31]; Greek translation: [32]. Items were rated on a 5-point scale (1 = never, 5 = always). In the present study, McDonald’s ω for scores on this scale was .96 (95% CI = .95, .96).

Self-esteem.

Self-esteem was assessed using the 10-item Rosenberg Self-Esteem Scale (RSES) [33]; Greek translation: [34]. Items were rated on a 4-point scale (1 = strongly disagree, 4 = strongly agree. In the present study, McDonald’s ω for RSES scores was .91 (95% CI = .90, .92).

Life satisfaction.

Participants completed the 5-item Satisfaction with Life Scale (SLS) [35]; Greek translation: [36], which assesses one’s assessment of the quality of life on the basis of their own unique criteria. All items were rated on a 5-point scale ranging from 1 (strongly disagree) to 5 (strongly agree). In the present work, McDonald’s ω for scores on this scale was .90 (95% CI = .89, .91).

Eating restriction.

To measure eating restriction, we used the 5-item Restraint subscale of the Eating Disorder Questionnaire (EDE-Q) [37]; Greek translation: [38]. All items were rated on a 7-point scale, ranging from 0 (no days) to 6 (every day). In the present work, McDonald’s ω for scores on this subscale was .85 (95% CI = .83, .86).

Perfectionism.

To measure perfectionism, we used the High Standards subscale of the Almost Perfect Scale–Revised (APS-R) [39]; Greek translation: [40], a 7-item measure of adaptive perfectionism. All items were rated on a 7-point scale ranging from 1 (strongly disagree) to 7 (strongly agree). In the present work, McDonald’s ω for scores on this subscale was .86 (95% CI = .84, .87).

Internalisation of appearance ideals.

Participants were asked to complete the Internalisation-General subscale of the Sociocultural Attitudes Toward Appearance Questionnaire-3 (SATAQ-3) [41]; Greek translation: [42], a 9-item measure of the degree to which individuals internalise general appearance ideals. All items were rated on a 5-point scale (1 = strongly disagree, 5 = strongly agree). In the present study, McDonald’s ω for scores on this subscale was .94 (95% CI = .93, .95).

Demographics.

Participants were asked to provide their demographic details consisting of age, highest educational qualification, ethnicity, height, and weight. Height and weight data were used to compute BMI as kg/m2.

Procedures

Ethics approval was obtained from the relevant departmental ethics committee (approval code: EEBK ΕΠ 2022.01.74), and permission to modify the scale was obtained from the owner of the original Experience of Embodiment Scale. Participants were recruited via a Google Forms link that was promoted through advertisements placed on social media platforms. Those who expressed an interest were first asked to complete a pre-screener to determine eligibility for the study. Inclusion criteria included 18 years of age or older, their preferred language being Greek, and being a citizen or resident of the Republic of Cyprus. Those who met the inclusion criteria provided digital informed written consent after being presented with additional information about the study, including that participation was anonymous, voluntary, and without remuneration. All participants then completed a survey consisting of all the measures described above presented in a counter-balanced order (to control for order effects), and four attention checks placed randomly throughout the questionnaire. Internet Protocol (IP) addresses were checked to ensure that no participant completed the survey more than once. All data were collected between August and November 2022.

Statistical analyses

Data treatment.

Data used in the present study are provided in S1 File. To examine the dimensionality of EES scores, our aim was to initially compare the utility of CFA and ESEM models, before cross-validating these results. To ensure adequate subsample sizes for both sets of analyses, the total dataset was first split using a computer-generated random seed, resulting in two split-half subsamples (n = 467 and 466, respectively). There were no significant differences between the two split-halves in terms of age and BMI, nor were there significant differences in the distribution of ethnic groups and educational qualifications (results available from the corresponding author). There were no missing data in our dataset.

First split-half subsample.

CFA and ESEM representations of the EES. In the first split-half subsample, all analyses were conducted using Mplus 8.8’s [43] robust weighted least squares estimator with mean and variance adjusted statistics (WLSMV). In a first step, the a priori 6-factor model of the EES was estimated using CFA and ESEM. In the CFA model, EES ratings were respectively explained by six correlated latent factors without cross-loadings. In the ESEM solution, all cross-loadings were freely estimated using a confirmatory oblique target rotation procedure, allowing us to rely on an a priori specification of the main indicators of each factor and “targeting” all cross-loadings to be as close to zero as possible [14, 44]. Additionally, in order to control for the methodological artefact introduced by the negatively worded EES items [24, 45], CFA and ESEM models were also separately estimated with CU between the following items: #21 and 31 (from the Agency and Functionality factor); #28 and 30 (from the Experience and Expression of Sexual Desire factor); #15, 16, 18 and 23 (from the Attuned Self-Care factor); and #19 (from the Resisting Objectification factor). Composite reliability of EES latent factors was estimated using McDonald’s omega (ω) [46].

Model fit. Model fit was examined using the following fit indices [4749]: the root mean square error of approximation (RMSEA) and its 90% CI (values ≤ .08 indicate acceptable fit; ≤ .06 indicates good fit), the Tucker-Lewis index (TLI; values ≥ .90 indicate acceptable fit and > .95 indicate good fit), and the comparative fit index (CFI; values ≥ .90 indicate acceptable fit and > .95 indicate good fit). However, as highlighted by Morin et al. [13, 17], goodness-of-fit assessment is insufficient to guide model selection when contrasting ESEM and CFA. Therefore, Morin et al. [13, 17] also recommended carefully examining parameter estimates (i.e., loadings, cross-loadings, latent correlations, composite reliability) from ESEM and CFA models. Observation of reduced factor correlations in the ESEM solution coupled with generally well-defined factors presents additional evidence for the superiority of the ESEM solution over a similarly fitting CFA solution [13, 17].

Ethnic invariance. The model providing the optimal representation of the data (CFA or ESEM, with and without CU) was then retained for tests of measurement invariance across ethnicity in the following sequence [50]: (i) configural invariance; (ii) weak invariance (loadings); (iii) strong invariance (thresholds); (iv) strict invariance (uniquenesses); (v) invariance of CU (if the model with CU is retained); (vi) invariance of the latent variances/covariances; and (vii) invariance of latent mean factors. Model comparisons (i.e., with each model contrasted to the previous one) relied on changes (Δ) in CFI, TLI, and RMSEA. Invariance was supported when ΔCFI and ΔTLI were ≤ .01, and ΔRMSEA was ≤.015 [51, 52].

Differential item functioning and latent mean differences as a function of age and BMI. In a third step, a hybrid multiple indicators multiple causes (MIMIC) multiple-group model [5355] was used to examine: (a) differential item functioning (DIF), that is, direct associations between the predictors (age and BMI) and the EES item responses over-and-above the association between the predictors and the EES latent factors; (b) the associations between predictors (age and BMI) and EES latent factors; and (c) the equivalence of these associations across the two ethnic groups (Greek and Greek-Cypriot). These models were developed from the most invariant multiple-group model identified in the ethnic invariance test, to which the age and BMI were included. Specifically, hybrid MIMIC models were estimated in the following sequence [18, 19]: (a) null effects model (paths from the predictors to the EES latent factors and item responses were constrained to be zero); (b) saturated model (paths from the predictors to the EES item responses were freely estimated, while paths from the predictors to the EES latent factors were constrained to be zero); and (c) factors only model (paths from the predictors to the EES latent factors were freely estimated, while paths from the predictors to the EES item responses were constrained to be zero). To ease interpretations, age and BMI were standardised prior to analyses. A substantial improvement in model fit (ΔCFIs-ΔTLIs > .01 and ΔRMSEAs >. 015 [55], in the factors-only and saturated models relative to the null effects model provides support for an association between predictors and the EES item responses. Additionally, improvement in model fit for the saturated model relative to the factors-only model provides support for DIF. These models were studied with all associations freely estimated across the Greek and Greek-Cypriot subsamples. Then, the most appropriate model was retained and compared to an alternative model in which all associations were constrained to be equal across Greek and Greek-Cypriot respondents.

Second split-half subsample.

Higher-order and bifactor representations of the EES. In the second split-half subsample, all analyses were conducted using Mplus 8.8’s [43] robust WLSMV. In a first step, the a priori 6-factor model of the EES was estimated using CFA and ESEM as described in 2.4.2.1. Higher-order representation (HO-CFA and HO-ESEM) of the EES was estimated using six a priori first-order factors (PBCC, BUA, AF, EESD, ASC, and RO) and one second-order factor (HO of experience of embodiment). The HO-ESEM was estimated using ESEM-within-CFA as recommended by Morin and Asparouhov [56]. Bifactor representation of the EES (B-CFA and B-ESEM) comprised one more factor than their CFA and ESEM counterparts. In these models, all factors were specified as orthogonal [13, 17] and all items had a main loading on both a global factor (G-factor of experience of embodiment) and on their six specific factors (S-factors: PBCC, BUA, AF, EESD, ASC and RO). Additionally, based on results obtained in the first split-half subsample, models were estimated with or without CU. Finally, McDonald’s ω [46] was used to estimate composite reliability of EES latent factors.

Model fit. Fit indices used to identify the optimal model were identical to those reported above. As highlighted by Morin et al. [13, 17] goodness-of-fit assessment is insufficient to guide model selection when contrasting CFA, ESEM, HO-CFA, HO-ESEM, B-CFA, and B-ESEM solutions. Instead, Morin et al. [13, 17] recommended a careful examination of parameter estimates (i.e., loadings, cross-loadings, latent correlations, composite reliability) from the various models. This comparison begins with a comparison of the CFA and ESEM models, where the observation of reduced factor correlations in the ESEM solution coupled with generally well-defined factors provides evidence in favour of the ESEM solution over a similarly fitting CFA solution [13, 17]. Next, the retained model should be contrasted to its higher-order and bifactor counterparts. In this second comparison, the observation of a well-defined G-factor coupled with at least a subset of well-defined S-factors supports the superiority of the bifactor solution over a similarly fitting first-order or higher-order solution [13, 17].

Ethnic invariance, DIF, and latent mean differences as function of age and BMI. These analyses were performed with the model providing the most optimal representation of the data (CFA, B-CFA, HO-CFA, ESEM, HO-ESEM, and B-ESEM), using the same strategies as those reported in Section 2.4.2.3.

Construct validity. Construct validity was examined in the total sample using a structural equation model (SEM) in which the EES factor structure was estimated based on model providing optimal representation of the data. In this model, the EES latent factors and the observed scores of convergent or concurent measures were all correlated. Correlations values ≤ .10 were considered weak, ~ .30 moderate, and ~ .50 strong [57].

Results

First split-half subsample

CFA and ESEM representations of the EES.

Goodness-of-fit indices of all measurement models are reported in Table 1. The 6-factor CFA solution had poor fit to the data (TLI < .90 and RMSEA > .08), whereas the 6-factor CFA-CU reached acceptability for CFI and TLI (> .90), but not for RMSEA (> .08). Both ESEM models (with and without CU) showed substantial improvement in fit relative to their CFA counterparts (ESEM: ΔCFI = +.051, ΔTLI = +.039, ΔRMSEA = -.020; ESEM-CU: ΔCFI = +.045, ΔTLI = +.037, ΔRMSEA = -.020). Additionally, the 6-factor ESEM-CU solution had an improved level of fit (ΔCFI = +.008, ΔTLI = +.007, ΔRMSEA = -.004) relative to its non-CU counterpart. Although these results lend preliminary support to the ESEM-CU solution relative to the CFA-CU solution, we followed Morin et al.’s [13, 17] suggestions, turning our attention to the parameter estimates from these solutions.

thumbnail
Table 1. Goodness-of-fit statistics for the Experience of Embodiment Scale (EES).

https://doi.org/10.1371/journal.pone.0303268.t001

Parameter estimates for the 6-factor CFA-CU and 6-factor ESEM-CU solutions are reported in S1 and S2 Tables1 in S1 File. In the 6-factor CFA-CU solution, factor loadings were all reasonably high (PBCC: Mλ = .854; BUA: Mλ = .680; AF: Mλ = .798; EES: Mλ = .833; ASC: Mλ = .712; RO: Mλ = .637), except for Item #19 on the RO factor. These factors presented acceptable coefficients of composite reliability (ω = .705 to .943, Mω = .869) and their latent correlations remained high (r = .354 to .867; Mr = .593).

In the 6-factor ESEM-CU solution, factor loadings were generally acceptable (PBCC: Mλ = .632; BUA: Mλ = .498; AF: Mλ = .718; EES: Mλ = .730; ASC: Mλ = .564; RO: Mλ = .608) and accompanied by reasonably small cross-loadings (Mλ = .107), with the exception of Items #3, 16, 19, 21, and 22. Item #3 from the BUA factor was more strongly associated with the PBCC factor; Item #16 from the ASC factor presented a similar pattern of associations with the BUA factor; Item #19 from the RO factor was more highly associated with the BUA factor; Item #21 from the AF scale presented a similar pattern of associations with the ASC factor; and Item #22 from the ASC factor presented a similar pattern of associations with the AF factor. The composite reliability coefficients of the six factors were adequate (ω = .718 to .923; Mω = .847). In contrast to the 6-factor CFA-CU solution, the latent factor correlations between scales were substantially reduced (r = .221 to .558; Mr = .352), thus supporting their distinguishability (see S2 Table in S1 File).

Ethnic invariance.

Goodness-of-fit statistics associated with the ESEM-CU solutions estimated separately in the Greek and Greek-Cypriot subsamples are presented in Table 1 (Models 2–1 and 2–2). These results revealed acceptable fit indices for all models (CFI and TLI > .90 or > .95; RMSEA ≤ .08). The goodness-of-fit statistics associated with the tests of measurement invariance conducted for the ESEM-CU (Models 2–3 to 2–9) provided support for complete measurement invariance (i.e., loadings, thresholds, uniqueness, CU, variances/covariances, and means) of the ESEM-CU model.

DIF as function of age and BMI.

Table 1 presents the results from the MIMIC models. These models were estimated starting from the most invariant model of the ethnic invariance test (model 2–9: invariance of means). Results revealed a substantial improvement in model fit in the saturated (model 3–2) and factors-only models (model 3–3) relative to the null effects model (model 3–1). This suggests that the predictors (age and BMI) are associated with EES responses. Additionally, the factors-only model resulted in a similar level of model fit compared to the saturated model (ΔCFI = -.001, ΔTLI = +.001, ΔRMSEA = -.001), supporting a lack of DIF as a function of predictors. Finally, the last model (model 3–4), built from the retained factors-only model, showed that relations between the predictors and the latent factors could be considered as equivalent across Greek and Greek-Cypriot subsamples.

Table 2 presents results from the invariant factors-only model. First, these results showed that age significantly and positively predicted scores on the BUA, ASC, and RO factors. More specifically, older participants tended to present significantly higher scores on these subscales. Second, BMI significantly and negatively predicted scores on the PBCC, BUA, EESD, and ASC subscales. Thus, individuals with higher BMIs tended to present significantly lower values on these subscales.

thumbnail
Table 2. Relations between the EES latent factors and the predictors in the first and second split-half subsamples.

https://doi.org/10.1371/journal.pone.0303268.t002

Second split-half subsample

Higher-order and bifactor representations of the EES.

Goodness-of-fit indices of all measurement models are reported in Table 1. The 6-factor CFA-CU solution had poor fit to the data (TLI < .90 and RMSEA > .08). Although the B-CFA-CU model reached acceptability (CFI and TLI > .90; RMSEA = .08), the HO-CFA-CU reached acceptability for CFI and TLI (> .90), but not for RMSEA (> .08). In contrast, the ESEM-CU, HO-ESEM-CU, and B-ESEM-CU solutions resulted in an acceptable fit to the data and in a level of fit that was substantially improved relative to their CFA-CU (ΔCFI = +.051, ΔTLI = +.041, ΔRMSEA = -.021), HO-CFA-CU (ΔCFI = +.053, ΔTLI = +.046, ΔRMSEA = -.024), and B-CFA-CU counterparts (ΔCFI = +.051, ΔTLI = +.052, ΔRMSEA = -.031). The comparison of the first-order, higher-order, and bifactor ESEM solutions suggested the superiority of the B-ESEM-CU compared to the ESEM-CU (ΔCFI = +.019, ΔTLI = +.030, ΔRMSEA = -.019) and HO-ESEM-CU solutions (ΔCFI = +.016, ΔTLI = +.023, ΔRMSEA = -.015). However, despite the results seeming to favour the B-ESEM-CU solution, as recommended by Morin et al. [13, 17], the selection of the optimal solution should be based on a careful examination of the parameter estimates, composite reliability, and factor correlations. To this end, the CFA-CU and ESEM-CU solutions were first contrasted, and then the most optimal of these representations with its higher-order and bifactor counterparts.

The detailed parameter estimates from all solutions are reported in S3-S8 Tables2 in S1 File. In the CFA-CU solution, the factor loadings of the EES were satisfactory (|λ| = .308-.939, Mλ = .701) and associated with acceptable composite reliability coefficients (ω = .716 to .936, Mω = .868). However, the factor correlations remained high (r = .563). In contrast, this factor correlation was substantially reduced in the ESEM solution (r = .334), suggesting that the slight level of overlap could in fact be explained by the presence of cross-loadings (M|λ| = .108). Nevertheless, although most cross-loadings remain negligible, the results also suggest that (a) Item #3 from the BUA subscale was more strongly associated with the PBCC subscale; (b) Item #17 from the PBCC subscale presented a nearly similar pattern of associations with the ASC subscale; (c) Item #19 from the RO subscale was more highly associated with the BUA subscale; and (d) Item #22 from the ASC subscale presented a nearly similar pattern of associations with the AF subscale. Finally, the ESEM solutions also resulted in generally well-defined (|λ| = .197-.894, Mλ = .618) and reliable latent factors (ω = .671 to .906, Mω = .841).

Based on these above results, the ESEM solution was favoured, and contrasted with the HO-ESEM-CU and B-ESEM-CU solutions. In the HO-ESEM-CU solution, the first-order factor loadings of the EES were generally acceptable (|λ| = .252-.901, Mλ = .618) and accompanied by reasonably small cross-loadings (Mλ = .107) with the exception of Items #3, 8,17, 19, and 22. The composite reliability coefficients of the six first-order factors were adequate (ω = .691 to .905, Mω = .844). Additionally, the second-order factor was well-defined by five of the subscales of the EES (|γ| = .532-.761, Mγ = .631), but weakly defined by the RO scale (γ = .293) suggesting that this scale might tap into a different construct. The composite reliability coefficient of the second-order factor was adequate (ω = .754).

The B-ESEM-CU solution resulted in a well-defined G-factor (|λ| = .053-.853, Mλ = .584) reflecting participants’ experience of positive embodiment, except for one item (#19) that remained substantial in two S-factors (BUA and RO). Additionally, the composite reliability of the G-factor was excellent (ω = .971) and higher than of the HO-ESEM-CU solution (ω = .754). Moreover, results revealed that: (a) the PBCC was less well defined (|λ| = .024-.674, Mλ = .282, ω = .692) and this could be attributed to four items (Items #8, 9, 11, and 17) that essentially serve to define the G-factor; (b) the BUA (|λ| = .221-.446, Mλ = .359, ω = .720) and ASC (|λ| = .218-.539, Mλ = .380, ω = .693) S-factors remained reasonably well-defined, but with weaker loadings values than those of the G-factor; (c) the AF (|λ| = .402-.738, Mλ = .535, ω = .846) and EESD (|λ| = .533-.704, Mλ = .598, ω = .834) S-factors remained well-defined and with similar loadings values to those of the G-factor; and (d) the RO (|λ| = .340-.729, Mλ = .592, ω = .710) S-factor remained well-defined and with higher loadings values than those of the G-factor. Finally, most cross-loadings were reduced (except for Items #3, 19, 22, and 34) in the B-ESEM-CU solution (M|λ| = .083) relative to the ESEM-CU and HO-CFA-CU (M|λ| = .107) solutions. Therefore, the present results support the B-ESEM-CU representation of the data (i.e., B-ESEM-CU resulted in an improved level of fit to the data compared to all other solutions; the G-factor of experience embodiment is a well-defined and the EES S-factors are reasonably well-defined).

Ethnic invariance.

Table 1 presents goodness-of-fit statistics associated with the B-ESEM-CU solutions estimated separately in the Greek and Greek-Cypriot subsamples (Models 5–1 and 5–2). These results revealed good fit indices for all models (CFI and TLI > .95; RMSEA ≤ .06). Additionally, the goodness-of-fit statistics associated with the tests of measurement invariance conducted for the B-ESEM-CU (Models 5–3 to 5–9) provided support for the complete measurement invariance (i.e., loadings, thresholds, uniqueness, CU, variances/covariances, and means) of the B-ESEM-CU solution.

DIF as function of age and BMI.

Results from the MIMIC models are reported in Table 1. These models were estimated starting from the most invariant model of the ethnic invariance test (model 5–9: invariance of means). Results revealed a substantial improvement in model fit in the saturated (model 6–2) and factors-only models (model 6–3) relative to the null effects model (model 6–1). This supports the idea that the predictors (age and BMI) are associated with EES responses. Additionally, the factors-only model resulted in a similar level of model fit compared to the saturated model (ΔCFI = -.001, ΔTLI = +.001, ΔRMSEA = .000), supporting a lack of DIF as a function of predictors. Finally, the last model (model 6–4), built from the retained factors-only model, showed that relations between the predictors and the latent factors could be considered equivalent across subsamples.

Table 2 presents result from the invariant factors-only model. First, these results showed that age significantly and positively predicted the G-factor and the BUA S-factor of the EES. Additionally, age significantly and negatively predicted the EESD S-factor of the EES. More specifically, older participants tended to present significantly higher values on the G-factor and the BUA S-factor, and significantly lower values on the EESD S-factor. Second, BMI significantly and negatively predicted the G-factor and the BUA S-factor of the EES. Additionally, BMI significantly and positively predicted the AF, ASC and RO S-factors of the EES. Thus, individuals with higher BMIs tended to present significantly lower values on the G-factor and the BUA S-factor, and higher values on the AF, ASC and RO S-factors.

Construct validity.

Goodness-of-fit statistics from the SEM including the EES latent factors (B-ESEM-CU model) and the other measures were acceptable: χ2(470) = 1570.347, CFI = .973, TLI = .955, RMSEA = .050 (90% CI = .047, .053). As illustrated in Table 3, the EES G-factor was significantly and (a) positively correlated with body appreciation, internalisation of appearance ideals, life satisfaction, perfectionism, and self-esteem; and (b) negatively correlated with eating restriction. Results for the PBCC and EESD S-factors showed significant and positive correlations with eating restriction. Additionally, results for the BUA S-factor also showed significant and (a) positive correlations with body appreciation, internalisation of appearance ideals, perfectionism and self-esteem; and (b) negative correlations with eating restriction and perfectionism. Moreover, results showed that the AF S-factor was significantly and positively correlated with all measures. In addition, the ASC S-factor was significantly and positively correlated with self-esteem, and negatively correlated with perfectionism. Finally, the RO S-factor was significantly and (a) positively correlated with body appreciation and internalisation of appearance ideals; and (b) negatively correlated with eating restriction, life satisfaction, and perfectionism.3

thumbnail
Table 3. Construct validity analyses from the bifactor exploratory structural equation modelling representation with correlated uniqueness of the EES in the overall sample.

https://doi.org/10.1371/journal.pone.0303268.t003

Discussion

The present study assessed the factorial validity and psychometric properties of a novel Greek translation of the EES in women from Cyprus. In broad outline, our results showed that a 6-factor B-ESEM model of EES scores that controls for CU had optimal fit and, additionally, was superior in terms of fit compared to all other models that were tested. Importantly, our results also indicated that CFA-based models generally had poor fit and, relative to ESEM models, had inferior fit. Beyond factorial validity, we also found that the B-ESEM-CU model was invariant across ethnicity, was not impacted by differential item functioning on the basis of respondent age and BMI, and generally showed adequate convergent, concurrent, and discriminant validity. Below, we begin by discussing the poor fit of CFA-based models before turning our attention to the optimal model of the EES in our sample.

CFA-based models had relatively poor fit

One key finding from the present study was that the 6-factor CFA model and the same model controlling for CU had poor fit to our data. Likewise, we also found that 6-factor CFA model that controlled for CU and that included a higher-order dimension (i.e., HO-CFA-CU) had poor fit, whereas the counterpart CFA model that included a bifactor only just about achieved adequate fit (i.e., B-CFA-CU). While scholars should avoid using fit indices as “golden rules” to judge model fit (e.g., [58]), these findings do not provide resounding support for CFA-based modelling of the Greek EES. Indeed, we might also note that the HO-CFA model tested by Piran and colleagues [7]) also had sub-par fit, which led the authors to introduce a correlation between Items #1 and 2 in order to achieve acceptable fit. However, such post hoc corrections are sub-optimal and may still hide misspecifications given the ability of CFA to absorb unmodelled cross-loadings through an inflation of factor correlations, without letting them impact model fit (e.g., [13, 17]).

In other words, the present findings are consistent with our suggestion that CFA-based models are problematic vis-à-vis the EES because they assume that each EES factor only loads onto their a priori latent factors and ignores the fact that EES items overlap across factors. Of course, one might be tempted to argue at this point that, given that the B-CFA-CU model had adequate fit, this model should be preferred over any other models precisely because subscale scores in these models can be viewed as representing domains of experience of embodiment [7]. However, we suggest that such an argument would be misplaced for three reasons. First, it ignores the fact that the EES items do overlap, and often quite substantively. Second, across CFA-based models, inter-factor correlations were moderate-to-high, suggesting a substantive degree of nomological overlap (i.e., the different “pure” factors are in fact measuring something common at a lower-order level). Third, and perhaps most importantly, CFA-based models consistently had relatively poorer fit compared to ESEM-based models.

ESEM-based models consistently had good fit

Our results showed that the ESEM-based models consistently had adequate fit to our data and relatively superior fit compared to the CFA-based models. In the first split-half subsample, both ESEM models (with and without CU) showed superior fit compared to their CFA counterparts, whereas in the second split-half subsample the B-ESEM-CU model had excellent fit to the data and was the best-fitting model of EES scores overall. On this basis alone, researchers should be encouraged to consider the possibility that ESEM-based models may provide a more optimal model of EES scores, but there are additional reasons to favour this structure over others. First, given that EES items do overlap across factors–sometimes substantially–ESEM-based models would seem to offer a more realistic and plausible account of the EES factor structure. Second, compared to the CFA-based solutions, latent factor correlations between subscales in the ESEM models were substantially reduced (i.e., the ESEM-based models appear to have reduced artificially inflated inter-factor correlations compared to CFA-based models, which in return reduces the degree or multicollinearity; [59]). Indeed, the fact that factor correlations were attenuated in the ESEM would seem to suggest that any nomological overlap is in fact being caused by the presence of cross-loadings, which CFA-based models ignore.

One potential objection to the ESEM-based models of EES scores is that they are relatively complex and, given this complexity, samples must be sufficiently large to conduct analyses. While we do not necessarily disagree, we also suggest that complex multidimensional scoring methods will be necessary for the future development of the EES and theoretical understandings of the experience of embodiment. Indeed, given that different scoring methods (i.e., CFA versus ESEM) conceptualise slightly different components of the experience of embodiment, researchers need to be aware of these differences and how they affect our ability to answer specific research questions. Likewise, if scholars are hopeful of using the EES to understand experiences of embodiment across social identity groups (e.g., sexual orientation, gender identity, nationality, etc.), where measurement invariance is a prerequisite, then they will need a model of EES that is robust, theoretically plausible, and conceptually meaningful.

Bifactor versus higher-order modelling

While the results from the second split-half subsample indicated that the B-ESEM-CU model had the best fit of the models tested, we also found that the HO-ESEM-CU had adequate fit. Given that both models achieved adequate fit, which should be preferred? We suggest there are several reasons to prefer the bifactor over the higher-order model. First, composite reliabilities of the G-factor in the bifactor model were substantively higher than the reliability of the counterpart higher-order EES factor. Second, cross-loadings were substantively reduced in the bifactor compared to the higher-order model. Finally, and similar to the findings of Piran and colleagues [7], the higher-order factor of EES scores was well-defined by only five of the six EES subscales (i.e., the RO subscale only weakly defined the higher-order construct, suggesting that this facet may tap a different construct when the experience of embodiment is modelled as a higher-order construct). In contrast, the S-factors were reasonably well-defined in the bifactor model and contributed to the G-factor, which represent the theoretical conceptualisation of the experience of embodiment.

Put differently, while the higher-order modelling of EES scores may be more convenient, this method may be less closely aligned with theoretical formulations of the experience of embodiment. Of course, one may suggest that, given that the RO factor was not theorised a priori [2], it is not a core facet of EES and could be discounted in future work. This is ultimately a theoretical discussion that goes beyond the present study, but our work suggests that modelling the EES using bifactor analysis would allow researchers to examine the role of overall embodiment (i.e., the G-factor), as well as the unique characteristics of all six facets of the experience of embodiment (i.e., the S-factors). It is also worth noting that the B-ESEM-CU model is not influenced by multicollinearity, as are the other multidimensional methods assessed here. Instead, in B-ESEM, all commonality between subscales is modelled through the G-factor and inter-factor correlations are constrained to zero.

Other findings

A clearer example of the potential nuance of the bifactor model can be seen in the relationships between EES scores and additional variables included in the present study. While the G-factor was significantly correlated with all additional variables largely in the expected directions, associations with S-factors were less clear-cut, with the BUA and AF S-factors most closely mirroring our hypothesised expectations. In contrast, associations with the additional S-factors were often attenuated and sometimes non-significant, suggesting that the B-ESEM-CU model is able to separate what is common versus specific across experience of embodiment facets (and, therefore, may offer a theoretically consistent approach to modelling the construct of the experience of embodiment). Overall, these findings suggest that the B-ESEM-CU model of EES scores has adequate construct validity, with one exception: the positive association (both with the G-factor and some S-factors) with internalisation of appearance ideals was in the opposite direction to what we predicted (similar results were also obtained with the ESEM-CU model). Previously, Kling et al. [8] reported negative associations between embodiment and internalisation of appearance ideals, so this finding could be more carefully examined in future research.

Our findings also add to the literature in two other ways. First, across both split-half subsamples, we found that the ESEM models of the EES (i.e., the ESEM-CU model in the first split-half and the B-ESEM-CU model in the second split-half) evidenced complete measurement invariance across the two ethnic groups represented in our sample. This can be taken as additional evidence that the modelling of the EES in this manner is robust, at least in the national context of Cyprus. Second, and perhaps more importantly, across both split-half subsamples, we found no evidence of DIF; that is, participants of different ages and BMIs do not appear to respond differently to particular items in the EES. This is important because it suggests that the EES may be suitable for completion by all adult age and BMI groups and measures the same latent constructs irrespective of these respondent characteristics. Importantly, however, we did find that older participants and participants with lower BMIs had higher G-factor scores. While this is an area that requires further research, these findings are consistent with the suggestion that embodiment is a lived process that is likely to be affected by the physical state of one’s corporeal body [25].

Limitations

The present findings should be considered in light of several limitations. First, in adopting the present analytic strategy, we sought to honour prior theoretical frameworks of the experience of embodiment [27] with empirical comprehensiveness. In adopting this strategy, however, we acknowledge that it is possible that an alternative factor structure may emerge as providing better fit to the data compared to the 6-factor B-ESEM-CU model. That is, our analytic strategy prioritises the theoretical underpinnings of the construct of experience of embodiment but does not necessarily allow us to test whether alternative models may explain the data better. We also cannot entirely rule out the possibility that our results are specific to the national context under investigation (i.e., Cyprus). However, given that previous work has not tested alternative models of the EES, as we have here, we suggest that it is incumbent on researchers to do so in previously examined national contexts.

Additionally, although the present study examined measurement invariance across participants who identified as Greek and Greek-Cypriot, we limited (for political and practical reasons) recruitment to the Republic of Cyprus (i.e., excluding respondents from Northern Cyprus, under Turkish occupation). Also, in terms of recruitment, our opportunistic method of recruitment means that our sample is unlikely to have been representative of the wider population of the Republic of Cyprus. We also did not collect additional information about our respondents, which may have been useful in terms of understanding experiences of embodiment, such as urbanicity and socioeconomic status [60]. As such, it would be useful in future research to recruit more representative samples of Cypriot adults, not to mention considering the extent to which the EES is invariant across factors such as socioeconomic status. Relatedly, it would also be useful to validate the Greek version of the EES in other Greek-speaking populations (e.g., in Greece). A final limitation is the fact that we did not assess test-retest reliability. Piran and colleagues [7] reported that EES scores were stable across a period of three weeks, but it would be useful to extend this by examining invariance of scores across time using the optimal model in the present study.

Conclusion

The present results suggest that a B-ESEM-CU model provides an alternative way of modelling EES scores, at least for adults in the Republic of Cyprus, although we suggest that this model is also likely to prove robust in other national contexts for the reasons we have discussed above. We appreciate that this model may appear (more) complex compared to the model favoured by the scale developers (i.e., a HO-CFA model), but given the initial stages of the development of this instrument in a cross-national context, we suggest that there is a need to more carefully consider how best to model EES scores and the implications of EES modelling for both theory and practice. Indeed, we do not present the criticisms of the EES and its scoring above because we seek to stifle research on the experience of embodiment. Rather, we believe strongly that theoretical rigour should be supported by empirical data, and our data suggest that there may be alternative ways of modelling EES scores compared to the model presently favoured by researchers.

Footnotes

1A power estimation was conducted using an α = .05, a Null RMSEA of .08, the sample size and models’ df and RMSEA values. Results revealed a power higher than 90% for both models.

2A power estimation was conducted and results revealed a power ranging from 80% to 100%.

3For comparison with previous studies, in S7 Table in S1 File, we also provide results taken from the ESEM-CU solution. Results showed significant correlations between all EES scales and other measures (except for BUA, ASC, RO and perfectionism).

Supporting information

S1 Appendix. Experience of Embodiment Scale in English and Greek.

https://doi.org/10.1371/journal.pone.0303268.s001

(DOCX)

S1 File. Supplementary tables for EES factor analysis representations.

https://doi.org/10.1371/journal.pone.0303268.s002

(DOCX)

S3 File. STROBE statement—checklist of items that should be included in reports of observational studies.

https://doi.org/10.1371/journal.pone.0303268.s004

(DOCX)

References

  1. 1. Allan HT. Gender and embodiment in nursing: the role of the female chaperone in the infertility clinic. Nurs Inq. 2005;12:175–183. pmid:16083468
  2. 2. Piran N. Embodied possibilities and disruptions: the emergence of the experience of embodiment construct from qualitative studies with girls and women. Body Image. 2016;18:43–60. pmid:27236476
  3. 3. Piran N. Journeys of embodiment at the intersection of body and culture: the developmental theory of embodiment. London: Academic Press; 2017.
  4. 4. Piran N. The experience of embodiment construct: reflecting the quality of embodied lives. In: Tylka TL, Piran N, editors. Handbook of positive body image and embodiment. Oxford: Oxford University Press; 2019. pp. 11–21. https://doi.org/10.1093/med-psych/9780190841874.003.0002
  5. 5. Piran N, Counsell A, Teall TL, Komes J, Evans EH. The developmental theory of embodiment: quantitative measurement of facilitative and adverse experiences in the social environment. Body Image. 2023;44:227–245. pmid:36610894
  6. 6. Piran N, Teall TL. The developmental theory of embodiment. In: McVey GL, Levine MP, Piran N, Ferguson HB, editors. Preventing eating-related and weight-related disorders: collaborative research, advocacy, and policy change. Waterloo: Wilfrid Laurier Press; 2012. pp. 171–199.
  7. 7. Piran N, Teall TL, Counsell A. The Experience of Embodiment Scale: Development and psychometric evaluation. Body Image. 2020;34:117–134. pmid:32554242
  8. 8. Kling J, Counsell A, Frisén A, Holmqvist Gattario K, Piran N. Translation and psychometric evaluation of the Experience of Embodiment Scale in a Swedish community sample of young women and men. Body Image. 2021;39:259–265. pmid:34655860
  9. 9. Munroe M. Positive embodiment for wellbeing researchers and practitioners: A narrative review of emerging constructs, measurement tools, implications, and future directions. Int J Wellbeing. 2022;12:134–162.
  10. 10. Asparouhov T, Muthén B, Morin AJS. Bayesian structural equation modeling with cross-loadings and residual covariances: comments on Stromeyer et al. J Manag. 2015;41:1561–1577.
  11. 11. Marsh HW, Muthén B, Asparouhov T, Lüdtke O, Robitzsch A, Morin AJS, et al. Exploratory structural equation modeling, integrating CFA and EFA: application to students’ evaluations of university teaching. Struct Equ Model. 2009;16:439–476.
  12. 12. Marsh HW, Morin AJS, Parker PD, Kaur G. Exploratory structural equation modeling: an integration of the best features of exploratory and confirmatory factor analysis. Annu Rev Clin Psychol. 2014;10:85–110. pmid:24313568
  13. 13. Morin AJS, Arens AK, Marsh HW. A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Struct Equ Model. 2016;23:116–139.
  14. 14. Asparouhov T, Muthén B. Exploratory structural equation modeling. Struct Equ Model. 2009;16:397–438.
  15. 15. Marsh HW, Liem GAD, Martin AJ, Morin AJS, Nagengast B. Methodological measurement fruitfulness of exploratory structural equation modeling (ESEM): new approaches to key substantive issues in motivation and engagement. J Psychoeduc Assess. 2011;29:322–346.
  16. 16. Marsh HW, Guo J, Dicke T, Parker PD, Craven RG. Confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), and Set-ESEM: optimal balance between goodness of fit and parsimony. Multivar Behav Res. 2020;55:102–119. pmid:31204844
  17. 17. Morin AJS, Myers ND, Lee S. Modern factor analytic techniques: bifactor models, exploratory structural equation modeling (ESEM), and bifactor‐ESEM. In: Tenenbaum G, Eklund RC, editors. Handbook of sport psychology. London: Wiley; 2020. pp. 1044–1073. https://doi.org/10.1002/9781119568124.ch51
  18. 18. Marsh HW, Nagengast B, Morin AJS. Measurement invariance of Big-Five factors over the life span: ESEM tests of gender, age, plasticity, maturity, and la dolce vita effects. Dev Psychol. 2013;49:1194–1218. pmid:22250996
  19. 19. Morin AJS, Marsh HW, Nagengast B. Exploratory structural equation modeling. In Hancock GR, Mueller RO, editors. Structural equation modeling: A second course. Charlotte, NC: Information Age; 2013, pp. 395–436.
  20. 20. Brunet J, Gunnell KE, Teixeira P, Sabiston CM, Bélanger M. Should we be looking at the forest or the trees? Overall psychological need satisfaction and individual needs as predictors of physical activity. J Sport Exerc Psychol. 2016;38:317–330. pmid:27736369
  21. 21. Gignac GE. The higher-order model imposes a proportionality constraint: That is why the bifactor model tends to fit better. Intelligence. 2016;55:57–68.
  22. 22. Gillet N, Morin AJS, Huart I, Colombat P, Fouquereau E. The forest and the trees: investigating the globality and specificity of employees’ basic need satisfaction at work. J Pers Assess. 2020;102:702–713. pmid:31012751
  23. 23. Sliter KA, Zickar MJ. An IRT examination of the psychometric functioning of negatively worded personality items. Educ Psychol Meas. 2014;74:214–226.
  24. 24. Marsh HW. Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? J Pers Soc Psychol. 1996;70:810–819. pmid:8636900
  25. 25. Harvey K. Epochs of embodiment: men, women and the material body. J Eighteenth-Century Stud. 2019;42:455–469.
  26. 26. Swami V, Maïano C, Wong KY, Zahari HS, Barron D. Psychometric properties of a Bahasa Malaysia (Malay) translation of the Body and Appearance Self-Conscious Emotions Scale (BASES): an assessment using exploratory structural equation modelling. Body Image. 2021;39:293–304. pmid:34739921
  27. 27. Maïano C, Morin AJS, Aimé A, Lepage G, Bouchard S. Psychometric properties of the Body Checking Questionnaire (BCQ) and of the Body Checking Cognitions Scale (BCCS): a bifactor-exploratory structural equation modeling approach. Assessment. 2021;28:632–646. pmid:31328530
  28. 28. Swami V, Maïano C, Morin AJS. A guide to exploratory structural equation modeling (ESEM) and bifactor-ESEM in body image research. Body Image. 2023;47:101641.
  29. 29. Holmqvist Gattario K, Frisén A, Teall TL, Piran N. Embodiment: cultural and gender differences and associations with life satisfaction. Body Image. 2020;35:1–10. pmid:32877841
  30. 30. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186–3191. pmid:11124735
  31. 31. Tylka TL, Wood-Barcalow NL. The Body Appreciation Scale-2: Item refinement and psychometric evaluation. Body Image. 2015;12:53–67. pmid:25462882
  32. 32. Argyrides M. The Body Appreciation Scale-2: Translation and validation in the Greek language. Eur J Couns Psychol. 2020;8:108–117.
  33. 33. Rosenberg M. Society and the adolescent self-image. Princeton, NJ: Princeton University Press; 1965.
  34. 34. Galanou C, Galanakis M, Alexopoulos E, Darviri C. Rosenberg Self-Esteem Scale: Greek validation on student sample. Psychology. 2014;05:819–827.
  35. 35. Diener E, Emmons RA, Larsen RJ, Griffin S. The Satisfaction with Life Scale. J Pers Assess. 1985;49: 71–75. pmid:16367493
  36. 36. Lyrakos GN, Xatziagelaki E, Papazafiropoulou AK, Batistaki C, Damigos D, Mathianakis G, et al. Translation and validation study of the Satisfaction With Life Scale (SWLS) in Greek general population, diabetes mellitus and patients with emotional disorders. Eur Psychiatry. 2013;28:1.
  37. 37. Fairburn CG, Beglin SJ. Assessment of eating disorders: interview or self-report questionnaire? Int J Eat Disord. 1994;16:363–370. pmid:7866415
  38. 38. Giovazolias T, Tsaousis I, Vallianatou C. The factor structure and psychometric properties of the Greek version of the Eating Disorders Examination Questionnaire (EDE-Q). Eur J Psychol Assess. 2013;29:189–196.
  39. 39. Slaney RB, Rice KG, Mobley M, Trippi J, Ashby JS. The Revised Almost Perfect Scale. Meas Eval Couns Dev. 2001;34:130–145.
  40. 40. Diamantopoulou G, Platsidou M. Factorial validity and psychometric properties of the Greek version of the Almost Perfect Scale Revised (APS-R). Hell J Psychol. 2014;11:123–137.
  41. 41. Thompson JK, van den Berg P, Roehrig M, Guarda AS, Heinberg LJ. The Sociocultural Attitudes Towards Appearance Scale-3 (SATAQ-3): Development and validation. Int J Eat Disord. 2004;35: 293–304. pmid:15048945
  42. 42. Argyrides M, Kkeli N, Kendeou P. Validation of the factor structure of the Greek adaptation of the Sociocultural Attitudes Towards Appearance Questionnaire (SATAQ-3). Body Image. 2014;11:201–205. pmid:24958653
  43. 43. Muthén LK, Muthén B. Mplus user’s guide. Muthén & Muthén; 2022.
  44. 44. Browne MW. An overview of analytic rotation in exploratory factor analysis. Multivar Behav Res. 2001;36:111–150.
  45. 45. Marsh HW, Scalas LF, Nagengast B. Longitudinal tests of competing factor structures for the Rosenberg Self-Esteem Scale: Traits, ephemeral artifacts, and stable response styles. Psychol Assess. 2010;22:366–381. pmid:20528064
  46. 46. McDonald RP. The theoretical foundations of principal factor analysis, canonical factor analysis, and alpga factor analysis. Br J Math Stat Psychol. 1970;23:1–21.
  47. 47. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.
  48. 48. Marsh HW, Hau K-T, Grayson D. Goodness of fit in structural equation models. In Maydeu-Olivares A, McArdle JJ, editors. Contemporary psychometrics: A festschrift for Roderick P. McDonald. London: Lawrence Earlbaum, 2005; 275–340.
  49. 49. Swami V, Barron D. Translation and validation of body image instruments: Challenges, good practice guidelines, and reporting recommendations for test adaptation. Body Image. 2019;31:204–220. pmid:30220631
  50. 50. Morin AJS, Moullec G, Maïano C, Layet L, Just J-L, Ninot G. Psychometric properties of the Center for Epidemiologic Studies Depression Scale (CES-D) in French clinical and nonclinical adults. Rev Epidemiol Santé Publique. 2011;59:327–340. pmid:21925817
  51. 51. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model. 2007;14:464–504.
  52. 52. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9:233–255.
  53. 53. Maïano C, Thibault I, Dreiskämper D, Henning L, Tietjens M, Aimé A. Psychometric properties of the French and German versions of the Physical Self-Concept Questionnaire for Elementary School Children–Revised (PSCQ-C-R). Meas Phys Educ Exerc Sci. 2023;27:181–194.
  54. 54. Maïano C, Aimé A, Almenara CA, Gagnon C, Barrada JR. Psychometric properties of the Teruel Orthorexia Scale (TOS) among a French–Canadian adult sample. Eat Weight Disord. 2022;27:3457–3467. pmid:36180717
  55. 55. Morin AJS, Maïano C, Scalas LF, Aşçı FH, Boughattas W, Abid S, et al. Cross-cultural validation of the short form of the Physical Self Inventory (PSI-S). Sport Exerc Perform Psychol. 2018;7:60–79.
  56. 56. Morin AJS, Asparouhov T. Estimation of a hierarchical exploratory structural equation model (ESEM) using ESEM-within-CFA. Montreal, QC: Substantive Methodological Synergy Research Laboratory.
  57. 57. Cohen J. A power primer. Psychol Bull. 1992;112:155–159. pmid:19565683
  58. 58. Perry JL, Nicholls AR, Clough PJ, Crust L. Assessing model fit: Caveats and recommendations for confirmatory factor analysis and exploratory structural equation modeling. Meas Phys Educ Exerc Sci. 2015;19:12–21.
  59. 59. Guay F, Morin AJS, Litalien D, Valois P, Vallerand RJ. Application of exploratory structural equation modeling to evaluate the Academic Motivation Scale. J Exp Educ. 2015;83:51–82.
  60. 60. Argyrides M, Sivitanides M. Body image, self-esteem, media, disordered eating and actual ideal weight discrepancy: Findings in Cyprus. Eur J Couns Psychol. 2017;6:63–74.