Figures
Abstract
Researchers continue to explore ways to understand and promote pro-environmental behavior (PEB) amongst various populations. Despite this shared goal, much debate exists on the operationalization and the dimensionality of PEB and how it is measured. This piecemeal approach to measurement has limited the ability to draw conclusions across studies. We address limitations associated with previous measures of PEB by developing a multi-dimensional scale that is validated across both a general population of individuals residing in the United States as well as a group of individuals associated with a pro-environmental organization. Exploratory and confirmatory factor analyses and reliability estimation were conducted for the developed measure across these two populations. Measurement invariance testing was also utilized to assess the psychometric stability of the scale across the two groups. Results indicated an 11 item scale was best fitting with two sub-scales: private and public behaviors. Implications for research and practice are discussed.
Citation: Mateer TJ, Melton TN, Miller ZD, Lawhon B, Agans JP, Taff BD (2022) A multi-dimensional measure of pro-environmental behavior for use across populations with varying levels of environmental involvement in the United States. PLoS ONE 17(10): e0274083. https://doi.org/10.1371/journal.pone.0274083
Editor: Carlos Andres Trujillo, Universidad de Los Andes, COLOMBIA
Received: August 23, 2021; Accepted: August 22, 2022; Published: October 4, 2022
This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Data Availability: All relevant data are within the paper and its Supporting information files.
Funding: The authors received support for this research from the Leave No Trace Center for Outdoor Ethics (https://lnt.org/). As one of the co-authors of this manuscript is employed by the supporting organization, the funder had a role in study design, data collection, and manuscript preparation.
Competing interests: The authors have declared that no competing interests exist.
1. Introduction
As social-ecological systems continue to be plagued by multi-faceted, “wicked” environmental problems [1, 2], human behavior exists at the forefront of many of these environmental issues as well as their solutions [3, 4]. Given all human behavior impacts the natural world either directly or indirectly [5], environmental psychologists and environmental social psychologists are often at the forefront of efforts to understand and reduce the adverse ecological impacts associated with human behavior in various ways [6]. In linking human behavior to its environmental impacts, a variety of terms have been used in the academic literature including environmentally responsible behavior [7], environmentally significant behavior [5], general ecological behavior [8], and pro-environmental behavior (PEB) [9, 10], the latter of which will be used throughout this study. As PEB becomes better understood and promoted, social-ecological systems can become more sustainable and resilient as well.
Measuring PEB effectively has significant implications for designing educational and psychological interventions aiming to encourage sustainable behavior within various populations [3, 11]. Be it an examination of barriers to acting in a pro-environmental manner [12] or formulating interventions to shift habitual behaviors towards more environmentally-friendly practices [13], environmental psychology has established itself as a major contributor to the conversation around behavioral change and environmentalism. While this body of research contributes important insight into how and why people behave in a pro-environmental manner, research on PEB has been broadly limited by inconsistencies in how it has been measured across studies. While some studies require researchers to measure specific, isolated behaviors [14, 15], many studies aim to understand how other social or psychological factors are related to more generalized PEB [16, 17]. The latter category is specifically constrained by many studies utilizing varied measures of general PEB. For example, [18] asserts that in a review of 49 studies measuring PEB through multi-item scales, 42 unique scales were utilized. As [19] further note, “many of these scales are ad hoc measures of unknown psychometric quality that have been developed for a particular research project” (p. 93). Such practices do not diminish the unique findings of these various studies, but the field of environmental psychology is limited in its understanding of broader trends due to this piecemeal approach to measurement.
In looking to other established scales in the field of environmental psychology, standardized measurements allow for findings to be more easily generalized for other psychological and behavioral constructs. For example, the New Ecological Paradigm represents a “gold standard” for measuring environmental attitudes that is broadly used across studies [20]. Similarly, Clayton’s Environmental Identity scale [21] represents a general measure of environmental identity that is also utilized regularly (also see [22] for an updated environmental identity measure). Regarding measures of PEB specifically, [19] assert the General Ecological Behavior scale [8] “can probably be considered the best established of these domain-general propensity measures” (p. 93). However, this scale, while having advanced PEB research considerably in the past two decades, contains some measures which may be considered outdated or only tangentially linked to PEB (e.g., “If possible, I do not insist on my right of way and make the traffic stop before entering a crosswalk”). Given social and cultural perceptions of PEB have evolved in the two decades since the General Ecological Behavior scale was developed, updated measures of PEB have been created but display some limitations when being utilized in general populations. For example, some have been developed for specific sub-groups [23] or have displayed tenuous reliability and validity by categorizing behaviors by their environmental impact rather than their psychological properties [18].
Many scales measuring general PEB in the field of environmental psychology have been utilized in populations with a range of environmental orientations, values, and attitudes [16, 17, 24–26]. If a general PEB scale is to be effectively employed across these disparate groups, it should be developed and tested amongst the various populations within which it will ultimately be utilized [27]. With that in mind, this study aims to develop an updated measure of general PEB for both a general population of individuals living in the United States and a population associated with a pro-environmental organization (sampled from the Leave No Trace Center for Outdoor Ethics, to be discussed later). Furthermore, measurement invariance testing examines the psychometric stability of the developed scale across the two groups [28]. While we specifically develop this general PEB scale in the social, cultural, and infrastructural context of the United States, it may also potentially provide a basis for measuring general PEB in other countries as well.
2. Literature review
2.1 Understanding and measuring pro-environmental behavior
Understanding and promoting PEB has been a central topic in the field of environmental psychology [5, 9, 10, 19, 29]. While prior research focused heavily on these environmentally-focused behaviors, some debate exists in the field about what is and is not considered PEB [30]. For example, Stern [5] adopts an intention-oriented approach to understanding PEB, stating it is “defined from the actor’s standpoint as behavior that is undertaken with the intention to change (normally, to benefit) the environment” (p. 408). Alternatively, Steg and Vlek [11] assert that PEB consists of actions taken that benefit or minimize the harm done to the natural environment, with the intention behind the behavior not being as heavily emphasized in their definition. As exemplified by Truelove and Gillis [9], other motivations such as saving money or benefiting one’s health may also encourage individuals to shift their behaviors in a pro-environmental manner. Given these divergent definitions, there may be some behaviors that would fit into one of the provided definitions of PEB but not the other (e.g., riding a bike to work specifically to save money on gas would likely not fall under Stern’s [5] definition of PEB but would be encompassed by that provided by Steg and Vlek [11]). Many recent studies [12, 18, 19, 23] have endorsed a conceptualization of PEB similar to that provided by Steg and Vlek [11], recognizing that benefits to the natural environment exist regardless of the social or psychological pathway that encourages their enactment [3, 10, 31, 32]. Expanding our understanding of PEB beyond an intention-oriented conceptualization allows for PEB to be encouraged through multiple pathways [4, 13, 31].
In conjunction with the debate on how to define PEB within the academic literature, other studies have also explored the social and psychological pathways of enacting general PEB and how these pathways influence the frequency at which different categories of behaviors are enacted [5, 23, 33, 34]. While many studies have aimed to measure general PEB through improvised unidimensional scales [17, 25, 35], such approaches fail to recognize the various factors that may inhibit or facilitate individuals’ enactment of some forms of PEB in comparison to others [9, 12, 34]. As Larson et al. [23] outline, behavioral difficulty, structural factors, and social influences all may influence whether certain clusters of behaviors more or less likely to be carried out by specific individuals. For example, individuals living in a city with a well-established recycling system may easily be able to enact that specific PEB but may have difficulty enacting another behavior such as biking to work due to a lack of accessible bike lanes in the area.
As certain behaviors may be easier or more difficult to enact for various populations, it is imperative to develop tools for measuring PEB within the populations with which they will be ultimately utilized [36–39]. This is generally done by utilizing sub-scales to represent the real-world differences in how different clusters of behaviors are enacted as a result of various psychological, social, and infrastructural factors. Each sub-scale is utilized to capture a different dimension of general PEB. The heterogeneity in PEB scales developed within different populations may provide insight into this divergent dimensionality of environmentally-oriented behaviors (see the Supplementary Materials of Lange and Dewitte [19] for an extensive list of previously developed PEB scales and their various dimensions). For example, Gkargkavouzi et al. [33] found PEB to exist as six unique factors within a population of Greek citizens: civic actions, policy support, transportation choices, household setting, and consumer behavior. Alternatively, Larson et al. [23] found four dimensions of PEB within residents living in rural communities of the United States: conservation lifestyle, land stewardship, social environmentalism, and environmental citizenship. It is likely that the various social, infrastructural, and psychological contexts unique to these communities influence the dimensionality of how PEB is perceived and enacted [9, 23, 40]. Extensive research has aimed to understand PEB across groups with varying psychological and social orientations to the natural world [10, 41, 42], but a scale measuring general PEB has not been developed across these disparate groups.
2.2 Scale development theory
There is an overall need for researchers to psychometrically evaluate measures prior to their use, an approach that has frequently been lacking in research examining PEB. To confidently identify what behaviors contribute to an individual’s PEB, researchers must utilize scales that have demonstrated both their reliability and accuracy in measuring the construct of interest [27]. Psychometric testing, which examines a scale’s reliability and validity, establishes confidence in the ability of a scale to accurately capture information on the construct researchers hope to be measuring; it is, therefore, a critical first step to conducting research. This notion of validity, or accuracy of the measure, is not absolute [43]. Although researchers often discuss the fact that the validity of a scale can be evaluated for a specific purpose, such as measuring an individual’s tendency to engage in PEB, the validity of a measure may differ based on the population included in the study as well [37, 43].
Not only does one’s context influence the behaviors with which they engage, constructs are understood and operationalized differently based on an individual’s setting and culture [36, 37]. For this reason, researchers [27] argue for the importance of evaluating the quality of a measure in the population within which findings are to be generalized, and caution against extending research to different groups without first testing that the instrument functions equally well within that specific population [38, 39]. However, previous PEB scales have mostly been developed within either a convenience sample of university students [18] or through online survey panels [44]. When adopted for other research, these PEB scales are generally utilized in populations that vary greatly from the populations used for scale development.
3. Study purpose
Given the various limitations associated with measuring PEB in the field of environmental psychology, the ability to extend findings to inform psychologically-grounded interventions to promote desired behaviors is also constrained [9]. This is especially important as research interest continues to grow around processes that support the adoption of PEB generally, such as promoting behavioral spillover [45, 46]. Lange and Dewitte [19] note that self-reported PEB measures are primarily used by personality psychologists aiming to connect these measures to other psychological constructs such as environmental values and identity, emphasizing the importance of using self-reported behavioral measures that are psychologically grounded as well. Taken collectively, there is a clear need to design a PEB scale rooted in the social and psychological processes of the communities within which they will be utilized, both to promote more effective research as well as to help practitioners design more effective psychological interventions. Given this need, we aimed to develop a scale that measures a breadth of meaningful PEB while also considering the psychological dimensions of these behaviors. Specifically, we aim to establish a PEB scale that is psychometrically sound both within the general population of the United States and for a population of individuals sampled from a pro-environmental organization also based in the United States. In specifically sampling individuals from a pro-environmental organization, we surveyed individuals from the Leave No Trace Center for Outdoor Ethics, a prominent non-profit organization promoting responsible outdoor recreation behaviors in the United States [47]. This organization was intentionally chosen as the source of one of the two samples as outdoor recreation involvement and pariticpation in environmental groups has been linked to pro-environmental attitudes and behaviors in previous research [42, 48, 49]. Given many studies aim to understand and compare PEB within populations that have various social and psychological orientation towards the natural world [25, 26, 35, 48], this study aims to develop a scale that is psychometrically stable and useful across these different populations. This study was specifically informed by the following three research questions:
- RQ1: What self-reported behaviors form a reliable and valid measure of general PEB within the unique social, cultural, and infrastructural context of the United States?
- RQ2: What unique dimensions of general PEB are best represented as sub-scales within the general measure of PEB that is developed?
- RQ3: What measures of general PEB form a psychometrically stable scale across a population of individuals sampled from a pro-environmental organization and a population of individuals sampled to represent the general population of the United States?
4. Methods
All research procedures that involved human subjects were approved by the Pennsylvania State University Institutional Review Board (STUDY00015401). Oral or written consent was not obtained as all data were analyzed anonymously.
4.1 Preliminary scale development
Initial scale items were aggregated from a range of previous studies measuring various aspects of PEB [8, 17, 18, 23, 50, 51]. These studies were intentionally reviewed by experts in the field of environmental psychology, communication, and education [27] to determine the breadth of behaviors that fall within Steg and Vlek’s [11] impact-oriented definition of PEB. This definition was considered simultaneously with the variety of ways previous research has attempted to characterize PEB such as activist-oriented behaviors [52], land stewardship [23, 53, 54], private-sphere behaviors [5], and socially-oriented behaviors [55]. After reviewing how PEB was measured in these previous studies, 27 initial scale items were extracted to represent a range of potential behaviors for preliminary analysis. These initial items are outlined in S1 Appendix. For these scale items, individuals were prompted to “Please rate how frequently you have participated in the following activities by selecting the appropriate point from the scale below.” Seven Likert-scale response options were provided ranging from “Never” to “As frequently as possible.”
These initial items were piloted within a population of 305 individuals recruited from Qualtrics market research panels [56]. All research processes for this pilot study, as well as subsequent data collection and analyses, were approved by the Pennsylvania State University Institutional Review Board. A quota sampling approach [57] was utilized to match recruited individuals to several broader demographic characteristics of the United States population as determined by the United States Census Bureau [58]. Specifically, demographic variables were matched for age, gender, and household income, each of which has been found to influence pro-environmental behavior in previous research [29].
Given that the goal of this preliminary test was to determine an initial scale for more rigorous analysis within two larger populations (one representing the general population of the United States and one sampled from a pro-environmental organization), this study phase utilized both exploratory and confirmatory techniques to eliminate redundant items as well as those that did not fit well within the psychometric properties relative to the broader scale. Specifically, descriptive statistics, exploratory factor analyses, confirmatory factor analyses, and reliability analyses were all used to examine the psychometric properties of these initial items. For more information on analysis processes and sample demographics, please see S2 Appendix. A final confirmatory factor analysis was primarily utilized at this stage to indicate preliminary discriminant validity for the scale [59]. Discriminant validity indicates the underlying sub-scale structure of a survey, which can be displayed through item loadings and latent construct relationships of a confirmatory factor analysis [60]. Items retained following this pilot study, including sub-scale structure, reliability statistics, and results from the confirmatory factor analysis are outlined in Table 1.
4.2 Sample populations
Following the pilot study, two primary samples were utilized to further develop the preliminary scale outlined in the previous section: a larger online sample representative of the United States population and a sample of individuals recruited from the Leave No Trace Center for Outdoor Ethics email list. For the representative sample of United States residents, 1043 individuals residing in the United States were recruited from Qualtrics market research panels [56], referred to as QUAL from here onward. Age, gender, race/ethnicity, and household income were matched using a quota sampling procedure [57] to demographic information collected from the United States census [58]. Like the other demographic variables, race/ethnicity has been found to potentially influence environmental concern in previous research [61], therefore an additional quota for race/ethnicity was intentionally added after the large percentage of White respondents was recruited from Qualtrics for the pilot study. Surveys were also distributed to an email list of 22,180 individuals provided by the Leave No Trace Center for Outdoor Ethics. This group will be referred to as LNT from here onward. Individuals were added to this list by registering as members of the organization, attending a training workshop, or taking a week-long course to become a master educator through the organization. The online list is mostly composed of avid outdoor recreationists who participate in 8 to 12 hours of outdoor recreation per week [62].
4.3 Measures
Online surveys were distributed to the two populations outlined in the previous section (QUAL and LNT). These online surveys included several batteries of questions including items measuring demographic characteristics of the sample and PEB. Demographic information was collected from participants, including their gender, age, household income, level of education, and race/ethnicity. For QUAL, these demographic variables were utilized in the quota sampling procedure to ensure the representativeness of the population to the broader demographics of the United States.
Additionally, the 14 items measuring different types of PEB, outlined in Table 1, were also included in the online survey. Individuals taking the survey were prompted: “Please rate how frequently you have participated in the following activities in the past six months by selecting the appropriate point from the scale below.” In contrast to the prompt utilized in the pilot study, this prompt specifically provides a time bound within which participants were asked to consider their behaviors to reduce the arbitrary nature of the measurement [63]. Six months was chosen specifically as it provided a broad enough time period for individuals to participate in PEB’s that may occur less frequently (e.g., donating money to an environmental organization) while also limiting the reflection period to a reasonable period for individuals to recall. Again, seven options were provided on a Likert-scale ranging from “Never” to “As frequently as possible.” These extreme end points were chosen intentionally to maximize scale variance [64].
Several additional measures were included within the online survey measuring environmental identity, outdoor recreation habits, and environmental values. These measures were utilized for an alternate study for which data were also being collected. This parallel study aimed to understand how involvement in environmentally-conscious outdoor recreation practices influenced the adoption of PEB’s in other life domains. A similar population structure combining avid outdoor recreationists with a United States census-matched population was also utilized for this alternate study.
4.4 Data analysis
Several analytical steps were taken to further develop a psychometrically valid and reliable scale from the items initially outlined in Table 1. All data analyses were carried out in IBM SPSS 26 or R Statistical Analysis Software. Analyses that utilized confirmatory factor analyses were carried out using the AMOS extension of IBM SPSS 26.
First, an exploratory factor analysis was run for both QUAL and LNT to determine whether the two latent constructs indicated from the initial pilot sample held within the two broader samples, especially because they differed from the pilot sample regarding several demographic characteristics (outlined in the Sample Populations section). This analysis was carried out to specifically address research questions #1 and #2. For each of these samples, a principle component analysis (PCA) was utilized to determine the appropriate number of factors to extract from the larger scale. While not technically a form of exploratory factor analysis, this initial PCA determined the number of factors to extract by taking advantage of all available variance within the data, providing a more general approach to understanding the measures prior to determining factor loadings via further analysis. Identifying the number of factors to extract was done utilizing a combination of theoretical interpretation, examination of corresponding scree plots, and Kaiser’s Rule [65]. Once the number of factors were determined, principle axis factors (PAF) was utilized to examine how individual items related to the underlying latent constructs represented by the scale. This sequence of steps (PCA followed by PAF) followed the exploratory factor analysis approach outlined by [66]. A cutoff value for factor loadings of 0.32 was utilized, as items below are less likely to have a statistically meaningful relationship with the associated latent construct [67].
Second, in order to further address research questions #1 and #2, two confirmatory factor analyses were run, one for QUAL one for LNT, to establish the factors structure of the PEB items. Like the confirmatory factor analysis conducted within the pilot study, the Σ2 statistic was used to assess model fit [68]. Additionally, other global fit indices utilized to assess model fit were: RMSEA ≤ 0.10 [68]; SRMR ≤ 0.08 [68]; and CFI ≥ 0.90 [69]. Also in parallel to the pilot study, factor loading were considered adequate if statistically significant and with loadings over 0.30 [70]. Bias-corrected confidence intervals (95% confidence interval computed by 5000 bootstrap resamples) helped to minimize the likelihood of Type 1 Error for factor loadings [71].
Third, to explore the psychometric stability of the final measure between a general population of individuals living in the United States and members of the Leave No Trace Center for Outdoor Ethics (addressing research question #3), invariance testing was utilized to compare the psychometric equivalence of the measure between the QUAL and LNT groups. On the importance of exploring measurement invariance between groups for which the measure will ultimately be utilized, [28] state, “meaning is essentially conventionalized, and so different groups can apply different meanings to the same cognition or behavior. Appropriate and proper comparison of a construct between groups or across times, therefore, depends first on ensuring equivalence of meaning of the construct” (p. 72). Therefore, configural, metric, and scalar invariance [28] were explored between the LNT and QUAL groups. This is done through an iterative process of sequentially imposing greater constraints on a multi-group CFA that incorporates both groups of interest [72]. Configural invariance explored whether the basic item-construct structure was the same between the two groups. Broadly, configural invariance suggests the same items load on to the same latent constructs across the two groups of interest [28, 73]. This was determined by assessing model fit using the same fit indices outlined for the confirmatory factor analysis in the previous paragraph. Metric invariance then constrained item loadings to be equivalent between the two groups and determined whether this constraint significantly reduced model fit when compared to the configural model. Theoretically, metric invariance suggests that not only the same items load on to the same latent constructs across the two groups (as explored in configural invariance), but the same items contribute to the same latent construct in a similar pattern across the two groups [28, 73]. Finally, scalar invariance constrained item intercepts between QUAL and LNT. Scalar invariance explores whether differences in latent constructs between the two groups adequately captures mean differences in the shared variance across the measured items (i.e., higher levels of a measured item in one group result in a higher level of the corresponding latent construct) [28, 73]. Reduction in model fit for the scalar invariance model was compared to the metric invariance model, with all outlined procedures matching those outlined in Putnick and Bornstein [28].
Since Σ2 is sensitive to large sample sizes, reduction in model fit was assessed utilizing alternative fit indices, specifically the cutoff measures developed by Cheung and Rensvold [74] and Chen [75]. Changes in fit indices should not exceed -0.010 for CFI and 0.015 for RMSEA. Additionally, for SRMR, changes should be less than or equal to 0.030 for metric invariance and 0.015 for scalar invariance. If model fit failed to meet thresholds of advancing to the next strictest model, constraints were selectively released based off meaningful differences between the two groups. Model fit was then reassessed for the partially restricted model.
5. Results
5.1 Sample characteristics and descriptive statistics
Of the distributed surveys, 1043 completed surveys were returned for QUAL while 1978 surveys were returned for LNT. QUAL was primarily white (61.6%), had a slight majority of females (51.9%), and had a mean age of 45.6 years old. Like QUAL, LNT was primarily white (though at a much higher percentage at 87.2%) and had a similar mean age of 47.3 years old. LNT deviated from QUAL in being primarily male (51.5%). Additionally, LNT generally had a higher household income and education level than those in QUAL. Detailed demographic information for both samples is provided in Table 2.
Descriptive statistics for the 14 items measuring PEB are outlined in Table 3, and item means are outlined for both QUAL and LNT. As expected, scores on the PEB measures were generally higher in LNT, further supporting prior work showing that individuals invested in environmental organizations and outdoor recreation self-report higher levels of PEB [25, 35]. While there was no missing data in QUAL, missing data was reported across the PEB items for LNT. Little’s MCAR Test [76] was utilized to explore whether data for the PEB items was missing randomly within LNT, an assumption that was confirmed by the analysis (Σ2 = 270.85, df = 269, p = 0.46). Once data were confirmed to be missing completely at random for LNT, the individuals with missing data on PEB measures were deleted listwise, leaving 1719 individuals for analysis.
5.2 Exploratory factor analyses
Exploratory factor analyses were utilized to further understand the underlying psychological dimensions of the 14 PEB items retained from the pilot sample in both the QUAL and LNT samples. Utilizing the Kaiser Rule [65] and examining the corresponding scree plot for each of the two PCAs, both samples suggested that two underlying latent constructs existed within the broader scale measuring PEB. For LNT, eigenvalues were 4.63 and 1.41 for the first two factors, respectively, with all other factors loading below the cutoff value of 1. For QUAL, the eigenvalues were 6.42 and 1.43. Similarly, all other factors failed to meet the threshold of exceeding 1. This statistical evidence also aligned with previous empirical evidence [24, 77] and with our pilot study that indicated two latent constructs existed within the concept of PEB: Private Behaviors and Public Behaviors. Eigenvalues for all extracted factors for both PCAs are outlined in Table 4.
Once the number of factors to extract were determined using PCA, PAF was utilized to further examine the nature of these latent constructs and how individual items loaded onto them for each population. An oblique rotation was utilized as the two latent factors were highly correlated with each other (0.61 for QUAL and 0.55 for LNT).
Item factor loadings for each latent construct are outlined in Table 5. After examining the item loadings on each latent factor, three problematic items were identified between the QUAL and LNT samples. For QUAL, Priv-PEB-4 and Priv-PEB-9 both cross-loaded considerably, with a slightly higher loading on the factor that seemed to align with Public Behaviors rather than Private Behaviors. This contrasted with what was indicated by the findings from the pilot study. Specifically, Priv-PEB-4 asked about composting behavior, a behavior that is constrained by infrastructural availability for some individuals (e.g., those living in urban environments), which could pose a significant limitation to performing a behavior even if behavioral intent was present [31]. Additionally, Priv-PEB-9 inquired about carpooling behaviors. While in some regards this behavior could take place in a private setting, it also required the participation of others. Given this practical justification and inconsistent statistical performance across the two groups, both items were dropped from further analysis. Additionally, Priv-PEB-7, which asked about the use of rechargeable batteries, did not meet the pre-determined loading threshold of 0.32 [67] for the LNT sample. Given the goal of this study is to develop a scale measuring PEB that can be generalized between general and pro-environmental groups within the United States, this item was also dropped.
In broadly examining the remaining 11 item loadings, they aligned with the two latent factors of Private Behaviors and Public Behaviors observed in the pilot study. With this, the six remaining items from the Private Behaviors sub-scale and the five items making up the Public Behaviors sub-scale established from the pilot study were maintained for further analysis.
5.3 Confirmatory factor analyses
Confirmatory factor analyses were utilized to analyze the relationship between the 11 items retained after the exploratory factor analysis for both the QUAL and LNT populations. Model fit indices and factor loadings are outlined for each population in the following paragraphs. Labels for the two latent constructs, Private Behaviors and Public Behaviors, were retained from the pilot study for the confirmatory factor analysis. Each of these corresponding labels continued to capture the theoretical concept represented by their corresponding items effectively.
For QUAL, Σ2 indicated poor model fit (Σ2 = 211.082, df = 43, p<0.001), a result likely linked to the large sample size. Other global fit indices alternatively indicated good model fit though: RMSEA = 0.061; SRMR = 0.044; CFI = 0.969. All factor loadings also met appropriate thresholds (0.30) on the corresponding latent construct and were significant. For LNT, Σ2 values also indicated poor model fit (Σ2 = 415.713, df = 43, p<0.001), though the large LNT sample size also likely contributed to this result [68]. Alternative global fit indices also met necessary thresholds: RMSEA = 0.071; SRMR = 0.047; CFI = 0.929. Like QUAL, all items loaded on the related latent constructs at appropriate levels (0.30) while also being statistically significant. With this, both original confirmatory factor analysis models were retained without modification for QUAL and LNT. Models for both QUAL and LNT populations are outlined in Figs 1 and 2, respectively.
5.4 Measurement invariance
Invariance testing was conducted between QUAL and LNT to explore the psychometric stability of the PEB measures and their associated latent constructs across the two populations. The configural invariance model was found to have appropriate model fit when examining all fit indices aside from the Σ2 measure (Σ2 = 626.786, df = 86, p<0.001; RMSEA = 0.048; SRMR = 0.0471; CFI = 0.950). Given these appropriate fit statistics, configural invariance for the PEB measures between the two groups was supported. In comparing the metric invariance model to the configural invariance model, corresponding changes in model fit fell within the pre-established thresholds for RMSEA and SRMR measures but exceeded the appropriate level of change for the CFI measures. The fit indices for the metric invariance model were Σ2 = 800.686, df = 97, p<0.001; RMSEA = 0.051; SRMR = 0.0687; CFI = 0.935. The -0.015 change in CFI exceeded the threshold of -0.010 established by both Cheung and Rensvold [74] and Chen [75].
Given the PEB measures and the associated latent constructs were found to be metric noninvariant, single item loadings were released in a stepwise manner to understand whether partial metric invariance could be established. These items were released specifically by examining potential theoretical differences between the QUAL and LNT populations. Ultimately, constraints on four item loadings were released: Priv-PEB-2, Pub-PEB-1, Pub-PEB-3, and Pub-PEB-5. Priv-PEB-2 specifically addresses walking and biking behaviors in commuting to nearby destinations. Since prior research has indicated that the LNT population regularly partakes in high levels of outdoor recreation on a weekly basis [62], the unique nature of the LNT population may have resulted in loading differences for this item. Additionally, Pub-PEB-1 and Pub-PEB-3 may be directly influenced by the nature of individuals’ involvement with the Leave No Trace Center for Outdoor Ethics. These items specifically address whether individuals talk to others about environmental issues and whether they participate as a regular member in an environmental organization. Given many individuals within the LNT sample are involved with the Leave No Trace Center for Outdoor Ethics as educators, this may have resulted in unique difference for factor loadings on these two items as well when compared to a general population. Lastly, LNT had much higher household income levels than QUAL, potentially influencing difference in how individuals rated frequency of participation in Priv-PEB-5 which asks about donating money to support environmental protection.
When item loadings were released between groups for these four items, partial metric invariance was supported as changes in fit indices fell within all appropriate thresholds (Σ2 = 742.186, df = 93, p<0.001; RMSEA = 0.050; SRMR = 0.0615; CFI = 0.940). Releasing factor loadings for four items was considered appropriate as previous research has indicated that constraints should be maintained on at least half of the items for partial metric invariance to be confirmed [78, 79]. Partial metric invariance indicates that item loadings were generally comparable across the LNT and QUAL groups, excluding the four items that were allowed to vary between groups (theoretical justification in why these items may not load in a similar pattern across groups being outlined previously). Given poor model fit and change in fit indices greatly exceeding appropriate thresholds when constraining for item intercepts, it was confirmed that the items were scalar noninvariant across the two groups. Model fit indices are further outlined in Table 6. Achieving partial metric invariance, but not scalar invariance, indicates that the proposed scale behaves similarly across the two groups, but some limitations exist in this similarity. The four indicated items (Priv-PEB-2, Pub-PEB-1, Pub-PEB-3, and Pub-PEB-5) load differently on the Private Behaviors and Public Behaviors latent constructs. Additionally, failing the test for scalar invariance indicates that an increase or decrease in an item’s intercept does not uniformly influence that latent construct between the LNT and QUAL groups. While partial metric invariance indicates that the developed scale behaves similarly across the two groups of interest, limitations to this similarity should be acknowledged.
5.5 Reliability analysis
Scale reliabilities were calculated using Cronbach’s Alpha [80] for each of the Private Behaviors and Public Behaviors sub-scales for both QUAL and LNT. The reliability measure for the Private Behaviors sub-scale in QUAL was 0.82, while the reliability measure for the Public Behaviors sub-scale in the same group was 0.90. For LNT, the Private Behaviors sub-scale had a reliability of 0.74. The Public Behaviors sub-scale had a reliability of 0.80 in LNT.
6. Discussion
This study provides researchers and practitioners with a reliable and valid scale to measure general PEB in the United States across groups with different levels of involvement in pro-environmental organizations or activities. Results mostly supported scale reliability and validity for both the LNT and QUAL groups. Additionally, partial metric invariance also indicated a level of consistency in how PEB was perceived across the different populations as well. These findings may allow for scale comparability across these different groups, though it should be noted that not all factor loadings and intercepts related to latent constructs in the same manner across groups. This scale overcomes limitations generally attributed to other measures of PEB in prior research, primarily a lack of rigorous psychometric testing in populations of interest to encourage use across studies. In this generalized scale, the sub-scale structure is split between private and public behaviors. This represents a simplification in how behaviors have been categorized when compared to previous scales measuring PEB, which have included a larger number of behavioral sub-scales [18, 23, 33, 81].
Indicators of reliability and validity for the developed scale were appropriate across both a population of individuals involved in a pro-environmental organization and a general population of individuals in the United States. Establishing these metrics between the two groups represents an important step forward in developing a scale measuring self-reported PEB. This is especially important as many studies measure behaviors within or between populations that have a range of involvement in environmental organizations, outdoor recreation activities, or psychosocial factors related to the behaviors themselves [25, 26, 44]. The establishment of partial metric invariance for the developed scale across these two populations further indicates that there is a level of psychometric stability across these divergent groups as well [28]. It is helpful to establish this consistency in the psychometric performance of the scale as differences in self-reported PEB across groups in future studies can more definitively be linked to changes in variables of interest rather than unaccounted for differences in how the scale is interpreted between groups [28]. Specifically, for this study, various practical differences between the QUAL and LNT groups may explain why full metric invariance was not achieved.
In developing this novel measure, a bi-dimensional sub-scale structure, in line with the public/private split highlighted by some other PEB research [24, 77], is supported as a psychometrically sound way to understand the multi-dimensional nature of PEB across these different groups. This is somewhat unsurprising given the significant role social norms have been found to play in influencing how PEB is enacted in various circumstances [31, 82, 83]. Public behaviors are generally social in nature, and this may be a contributing factor to the underlying sub-scale structure. Despite the influence social norms have been found to have on PEB, they have not been the primary factor determining the structure of a widely used PEB scale previously. Though this sub-scale structure has not been represented in previous developed scales (in contrast to more theoretical work on the nature of PEB; [31, 82, 83]), measuring general PEB through these two dimensions was determined to be psychometrically consistent across LNT and QUAL groups.
In looking to other PEB measures utilizing sub-scales that have received widespread use previously, the bi-dimensional structure of the scale developed in this study generally represents a simplification in categorizing self-reported behaviors. Markle [18] asserts PEB should be measured via four sub-scales (conservation, environmental citizenship, food, and transportation), while Kaiser [81] asserts there should be seven sub-scales (prosocial behavior, ecological garbage removal, water and power conservation, ecologically aware consumer behavior, garbage inhibition, volunteering in nature protection activities, and ecological automobile use). Evidence from this study suggests that these previously established measures may over specify the multi-dimensional nature of PEB when understanding it in the broad context of the general United States population. For example, in an alternative conceptualization of PEB by Larson et al. [23], “land stewardship” was an important aspect of PEB that is notably absent from the scale developed in this study. Given that Larson et al. [23] developed their scale within a rural population in the United States, accessibility or ownership of natural areas is likely more widespread throughout their population. When understanding PEB within the broader population of the United States, these behaviors may not be as commonplace due to restricted access to natural areas. For example, composting behavior was eventually removed from our scale due to its cross-loading between sub-scales amongst the QUAL group in the exploratory factor analysis, indicating there may be some confounding factors influencing how this behavior is perceived and enacted. This aligns with findings by Huddart-Kennedy et al. [51], suggesting that land stewardship behaviors (a broader PEB category that can include composting) are enacted less frequently in populations outside of rural areas. While generalizing to the United States population may lead to a reduced level of nuance within the sub-scale structure of the developed measure, two dimensions were found to be reliable and valid across both the LNT and QUAL populations. In comparison to previously developed scales, the scale developed here may oversimplify the nature of PEB to a degree. There is certainly less breadth of behaviors represented in the final scale in comparison to the initial 27 items utilized in the pilot study (outlined in S1 Appendix). This simplification is somewhat of a trade-off for other aspects of the developed scale that may be beneficial: the generally stable psychometric properties across groups with varying environmental orientations and its brief nature. Additionally, findings from this study further support the assertion made by Larson et al. [23] that PEB is not a unidimensional construct and therefore should not be measured as such. This simplified practice diminishes the behavioral and psychological complexity of PEB, a layer of intricacy that should not be lost if future studies are to most effectively understand PEB.
7. Limitations
Several limitations must be acknowledged when drawing conclusions and implications from the findings of this study. Firstly, the PEB scale was developed solely within populations residing in the United States. The behaviors and associated sub-scale structure are therefore representative of how PEB is perceived and enacted in the United States. Application of this scale to other populations should be done with care and additional psychometric testing, acknowledging that the associated social and psychological factors influencing PEB may differ across cultures and locations. This newly developed scale may provide direction in how to measure PEB in other populations, but measurement invariance should be established first [28]. Establishing such consistency across different countries and regions represents a potential step forward for future research.
Secondly, while partial metric invariance was established between the LNT and QUAL groups, these findings indicate that divergences remain in how the developed scale is perceived and interpreted between the two different groups. While this degree of psychometric stability between groups presents a considerable step forward in developing a scale that can be used across populations with differing levels of involvement in environmentally-oriented causes, there remain limitations to the scale’s performance as well. Item loadings on latent constructs across groups were not fully stable, and difference in intercepts did not correspond to uniform differences in latent constructs across the two groups. This indicates that future applications of this measure across groups with varying involvement in pro-environmental organizations may need to consider that some differences may be a result of how sub-scales are perceived rather than true differences in behavior.
Thirdly, it should be noted that this study did not utilize a new sample to further confirm scale structure after the primary analyses done across the QUAL and LNT groups. Utilizing an additional sample to determine the scale structure would further support the psychometric stability of the developed PEB scale. Despite the potential benefits of recruiting an additional population of individuals to test scale properties, the three populations (pilot study group, QUAL, and LNT) utilized throughout the presented study suggest initial evidence for utilizing the items and sub-scale structure in future research. While the presented scale could further be confirmed in a new group of individuals, this step may only add marginal evidence for scale stability and structure. Given limited time and resources allocated to the scale development process, this additional step may not be justified by the amount of additional information that it would provide.
8. Conclusion
While a range of studies have been focused on how to measure self-reported PEB previously, this study represents a step forward in developing a psychometrically sound scale that can be more readily utilized in populations with a range of orientations towards the natural environment. While some previous PEB studies have aimed to establish measurement consistency across different populations such as between individuals residing in different countries [8], this scale development process took the novel approach of developing a scale that is explicitly designed to be consistent across populations with different levels of involvement with a pro-environmental organization. Additionally, the range of behaviors measured relative to the scale’s short length (11 items) represents a tool for future researchers to readily incorporate into future studies without significantly increasing measurement burden.
Considering the plethora of research focused on understanding and encouraging PEB within the field of environmental psychology, the use of a consistent scale across these studies can aid greatly in more holistically understanding trends across and between studies. This, in turn, allows for researchers and practitioners to better develop a body of collective knowledge on how to encourage PEB in various populations. Developing consistent, reliable, and valid measurement practices represents a necessary step towards achieving that goal.
Supporting information
S1 Data. Anonymized data utilized in study procedures.
https://doi.org/10.1371/journal.pone.0274083.s001
(CSV)
Acknowledgments
The views expressed in this article are the responsibility of the authors and do not necessarily represent the opinions or policy of the National Park Service.
References
- 1. Bergendahl J. A., Sarkis J., & Timko M. T. (2018). Transdisciplinarity and the food energy and water nexus: Ecological modernization and supply chain sustainability perspectives. Resources, Conservation and Recycling, 133, 309–319. https://doi.org/10.1016/j.resconrec.2018.01.001
- 2. Norris P. E., O’Rourke M., Mayer A. S., & Halvorsen K. E. (2016). Managing the wicked problem of transdisciplinary team formation in socio-ecological systems. Landscape and Urban Planning, 154, 115–122. https://doi.org/10.1016/j.landurbplan.2016.01.008
- 3. Dietz T., Gardner G. T., Gilligan J., Stern P. C., & Vandenbergh M. P. (2009). Household actions can provide a behavioral wedge to rapidly reduce US carbon emissions. Proceedings of the National Academy of Sciences, 106(44), 18452–18456. https://doi.org/10.1073/pnas.0908738106 pmid:19858494
- 4. Shove E. (2010). Beyond the ABC: Climate change policy and theories of social change. Environment and Planning A, 42(6), 1273–1285. https://doi.org/10.1068/a42282
- 5. Stern P. C. (2000). New environmental theories: toward a coherent theory of environmentally significant behavior. Journal of Social Issues, 56(3), 407–424.
- 6. Swim J. K., Stern P. C., Doherty T. J., Clayton S., Reser J. P., Weber E. U., et al. (2011). Psychology’s contributions to understanding and addressing global climate change. American Psychologist, 66(4), 241. https://doi.org/10.1037/a0023220 pmid:21553950
- 7. Mobley C., Vagias W. M., & DeWard S. L. (2010). Exploring additional determinants of environmentally responsible behavior: The influence of environmental literature and environmental attitudes. Environment and Behavior, 42(4), 420–447. https://doi.org/10.1177/0013916508325002
- 8. Kaiser F.G., & Wilson M. (2000). Assessing people’s general ecological behavior: A cross-cultural measure. Journal of Applied Social Psychology, 30(5), 952–978. https://doi.org/10.1111/j.1559-1816.2000.tb02505.x
- 9. Truelove H. B., & Gillis A. J. (2018). Perception of pro-environmental behavior. Global Environmental Change, 49, 175–185. https://doi.org/10.1016/j.gloenvcha.2018.02.009
- 10. Van Riper C. J., Lum C., Kyle G. T., Wallen K. E., Absher J., & Landon A. C. (2020). Values, motivations, and intentions to engage in proenvironmental behavior. Environment and Behavior, 52(4), 437–462. https://doi.org/10.1177/0013916518807963
- 11. Steg L., & Vlek C. (2009). Encouraging pro-environmental behaviour: An integrative review and research agenda. Journal of Environmental Psychology, 29(3), 309–317. https://doi.org/10.1016/j.jenvp.2008.10.004
- 12. Lacroix K., Gifford R., & Chen A. (2019). Developing and validating the Dragons of Inaction Psychological Barriers (DIPB) scale. Journal of Environmental Psychology, 63, 9–18. https://doi.org/10.1016/j.jenvp.2019.03.001
- 13. Heimlich J. E., & Ardoin N. M. (2008). Understanding behavior to understand behavior change: A literature review. Environmental Education Research, 14(3), 215–237. https://doi.org/10.1080/13504620802148881
- 14. Wang Z., Guo D., & Wang X. (2016). Determinants of residents’ e-waste recycling behaviour intentions: evidence from China. Journal of Cleaner Production, 137, 850–860. https://doi.org/10.1016/j.jclepro.2016.07.155
- 15. Fielding K. S., McDonald R., & Louis W. R. (2008). Theory of planned behaviour, identity and intentions to engage in environmental activism. Journal of Environmental Psychology, 28(4), 318–326. https://doi.org/10.1016/j.jenvp.2008.03.003
- 16. Halpenny E. A. (2010). Pro-environmental behaviours and park visitors: The effect of place attachment. Journal of Environmental Psychology, 30(4), 409–421. https://doi.org/10.1016/j.jenvp.2010.04.006
- 17. Vaske J. J., & Kobrin K. C. (2001). Place attachment and environmentally responsible behavior. The Journal of Environmental Education, 32(4), 16–21. https://doi.org/10.1080/00958960109598658
- 18. Markle G.L. (2013). Pro-environmental behavior: does it matter how it’s measured? development and validation of the Pro-Environmental Behavior Scale (PEBS). Human Ecology, 41(6), 905–914.
- 19. Lange F., & Dewitte S. (2019). Measuring pro-environmental behavior: Review and recommendations. Journal of Environmental Psychology, 63, 92–100. https://doi.org/10.1016/j.jenvp.2019.04.009
- 20. Dunlap R. E., Van Liere K. D., Mertig A. G., & Jones R. E. (2000). New trends in measuring environmental attitudes: measuring endorsement of the new ecological paradigm: A revised NEP scale. Journal of Social Issues, 56(3), 425–442. https://doi.org/10.1111/0022-4537.00176
- 21.
Clayton, S. (2003). Environmental identity: A conceptual and an operational definition. In S. Clayton & S. Opotow (Eds.), Identity and the Natural Environment: The Psychological Significance of Nature (pp. 317–341). The MIT Press.
- 22. Clayton S., Czellar S., Nartova-Bochaver S., Skibins J. C., Salazar G., Tseng Y. C., et al. (2021). Cross-cultural validation of a revised environmental identity scale. Sustainability, 13(4), 2387. https://doi.org/10.3390/su13042387
- 23. Larson L. R., Stedman R. C., Cooper C. B., & Decker D. J. (2015). Understanding the multi-dimensional structure of pro-environmental behavior. Journal of Environmental Psychology, 43, 112–124. https://doi.org/10.1016/j.jenvp.2015.06.004
- 24. Dono J., Webb J., & Richardson B. (2010). The relationship between environmental activism, pro-environmental behaviour and social identity. Journal of Environmental Psychology, 30(2), 178–186. https://doi.org/10.1016/j.jenvp.2009.11.006
- 25. Lee T. H. (2011). How recreation involvement, place attachment and conservation commitment affect environmentally responsible behavior. Journal of Sustainable Tourism, 19(7), 895–915. https://doi.org/10.1080/09669582.2011.570345
- 26. Thapa B. (2010). The mediation effect of outdoor recreation participation on environmental attitude-behavior correspondence. The Journal of Environmental Education, 41(3), 133–150. https://doi.org/10.1080/00958960903439989
- 27. Worthington R. & Whittaker T. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838.
- 28. Putnick D. L., & Bornstein M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004 pmid:27942093
- 29. Gifford R., & Nilsson A. (2014). Personal and social factors that influence pro‐environmental concern and behaviour: A review. International Journal of Psychology, 49(3), 141–157. https://doi.org/10.1002/ijop.12034 pmid:24821503
- 30. Poortinga W., Steg L., & Vlek C. (2004). Values, environmental concern, and environmental behavior: A study into household energy use. Environment and Behavior, 36(1), 70–93. https://doi.org/10.1177/0013916503251466
- 31.
Heberlein, T. A. (2012). Navigating Environmental Attitudes. Oxford University Press.
- 32. Schultz P. W., Gouveia V. V., Cameron L. D., Tankha G., Schmuck P., & Franěk M. (2005). Values and their relationship to environmental concern and conservation behavior. Journal of Cross-Cultural Psychology, 36(4), 457–475. https://doi.org/10.1177/0022022105275962
- 33. Gkargkavouzi A., Halkos G., & Matsiori S. (2019). A multi-dimensional measure of environmental behavior: Exploring the predictive power of connectedness to nature, ecological worldview and environmental concern. Social Indicators Research, 143(2), 859–879. https://doi.org/10.1007/s11205-018-1999-8
- 34. Green-Demers I., Pelletier L. G., & Ménard S. (1997). The impact of behavioural difficulty on the saliency of the association between self-determined motivation and environmental behaviours. Canadian Journal of Behavioural Science, 29(3), 157. https://doi.org/10.1037/0008-400X.29.3.157
- 35. Larson L. R., Whiting J. W., & Green G. T. (2011). Exploring the influence of outdoor recreation participation on pro-environmental behaviour in a demographically diverse population. Local Environment, 16(1), 67–86. https://doi.org/10.1080/13549839.2010.548373
- 36. Hines A. (1993). Linking qualitative and quantitative methods in cross-cultural survey research: techniques from cognitive science. Journal of Community Psychology, 21(6), 729–746. https://doi.org/10.1007/BF00942245
- 37. Fiske A. (2002). Using individualism and collectivism to compare cultures—A critique of the validity and measurement of the constructs: Comment on Oyserman et al. (2002). Psychological Bulletin, 128, 78–88. pmid:11843549
- 38. Ungar M., Liebenberg L., Boothroyd R., Kwong W., Lee T., Leblanc J., et al. (2008). The study of youth resilience across cultures: Lessons from a pilot study of measurement development. Research in Human Development, 5(3), 166–180.
- 39. Van De Schoot R., Schmidt P., Beuckelaer A., Lek K., & Zondervan-Zwijnenburg M. (2015). Editorial: Measurement invariance. Frontiers of Psychology, 6. https://doi.org/10.3389/fpsyg.2015.01064 pmid:26283995
- 40. Kitchell A., Kempton W., Holland D., & Tesch D. (2000). Identities and actions within environmental groups. Human Ecology Review, 1–20.
- 41. Sparks P., & Shepherd R. (1992). Self-identity and the theory of planned behavior: Assesing the role of identification with" green consumerism". Social Psychology Quarterly, 388–399. https://doi.org/10.2307/2786955
- 42. Teisl M. F., & O’Brien K. (2003). Who cares and who acts? Outdoor recreationists exhibit different levels of environmental concern and behavior. Environment and Behavior, 35(4), 506–522. https://doi.org/10.1177/0013916503035004004
- 43.
Thorndike, R. M., & Thorndike-Christ, T. (2009). Measurement and evaluation in psychology and education (Eight ed.). Pearson Education.
- 44. Brick C., Sherman D. K., & Kim H. S. (2017). “Green to be seen” and “brown to keep down”: Visibility moderates the effect of identity on pro-environmental behavior. Journal of Environmental Psychology, 51, 226–238. https://doi.org/10.1016/j.jenvp.2017.04.004
- 45. Nash N., Whitmarsh L., Capstick S., Hargreaves T., Poortinga W., Thomas G., et al. (2017). Climate-relevant behavioral spillover and the potential contribution of social practice theory. Wiley Interdisciplinary Reviews: Climate Change, 8(6). https://doi.org/10.1002/wcc.481
- 46. Truelove H. B., Carrico A. R., Weber E. U., Raimi K. T., & Vandenbergh M. P. (2014). Positive and negative spillover of pro-environmental behavior: An integrative review and theoretical framework. Global Environmental Change, 29, 127–138. https://doi.org/10.1016/j.gloenvcha.2014.09.004
- 47.
Marion J. L. (2014). Leave No Trace in the outdoors. Mechanicsburg, PA: Stackpole Books.
- 48. Cooper C., Larson L., Dayer A., Stedman R., & Decker D. (2015). Are wildlife recreationists conservationists? Linking hunting, birdwatching, and pro‐environmental behavior. The Journal of Wildlife Management, 79(3), 446–457.
- 49. Ramkissoon H., Weiler B., & Smith L. D. G. (2012). Place attachment and pro-environmental behaviour in national parks: The development of a conceptual framework. Journal of Sustainable Tourism, 20(2), 257–276. https://doi.org/10.1080/09669582.2011.602194
- 50. Kaiser F. G., Oerke B., & Bogner F. X. (2007). Behavior-based environmental attitude: Development of an instrument for adolescents. Journal of Environmental Psychology, 27(3), 242–251. https://doi.org/10.1016/j.jenvp.2007.06.004
- 51. Huddart-Kennedy E., Beckley T.M., McFarlane B.L., & Nadeau S. (2009). Rural-urban differences in environmental concern in Canada. Rural Sociology, 74(3), 309–329. https://doi.org/10.1526/003601109789037268
- 52. Alisat S., & Riemer M. (2015). The environmental action scale: Development and psychometric evaluation. Journal of Environmental Psychology, 43, 13–23. https://doi.org/10.1016/j.jenvp.2015.05.006
- 53. Okvat H. A., & Zautra A. J. (2011). Community gardening: A parsimonious path to individual, community, and environmental resilience. American Journal of Community Psychology, 47(3–4), 374–387. pmid:21222153
- 54. Smith J. G., DuBois B., & Krasny M. E. (2016). Framing for resilience through social learning: impacts of environmental stewardship on youth in post-disturbance communities. Sustainability Science, 11(3), 441–453. https://doi.org/10.1007/s11625-015-0348-y
- 55. Abrahamse W., & Steg L. (2013). Social influence approaches to encourage resource conservation: A meta-analysis. Global Environmental Change, 23(6), 1773–1785. https://doi.org/10.1016/j.gloenvcha.2013.07.029
- 56.
Qualtrics. (2020). Unlock breakthrough insights with market research panels. https://www.qualtrics.com/research-services/online-sample/
- 57. Etikan I., & Bala K. (2017). Sampling and sampling methods. Biometrics & Biostatistics International Journal, 5(6).
- 58.
United States Census Bureau. (2020). United States of America. https://data.census.gov/cedsci/profile?q=ACSDP1Y2019.DP05%20United%20States&g=0100000US
- 59.
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications.
- 60. Carter S. R. (2016). Using confirmatory factor analysis to manage discriminant validity issues in social pharmacy research. International Journal of Clinical Pharmacy, 38(3), 731–737. https://doi.org/10.1007/s11096-016-0302-9 pmid:27147255
- 61. Liu X., Vedlitz A., & Shi L. (2014). Examining the determinants of public environmental concern: Evidence from national public surveys. Environmental Science & Policy, 39, 77–94. https://doi.org/10.1016/j.envsci.2014.02.006
- 62.
Leave No Trace Center for Outdoor Ethics, (2018). Report for Leave Not Trace 2018 member survey. Boulder, CO: Leave No Trace Center for Outdoor Ethics.
- 63. Blanton H., & Jaccard J. (2006). Arbitrary metrics in psychology. American Psychologist, 61(1), 27. pmid:16435974
- 64. Miller Z. D. (2018). Finding the unicorn: Evidence-based best practices for improving quantitative measures. Journal of Park and Recreation Administration, 36(4).
- 65. Kaiser H. F. (1970). A second generation little jiffy. Psychometrika, 35(4), 401–415. https://doi.org/10.1007/BF02291817
- 66.
Tabachnick, B.G., & Fidell, L.S. (2007). Using multivariate statistics (4th Ed.). Harper-Collins.
- 67. Yong A. G., & Pearce S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79–94.
- 68.
Kline, R.B. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Publications.
- 69. Hu L., & Bentler P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453. https://doi.org/10.1037/1082-989X.3.4.424
- 70.
Kline, P. (1994). An easy guide to factor analysis. Routledge.
- 71.
Byrne, B.M. (2001). Structural equation modeling with AMOS: basic concepts, applications, and programming. Lawrence Erlbaum Associates.
- 72. French B. F., & Finch W. H. (2006). Confirmatory factor analytic procedures for the determination of measurement invariance. Structural Equation Modeling, 13(3), 378–402. https://doi.org/10.1207/s15328007sem1303_3
- 73. Schmitt N., & Kuljanin G. (2008). Measurement invariance: Review of practice and implications. Human Resource Management Review, 18(4), 210–222. https://doi.org/10.1016/j.hrmr.2008.03.003
- 74. Cheung G. W., & Rensvold R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
- 75. Chen F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504.
- 76. Little R.J. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202.
- 77. Sparks A. C., Henderson G. L., Sriram S. K., & Smith E. R. (2020). Measuring Environmental Values and Identity. Society & Natural Resources, 1–20. https://doi.org/10.1080/08941920.2020.1817644
- 78. Steenkamp J.E.M., & Baumgartner H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90. https://doi.org/10.1086/209528
- 79. Vandenberg R.J., & Lance C.E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 2, 4–69. https://doi.org/10.1177/109442810031002
- 80. Cortina J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98. https://doi.org/10.1037/0021-9010.78.1.98
- 81. Kaiser F. G. (1998). A general measure of ecological behavior. Journal of Applied Social Psychology, 28(5), 395–422. https://doi.org/10.1111/j.1559-1816.1998.tb01712.x
- 82. Bamberg S., & Möser G. (2007). Twenty years after Hines, Hungerford, and Tomera: A new meta-analysis of psycho-social determinants of pro-environmental behaviour. Journal of Environmental Psychology, 27(1), 14–25. https://doi.org/10.1016/j.jenvp.2006.12.002
- 83. Thomas C., & Sharp V. (2013). Understanding the normalisation of recycling behaviour and its implications for other pro-environmental behaviours: A review of social norms and recycling. Resources, Conservation and Recycling, 79, 11–20. https://doi.org/10.1016/j.resconrec.2013.04.010