To address the present research gap on relations between motivational beliefs, self-regulation failure, and psychological health in post-secondary faculty, the present study used associative latent growth modeling to longitudinally examine relationships between self-efficacy, procrastination, and burnout (emotional exhaustion) in faculty internationally. Findings from 3,071 faculty participants (70% female, 69 countries) over three time points (5–6 month lags) showed greater self-efficacy at baseline to correspond with lower procrastination and burnout, and procrastination to be positively related to burnout (intercepts). Growth analyses additionally revealed stronger relations between increases in self-efficacy, procrastination, and burnout over time (slopes). Supplemental cross-lagged analyses provided causal evidence of burnout as an antecedent of self-efficacy and procrastination, underscoring intervention and policy efforts to address overwork and exhaustion in post-secondary faculty.
Citation: Hall NC, Lee SY, Rahimi S (2019) Self-efficacy, procrastination, and burnout in post-secondary faculty: An international longitudinal analysis. PLoS ONE 14(12): e0226716. https://doi.org/10.1371/journal.pone.0226716
Editor: Sergio A. Useche, Universitat de Valencia, SPAIN
Received: August 22, 2019; Accepted: December 2, 2019; Published: December 30, 2019
Copyright: © 2019 Hall et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying the results presented in the study are available from www.ame1.net.
Funding: This study was funded by an Insight Grant to NH from the Social Sciences and Humanities Research Council of Canada Insight Grant (SSHRC 435-2013-1099; http://www.sshrc-crsh.gc.ca). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Over the past 20 years, faculty at post-secondary institutions internationally have experienced rising levels of stress and burnout due to increasing demands for quality instruction, research excellence, and service contributions without commensurate increases in institutional support [1–3]. Beyond the notable impact of institutional demands (e.g., teaching ; research ) and support (e.g., teaching [6–7]), existing faculty development research has also explored the role of psychological factors in well-being levels (for reviews, see [8–9]). With respect to motivational variables, perceptions of competence in post-secondary faculty has received particular attention given findings showing higher levels of perceived competence (e.g., self-efficacy, control) to consistently correspond with greater teaching success [10–11], research productivity [12–13], and well-being [5,14]. Although adaptive self-regulation strategies have received less empirical attention in faculty research to date (e.g., humor coping ), self-regulation failure has been repeatedly examined in relation to both faculty productivity (e.g., writing procrastination [16–17]) and burnout (e.g., inability to cope ). However, there to date exists no published research exploring longitudinal relations between faculty motivation, self-regulation, and well-being thereby limiting our understanding of potential causal relationships between these critical psychological variables. To address this research gap, the present longitudinal study evaluated faculty perceptions of self-efficacy, procrastination, and burnout (emotional exhaustion) at three points using latent growth and cross-lagged structural equation models to provide an in-depth analysis of hypothesized relations between these variables with respect to valence, magnitude, as well as causality.
Motivation in faculty: Self-efficacy beliefs
Motivational variables have consistently been found to correspond with productivity and job satisfaction in post-secondary faculty (e.g., perceived value ; perceived competence ), with perceptions of self-efficacy having been previously examined in relation to both faculty employment and well-being outcomes. The theoretical construct of self-efficacy is derived from social-cognitive theory [20–21] and is defined as beliefs or confidence regarding one’s capability to manage and perform specific behaviors. Self-efficacy has long been found to be a strong predictor of performance outcomes across academic populations over and above the effects of prior achievement, including K-12, undergraduate, and graduate students (e.g., for reviews, see [22–23]) as well as K-12 teachers . With respect to post-secondary faculty, international research over the past three decades has also explored this social-cognitive construct as reflective of faculty beliefs in their ability to teach (e.g., The Netherlands ; China ), conduct research (e.g., Turkey ; U.S. ), and engage in service (e.g., public outreach among U.S. faculty [29–30]), among other academic activities (e.g., administration and consulting, Australia ; computing, Nigeria ; see also ).
In addition to recent qualitative work investigating critical social-environmental contributors to faculty self-efficacy beliefs (e.g., mentorship, collegiality; Australia ; Mexico ; U.S. ), research on faculty self-efficacy has consistently explored demographic antecedents including gender, rank, and discipline. Whereas some studies report no gender differences in teaching or research self-efficacy [31,36], other findings persistently show male faculty to report higher levels of self-efficacy for research and service than females [26,28,37–38]. Similar to findings on teaching self-efficacy among K-12 educators , existing research has also shown faculty self-efficacy beliefs for research to be higher among senior relative to junior faculty members [31,36]. Prior studies have further examined faculty self-efficacy beliefs specific to a given discipline (e.g., STEM ; foreign language instruction [27,35]), with scattered findings showing faculty self-efficacy levels to be more problematic in specific disciplines relative to others (e.g., education ; social sciences ; accounting ).
Longitudinal research has also been conducted to examine changes in faculty self-efficacy levels, specifically to evaluate the cognitive effects of professional development initiatives. Alongside multiple intervention studies showing pedagogical training programs to increase teaching self-efficacy in faculty internationally (U.S. ; Finland [41–42]; India, South Africa ), recent findings further show faculty development efforts to improve self-efficacy for research self-efficacy (Turkey ) and service over time (i.e., for engaging in gender-equity-promoting behaviors; U.S. ). Faculty self-efficacy has also been repeatedly assessed in relation to critical outcome measures, with findings showing greater teaching self-efficacy to correspond with indicators of teaching effectiveness (U.K. ; China ), and higher research self-efficacy to be related to greater research productivity (e.g., Australia [31,37,47]; U.S. [28,48]). However, beyond recent cross-sectional studies exploring relations between faculty self-efficacy and emotional well-being variables (teaching-related emotions ; perceived stress ), research on how self-efficacy intersects with psychological health in post-secondary faculty internationally is currently lacking.
Self-regulation in faculty: Procrastination behaviors
In addition to the role of self-efficacy beliefs in faculty development, research has also begun to explore the utility of higher-order self-regulation constructs to account for faculty performance and well-being outcomes. Nevertheless, despite a voluminous literature with students on the academic implications of self-regulation strategies , self-regulation among post-secondary educators with respect to teaching and research  or corresponding emotions (e.g., emotional labor ; humor coping ) has rarely been examined. However, notable exceptions to this research gap include scattered studies assessing self-regulation failure in post-secondary faculty with respect to global beliefs in one’s inability to cope [1,5], and an emerging body of research on faculty procrastination. More specifically, following from studies that examined how faculty perceive student procrastination [53–54], or how their instructional methods could impact student procrastination , limited research has also investigated the characteristics and correlates of academic procrastination behaviors in post-secondary faculty [16–17].
Procrastination is commonly defined as a dysfunctional phenomenon whereby individuals needlessly delay a task or an action despite expected negative consequences [56,57], with this behavior typically characterized as a failure of self-regulation toward a desired goal [57–61]. More specifically, procrastination researchers suggest that this maladaptive behavior can represent self-regulation failure in two ways: underregulation and/or misregulation. Whereas the underregulation hypothesis asserts that procrastination can result from poor behavioral or motivational self-regulation (e.g., ineffective work strategies, insufficient self-control or persistence [57,59,62–63]), the misregulation hypothesis proposes that individuals may instead prioritize downregulating negative emotions (e.g., anxiety) through procrastination over accomplishing an achievement goal [58,64–66]. Accordingly, findings in academic contexts have consistently found higher levels of procrastination in students to correspond with poorer performance [67–69] and self-efficacy levels [70–71], as well as lower levels of emotional well-being [72–74].
Limited existing research on procrastination in post-secondary faculty similarly suggests that this behavior is not only regularly experienced but may also correspond with maladaptive performance and psychological outcomes. Early findings showed new faculty in the U.S. to report frequently procrastinating on scholarly writing tasks (e.g., research manuscripts) and unintentionally delaying writing activities due to busyness with other academic responsibilities . These descriptive results were followed up by findings showing a structured intervention that addressed binge writing to improve writing productivity in faculty who reported scholarly writing as a challenge [17,75]. Research by Ackerman and Gross  further delineated the specific task components that elicit procrastination in academic staff, with an online survey of faculty across the U.S. showing procrastination to be most frequent when tasks were perceived as ambiguous, difficult, or in conflict with competing deadlines. Most recently, findings from Sharma and Kaur  with female college and university lecturers in India showed occupational self-efficacy and procrastination behaviors to be strongly interrelated (r = -.67), with both variables further demonstrating significant correlations of equivalent magnitude with occupational stress (self-efficacy: r = -.58; procrastination: r = .62). Thus, despite emerging research highlighting the potential complementary utility of academic procrastination for predicting faculty development outcomes, in addition to more commonly assessed motivational beliefs, empirical research on procrastination in relation to academic competencies and psychological well-being in faculty members is unfortunately scarce.
The present research
To address the notable research gaps on relations between self-efficacy, procrastination, and well-being in post-secondary faculty, the present longitudinal study examined these critical psychological variables in an international sample using both latent growth and cross-lagged models to provide lacking large-scale empirical evidence as to respective valences, magnitudes, and causality. Expanding on previous studies exploring cross-cultural differences in faculty self-efficacy (e.g., Australia vs. U.K. ), participants were recruited from several countries to afford a representative sample of academics internationally. Consistent with prior intervention research on faculty self-efficacy employing longitudinal designs [41–42], this study further administered reliable measures of self-efficacy, procrastination, and burnout (emotional exhaustion) across three study phases to elucidate potential causal relationships. Moreover, following from recent research efforts to examine the effects of faculty self-efficacy and procrastination on not only performance but psychological health (i.e., emotions ; stress ), the present research also specifically assessed an internationally validated measure of emotional exhaustion to optimally investigate how motivational and self-regulation factors intersect with a critical psychological indicator of occupational burnout.
Hypothesis 1: Self-efficacy and procrastination.
Higher levels of self-efficacy intercepts and slopes were hypothesized to correspond with lower procrastination intercepts and slopes, respectively. This hypothesis was derived from assumed positive relations between self-efficacy and self-regulation competencies as outlined in Bandura’s  theory (for reviews of the hypothesized role of self-efficacy in procrastination relative to competing motivational constructs, see [57,76]). This hypothesis was additionally informed by the underregulation hypothesis which asserts that procrastination can result from lacking academic competencies [57,62] and by empirical studies showing self-efficacy to be negatively correlated with procrastination in students [61,70–71,77–79] and post-secondary lecturers . Given the exploratory nature of the study, differential magnitudes of relations between study variables, patterns of relations between intercepts and slopes of different variables, and directions of causality between study variables were not proposed.
Hypothesis 2: Self-efficacy and burnout.
Higher levels of self-efficacy at baseline (intercepts) and over time (slopes) were further hypothesized to correspond with lower intercepts and slopes for the burnout subscale of emotional exhaustion, respectively. This hypothesis was informed by the emotional benefits of self-efficacy as outlined in Bandura’s  social-cognitive theory, and research demonstrating negative relations between self-efficacy and negative affectivity in students , K-12 teachers (e.g., burnout [80–82]), and post-secondary faculty (teaching emotions ; occupational stress ).
Hypothesis 3: Procrastination and burnout.
Finally, higher levels of procrastination intercepts and slopes were hypothesized to correspond with higher intercepts and slopes for emotional exhaustion, respectively. This hypothesis follows from the misregulation hypothesis in which procrastination is proposed as a self-protective response to negative emotions (e.g., anxiety [65–66]), as well as existing findings showing procrastination to correlate positively with negative affectivity in both students [64,83–87] and post-secondary lecturers .
Materials and methods
Participants and procedure
Faculty participants (N = 3,071) employed at post-secondary institutions across 69 countries were recruited predominantly via social media (Facebook: 57.9%, Twitter: 40.2%; blogs/web/email: 1.9%) as part of a three-phase data collection effort examining self-regulation and academic success in higher education [88–90]. Participants’ mean age was 39 years (SD = 8.51) and 69.7% of the sample identified as female, with most participants being employed at institutions in the United States (63.7%), United Kingdom (9.4%), Canada (8.2%), Australia (4.4%), and European countries (8.7%). Faculty were employed across ranks (e.g., U.S: 28% contingent, 39% assistant, 22% associate, 11% full; Canada: 25% contingent, 29% assistant, 34% associate, 12% full; U.K: 52% lecturer, 26% senior lecturer, 13% reader, 10% professor; Australia: 11% tutor, 45% lecturer, 28% senior lecturer, 9% reader, 7% professor) and across disciplines (48 in total, including professional, social/natural sciences, humanities), and had been employed as an academic for an average of 7 years (SD = 6.55). Participants completed an omnibus online questionnaire at three time points (5–6 month lags) including demographic items (e.g., age, gender, years of employment) followed by self-report measures of procrastination, self-efficacy, and burnout, and were compensated by cash prize draw after each study phase ($500 per phase). Study protocols were approved by the Research Ethics Board at McGill University (REB File #: 261–0115). Sample sizes for each study phase/measure and descriptive statistics for all study variables (averaged scores across scale items) are presented in Table 1.
Informed by Bandura's  social cognitive theory, a 10-item, five-point Likert scale developed for this study assessed faculty members' perceived capabilities with respect to prototypic academic responsibilities (αt1/t2/t3 = .81/.84/.83; 1 = strongly disagree to 5 = strongly agree). Consistent with prior assessments of faculty self-efficacy with respect to primary academic tasks (i.e., teaching and research [31,46]), scale items assessed participants’ perceived confidence in their abilities with respect to student instruction and supervision (e.g., “teach effectively”; “have supervised students graduate in a timely manner”) as well as research activities (e.g., “write a literature review paper”; “deliver a public academic presentation”). A composite self-efficacy measure consisting of items pertaining to both teaching and research was assessed in our main analyses due to exploratory factor analyses showing all items to load significantly on a single factor (no rotation; factor loadings ≥ .30; eigenvalue = 3.75) and the domain-general nature of the other main variables (e.g., academic procrastination vs. research or teaching procrastination).
To evaluate perceived frequency of procrastination behaviors in faculty participants, a 12-item, five-point Likert measure compiled by Steel (Pure Procrastination Scale, PPS ) was administered (αt1-t3 = .93; 1 = strongly disagree to 5 = strongly agree). The PPS represents a composite of top-loading items from multiple domain-general measures of procrastination in adult populations (i.e., Adult Inventory of Procrastination, AIP ; Decisional Procrastination Questionnaire, DPQ ; General Procrastination Scale, GPS ). The PPS has previously been found to demonstrate higher reliability than its constituent measures (e.g., α = .92 ) and shows significant relations with established well-being scales (e.g., Satisfaction with Life Scale ; r = -.41). The scale preamble was modified from the original to encourage faculty respondents to refer specifically to their academic procrastination behaviors (i.e., “The items below concern your everyday academic work experiences"). Sample items include: “I am not very good at meeting deadlines” (AIP); “Even after I make a decision I delay acting upon it” (DPQ); and “In preparation for some deadlines, I often waste time by doing other things” (GPS).
Burnout: Emotional exhaustion.
To evaluate an indicator of occupational burnout in faculty participants, the seven-item, six-point emotional exhaustion subscale of the Maslach Burnout Inventory (MBI ) was administered (αt1/t2/t3 = .92/.93/.93; 1 = never to 6 = every day). The emotional exhaustion MBI subscale was selected based on recent research with K-12 teachers  and post-secondary faculty  showing this subscale to demonstrate substantially better internal reliability as compared to the depersonalization and personal accomplishment subscales, with the accomplishment subscale also not assessed to prevent redundancy with the self-efficacy measure. The scale preamble was modified to instruct participants to refer specifically to their experiences as a faculty member, with two scale items removed from the original nine-item exhaustion measure following from international MBI validation data showing consistently poor factor loadings for two service profession items pertaining to stress/strain from “working with people” . Sample subscale items include: “I feel emotionally drained from my work”; “I feel fatigued when I get up in the morning and have to face another day at work”; and “I feel I’m working too hard at my job.”
Given that substantial attrition is typically observed in longitudinal studies with repeated assessments (e.g., ranging from 30% to 70% [99–100]), preliminary analyses were additionally conducted to assess potential differences in participant demographics and the main study variables (self-efficacy, procrastination, exhaustion at Time 1) as a function of three attrition levels (completed Time 1, Times 1–2, Times 1–3). As outlined in Table 1 (see self-efficacy), 30% attrition was observed from Time 1 to 2, with 37% attrition found from Time 2 to 3 (57% total study attrition). ANOVA results showed faculty who completed only the first phase to report higher emotional exhaustion at Time 1 (M = 29.65, SD = 10.78) than those who completed two study phases (M = 28.23, SD = 9.96; Games-Howell contrast), however this effect was notably weak in magnitude F(2, 2205) = 3.36, p = .035, ηp2 = .003. In contrast, ANOVA and chi-squared analyses showed no statistically significant differences in participants’ gender, age, country (of institution), years of employment, self-efficacy, and procrastination as a function of study attrition, with attrition results overall thus underscoring the representativeness of the total study sample with respect to both key background characteristics and the main study variables.
To evaluate the extent to which specific demographic background variables examined in prior faculty research were associated with mean levels or could moderate changes over time in self-efficacy, procrastination, and burnout in the present study, repeated measures ANOVAs were conducted on each variable with gender and country (of institution) as between-subjects variables alongside the within-subjects effect of time. Gender was selected based on prior research consistently showing male faculty to report higher research and service self-efficacy relative to females [26–38]. Country of institution was also examined (i.e., five main countries: U.S., U.K., Canada, Australia, Europe) in that although prior research has investigated faculty self-efficacy and procrastination in various countries (e.g., India, China, U.S., Turkey, Nigeria, Mexico, Australia, U.K., The Netherlands), no research to date has obtained international data affording direct comparisons between more than two countries on these variables (cf. Australia vs. U.K. ).
Significant within-subjects effects of time were observed only on self-efficacy (e.g., gender ANOVA: F(2,1836) = 6.51, p = .002, ηp2 = .006), showing self-efficacy levels to increase slightly from Time 1 to 2 (see Table 1). No within-subjects interactions between time and gender or country were observed and no between-groups country effects were significant. Consistent with prior research on faculty burnout (e.g., emotional exhaustion ), significant between-subjects effects showed female faculty to report slightly greater exhaustion levels relative to males, F(1,887) = 5.73, p = .017, ηp2 = .006. Moreover, whereas prior research on faculty procrastination has not examined gender differences [16–17] or was gender-specific (i.e., females ), the present findings also showed female faculty to report consistently lower levels of procrastination relative to males, F(1,918) = 7.79, p = .005, ηp2 = .008. Nevertheless, due to a lack of significant differences between countries, no moderation effects of gender or country on changes over time, and the gender effects being notably weak in magnitude, these variables were not evaluated as potential confounds or moderators in our main structural equation models.
Correlational analyses on averaged scale items for each self-report measure (Table 2) showed moderate to strong intercorrelations among the three assessments of self-efficacy, procrastination, and burnout (.67 < rs < .84), particularly between adjacent assessments. Weak correlations in the expected directions were otherwise observed between self-efficacy and procrastination (-.21 < rs < -.16) and between procrastination and the emotional exhaustion burnout subscale (.20 < rs < .24), with the weakest correlations found between self-efficacy and exhaustion (-.13 < rs < -.09). These findings underscore the orthogonality of the faculty motivation, self-regulation, and well-being variables administered in this study and show multicollinearity to not represent a substantial confound in our main structural equation models.
Associative latent growth curve model.
Latent growth curve modeling (LGCM) was conducted via Amos 21.0 software to examine the covariance among intercepts (baselines) and slopes (increases over time) over three assessments of faculty self-efficacy, procrastination, and emotional exhaustion (for more on LGCM protocols, see [101–102]). Missing data were automatically computed using maximum likelihood (ML) estimation , with the Comparative Fit Index (CFI), Tucker-Lewis index (TLI), and Root Mean Square Error of Approximation (RMSEA) evaluated as indicators of model fit. The LGCM evaluating hypothesized covariances between self-efficacy, procrastination, and burnout (emotional exhaustion) intercepts and slopes is outlined in Fig 1.
All model fit indices were satisfactory indicating sufficient power to detect differences between the observed data and predicted model [104–105]; CFI = .99, TLI = .98, RMSEA = .03. Inspection of the latent overall mean (M = 37.59, SE = .12, p < .001) and slope mean for self-efficacy (M = .38, SE = .14, p < .01), as well as intercept (σ2 = 27.13, SE = 1.43, p < .001) and slope variances (σ2 = 10.67, SE = 2.64, p < .001), revealed both significant individual differences in baseline levels and intra-individual differences in growth in self-efficacy over time. For procrastination (latent overall M = 34.53, SE = .23, p < .001), significant intercept variance further revealed individual differences between faculty on this variable (σ2 = 101.83, SE = 4.35, p < .001). For the burnout measure of emotional exhaustion (latent overall M = 29.02, SE = .21, p < .001), the variances for both the intercept (σ2 = 81.40, SE = 4.09, p < .001) and slope (σ2 = 25.64, SE = 7.11, p < .001) further suggested both initial differences as well as intra-individual differences in growth in exhaustion over time. Slope means for procrastination (M = -.10, SE = .20, p = .635) and burnout (M = -.09, SE = .34, p = .679) were not significant.
Covariances between the intercepts and slopes for each of the study variables are outlined in Table 3. With respect to relations between intercepts and slopes for the same variable, although these covariances were not significant for self-efficacy and procrastination, it was significant for emotional exhaustion (-.20, p = .034) in showing faculty with initially high levels of exhaustion to demonstrate a lower rate of increase in exhaustion over the subsequent two assessments. Concerning covariances between intercepts for the study variables (|.18|-|.28|), baseline levels of self-efficacy and procrastination, self-efficacy and exhaustion, as well as procrastination and exhaustion were found to significantly covary in the expected directions. However, even stronger relations in the hypothesized directions were observed between the slopes for each of the study variables (|.21|-|.46|), underscoring the correspondence between faculty self-efficacy, procrastination, and burnout not only at baseline but also in terms of shared trajectories over time. Weak yet significant covariances between the slope for self-efficacy and the intercepts for procrastination and exhaustion were also observed, suggesting that faculty with poorer procrastination and emotional exhaustion levels at baseline were more likely to show increases in self-efficacy over time, suggesting potential floor effects or regression to the mean.
Supplemental cross-lagged analyses.
As a follow-up to the associative LGCM findings showing substantial relations between the study variables over time, exploratory cross-lagged structural equation models were further conducted to examine potential causal relations between self-efficacy, procrastination, and burnout (emotional exhaustion) in our faculty sample. Three cross-lagged analyses were performed, each contrasting two study variables over three time points (self-efficacy vs. procrastination, self-efficacy vs. burnout, procrastination vs. burnout). Autoregressive paths between each assessment for the same variable were modelled (e.g., self-efficacy at Time 1 to Time 2), with covariances additionally modelled between variables within the same assessment period (e.g., self-efficacy at Time 1 with procrastination at Time 1) and between error terms for equivalent item parcels (e.g., self-efficacy Time 1 parcel 1 with self-efficacy Time 2 parcel 1). Due to these supplemental analyses affording greater specificity than the LGCM with respect to manifest indicators (by concurrently examining two vs. three study variables), scale items were parceled in a sequential manner (items summed with subsequent items for unidimensional variables; see [106–107]) to evaluate the latent self-efficacy, procrastination, and exhaustion variables with roughly equivalent numbers of manifest indicators (5, 4, and 3 parcels respectively). Given the highly conservative nature of cross-lagged analyses in controlling for autoregressive paths, statistically significant cross-lagged parameters (e.g., self-efficacy at Time 1 to procrastination at Time 2) were not expected to be large in magnitude but instead suggestive of the potential existence and valence of causal relationships .
The first analysis evaluating potential directional relations between self-efficacy and procrastination (see Fig 2, Panel A) showed adequate model fit (CFI = .90, TLI = .86, RMSEA = .06) and no significant cross-lagged effects between the three time points. The second analysis evaluating self-efficacy and burnout (emotional exhaustion) relations (Fig 2, Panel B) demonstrated mediocre model fit (CFI = .82, TLI = .75, RMSEA = .09), and revealed a weak negative effect of exhaustion at Time 1 on self-efficacy at Time 2 (β = -.05, p = .011). Finally, the analysis of procrastination and exhaustion relations over time showed satisfactory model fit (CFI = .98, TLI = .98, RMSEA = .03), with two significant directional paths between the study variables being observed (Fig 2, Panel C). Although the cross-path parameters were weak in magnitude, a significant bidirectional pattern of relations showed greater burnout at Time 1 to lead to higher levels of procrastination at Time 2 (β = -.04, p = .038) that, in turn, predicted greater emotional exhaustion at Time 3 (β = -.05, p = .043). The supplemental cross-lagged findings thus suggest that beyond the notable stability of the self-report measures of faculty self-efficacy, procrastination, and burnout over time (autoregressive paths within variables), specific directions and valences of causal relations may also be inferred (weak yet significant cross-lagged paths between variables). More specifically, higher levels of emotional exhaustion in faculty at Time 1 were found to predict poorer levels of both self-efficacy and procrastination at Time 2, with lower procrastination levels at Time 2 further contributing to exhaustion at Time 3.
The present study findings contribute to existing research on motivational beliefs, self-regulation failure, and psychological health in faculty by examining three quintessential constructs reflecting each psychological domain, namely self-efficacy, procrastination, and burnout (emotional exhaustion). By way of large-scale international recruitment and longitudinal assessments, the present data afforded not only an in-depth analysis of baseline covariance but also shared trajectories in changes over time in these key psychological variables. Concerning relations between self-efficacy and procrastination, our LGCM results provide empirical support for Hypothesis 1 in showing higher faculty self-efficacy to correspond with lower procrastination not only at baseline (intercepts) but especially over time (slopes), with increases in self-efficacy found to correspond with a lower likelihood of increased procrastination over a one-year period. These results thus underscore the utility of Bandura’s  social learning theory for explaining self-regulation behavior in faculty populations and are consistent with the underregulation hypothesis (procrastination as self-regulation failure [57,62]) as well as recent findings showing negative cross-sectional relations between self-efficacy and procrastination among female faculty .
The present LGCM findings additionally provide support for Hypothesis 2 in showing greater faculty self-efficacy to further correspond with lower levels of emotional exhaustion at baseline as well as a significantly lower likelihood of increased exhaustion over time. Accordingly, these findings again support the use of Bandura’s  social-cognitive theory to account for psychological well-being in post-secondary faculty, and are consistent with recent cross-sectional findings with academic staff showing greater self-efficacy to correlate with more positive emotions  and lower occupational stress . Our latent growth results also supported Hypothesis 3 such that greater procrastination at baseline, and especially over time, was found to consistently correspond with higher exhaustion levels in our faculty sample. These findings are thus additionally aligned with the misregulation hypothesis (e.g., procrastination as emotion regulation [65–66]) as well as recent cross-sectional findings with female faculty .
Study limitations and implications
Despite consistent empirical support for each of the study hypotheses, it is important to understand the present findings in the context of limitations that could impact replicability and generalizability. First, as has long been suggested in research on the domain-specificity of motivation measures , observed relations in this study may be underestimated due to our study measures being global in nature as opposed to differentiating between academic tasks (e.g., faculty self-efficacy for research vs. teaching [31,46]). Second, whereas the present measure of faculty self-efficacy assessed both teaching and research competencies, it did not address service responsibilities (e.g., public scholarship ) thus warranting replication with respect to this third critical set of academic tasks. Third, despite preliminary analyses suggesting a lack of systematic attrition as a function of demographic and psychological factors, it is nevertheless possible for missing data to bias latent growth results  with faculty who persisted with study completion (or the academic profession) over the one-year study period possibly demonstrating academic “survival bias” .
A fourth limitation of this study concerns the exploratory cross-lagged analyses in that although they provide preliminary evidence of directional relationships between the faculty self-efficacy, procrastination, and exhaustion, the magnitudes of these relations were notably weak requiring further research to obtain and triangulate stronger empirical evidence of causal links (e.g., qualitative interviews, observational data, experimental methods). Finally, it also possible that due to the use of social media as a participant recruitment method (i.e., Facebook, Twitter), the present sample may not be representative of faculty who do not regularly use social media (e.g., an estimated 56% of faculty do not use Twitter ) with greater attrition rates observed in studies with online recruitment having also potentially contributed to Type I error (e.g., MTurk ). However, these recruitment concerns are mitigated in that academics tend to engage regularly with the primary social media platform used for recruitment (e.g., over 50% of academics in the social sciences, arts, and humanities report using Facebook on a regular basis ) with our preliminary analyses also showing no differences in gender, age, country, years of employment, self-efficacy, or procrastination due to attrition. Moreover, emerging research further demonstrates largely equivalent (or even superior) validity of responses obtained from participants recruited via social media vs. in-person methods .
These limitations notwithstanding, these findings also contribute to existing theories relevant to faculty motivation, self-regulation, and burnout in the following ways. For example, to the extent that greater emotional exhaustion is indicative of excessive work requirements, these results suggest that the effects of context (exhaustion) on motivation (self-efficacy) may be stronger than vice versa, thus clarifying the proposed bidirectional relationship between these variables in Bandura’s  social learning theory (i.e., triadic reciprocity) when applied to faculty. Similarly, our cross-lagged findings provide stronger support for the misregulation hypothesis than the underregulation hypothesis  suggesting that procrastination may represent a self-protective response to threats to emotional well-being in faculty. Similarly, to the extent that self-efficacy represents an internal psychological resource, and procrastination may imply cognitive disengagement, these findings suggest that the well-known Job Demands-Resources model of occupational burnout  may be optimally adapted to faculty populations by examining disengagement as an outcome as opposed to a correlate of burnout experiences.
Concerning practical implications of the study findings, beyond our LGCM analyses demonstrating significant relations over time between our study variables, our cross-lagged analyses further suggest burnout to be more likely to predict subsequent self-efficacy and procrastination than vice versa. Although this effect was weak in magnitude and exploratory in nature, it may nevertheless help to inform orientation and intervention efforts for faculty moving forward if replicated in future studies. More specifically, whereas existing professional development efforts to date aimed at improving faculty self-efficacy beliefs [27,41–42] or reducing procrastination [17,75] show promise with respect to performance and productivity gains, increased institutional efforts to reduce known antecedents of emotional exhaustion due to overwork (e.g., teaching demands ; research pressures ; for a review, see ) may be more effective for improving psychological health in faculty internationally.
- 1. Blix AG, Cruise RJ, Mitchell BM, Blix GG. Occupational stress among university teachers. Journal of Educational Research. 1994;36: 157–169.
- 2. Catano V, Francis L, Haines T, Kirpalani H, Shannon H, Stringer B, et al. Occupational stress in Canadian universities: A national survey. International Journal of Stress Management. 2010;17: 232–258.
- 3. Winefield AH, Boyd CM, Saebel J, Pignata S. Update on national university stress study. Australian Universities Review. 2008;50: 20–29.
- 4. Watts J, Robertson N. Burnout in university teaching: A systematic literature review. Journal of Educational Research. 2011;53: 33–50.
- 5. Gomes AR, Faria S, Gonçalves AM. Cognitive appraisal as a mediator in the relationship between stress and burnout. Work & Stress. 2013;27: 351–367.
- 6. Feldman KA, Paulsen MB. Faculty motivation: The role of supporting teaching culture. New Directions for Teaching and Learning. 1999;78: 69–78.
- 7. Lee J. Instructional support for distance education and faculty motivation, commitment, satisfaction. British Journal of Educational Technology. 2002;32: 153–160.
- 8. Sabagh Z, Hall NC, Saroyan A. Antecedents, correlates, and consequences of faculty burnout. Educational Research. 2018;60: 1–26.
- 9. Salimzadeh R, Saroyan A, Hall NC. Examining the factors impacting academics’. psychological well-being: A review of research International Education Research. 2017;5: 13–44.
- 10. Morris DB, Usher EL. Developing teaching self-efficacy in research institutions: A study of award-winning professors. Contemporary Educational Psychology. 2011;36: 232–245.
- 11. Stupnisky RH, BrckaLorenz A, Yuhas B, Guay F. Faculty members’ motivation for teaching and best practices: Testing a model based on self-determination theory across institution types. Contemporary Educational Psychology. 2018;53: 15–26.
- 12. Perry RP, Clifton RA, Menec VH, Struthers CW, Menges RJ. Faculty in transition: A longitudinal analysis of perceived control and type of institution in the research productivity of newly hired faculty. Research in Higher Education. 2000;41: 165–194.
- 13. Stupnisky RH, Hall NC, Daniels LM, Mensah E. Testing a model of pretenure faculty members’ teaching and research success: Motivation as a mediator of balance, expectations, and collegiality. The Journal of Higher Education. 2017;88: 376–400.
- 14. Navarro MLA, Mas MB, Jiménez AML. Working conditions, burnout and stress symptoms in university professors: Validating a structural model of the mediating effect of perceived personal competence. The Spanish Journal of Psychology. 2010;13: 284–296. pmid:20480697
- 15. Tümkaya S. Burnout and humor relationship among university lecturers. Humor. 2007;20: 73–92.
- 16. Ackerman DS, Gross BL. I can start that “JME” manuscript next week, can’t I? The task characteristics behind why faculty procrastinate. Journal of Marketing Education. 2007;29: 97–110.
- 17. Boice R. Procrastination, busyness, and bingeing. Behavior Research and Therapy. 1989;27: 605–611.
- 18. Hammond C. Integrating service and academic study: Faculty motivation and satisfaction in Michigan higher education. Michigan Journal of Community Service Learning. 1994;1: 21–28.
- 19. Hardré PL, Beesely AD, Miler RL, Pace TM. Faculty motivation to do research: Across disciplines in research-extensive universities. Journal of the Professoriate. 2011;5: 35–69.
- 20. Bandura A. Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review. 1977;84: 191–215. pmid:847061
- 21. Bandura A. Self-efficacy. In: Ramachaudra VS, editor. Encyclopedia of mental health. New York, NY: Academic Press; 1994. pp. 4–71.
- 22. Schunk DH, Pajares F. Self-efficacy theory. In: Wentzel KR, Wigfield A, editors. Handbook of motivation at school. New York: Routledge; 2009. pp. 35–53.
- 23. Sverdlik A, Hall NC, Hubbard KA, McAlpine L. The PhD experience: A review of the factors influencing doctoral students’ completion, achievement, and well-being. International Journal of Doctoral Studies. 2018;13: 361–388.
- 24. Klassen R, Tze VMC. Teachers’ self-efficacy, personality, and teaching effectiveness: A meta-analysis. Educational Research Review. 2014;12: 59–76.
- 25. Visser-Wijnveen GJ, Stes A, Van Petegem P. Development and validation of a questionnaire measuring teachers’ motivations for teaching in higher education. Higher Education. 2012;64: 421–436.
- 26. Zhao J, McCormick J, Hoekman K. Idiocentrism-allocentrism and academics’ self-efficacy for research in Beijing universities. International Journal of Educational Management. 2008;22: 168–183.
- 27. Wyatt M, Dikilitaş K. English language teachers becoming more efficacious through research engagement at their Turkish university. Educational Action Research. 2016;24: 550–570.
- 28. Vasil L. Self-efficacy expectations and causal attributions for achievement among male and female university faculty. Journal of Vocational Behavior. 1992;41: 259–269.
- 29. Colbeck CL, Weaver LD. Faculty engagement in public scholarship: A motivation systems theory perspective. Journal of Higher Education Outreach and Engagement. 2008;12: 7–30.
- 30. Ellett CD, Demir K, Monsaas J. Science and mathematics faculty responses to a policy-based initiative: Change processes, self-efficacy beliefs, and department culture. Innovative Higher Education. 2015;40: 127–141.
- 31. Bailey JG. Academics’ motivation and self-efficacy for teaching and research. Higher Education Research & Development. 1999;18: 343–359.
- 32. Jegede PO. Factors in computer self-efficacy among Nigerian college of education teachers. Journal of Psychology in Africa. 2007;17: 39–44.
- 33. Hemmings BC, Kay R, Sharp J, Taylor C. A transnational comparison of lecturer self-efficacy. Journal of Further and Higher Education. 2012;36: 291–307.
- 34. Hemmings BC. Strengthening the teaching self-efficacy of early career academics. Issues in Educational Research. 2015. pp. 1–17.
- 35. Reyes-Cruz M del R, Perales-Escudero MD. Research self-efficacy sources and research motivation in a foreign language university faculty in Mexico: Implications for educational policy. Higher Education Research and Development. 2016;35: 800–814.
- 36. Schoen LG, Wincour S. An investigation of the self-efficacy of male and female academics. Journal of Vocational Behaviour. 1988;32: 307–320.
- 37. Hemmings BC, Kay R. Research self-efficacy, publication output, and early career development. International Journal of Educational Management. 2010;24: 562–574.
- 38. Landino RA, Owen SV. Self-efficacy in university faculty. Journal of Vocational Behavior. 1988;33: 1–14.
- 39. Klassen RM., Chiu MM. Effects on teachers' self-efficacy and job satisfaction: Teacher gender, years of experience, and job stress. Journal of Educational Psychology, 2010;102, 741–756.
- 40. Pinheiro SO, White HK, Buhr GT, Elbert-Avila K, Cohen HJ, Heflin MT. Advancing geriatrics education through a faculty development program for geriatrics-oriented clinician educators. Journal of the American Geriatrics Society. 2015;63: 2580–2587. pmid:26563754
- 41. Postareff L, Lindblom-Ylanne S, Nevgi A. The effect of pedagogical training on teaching in higher education. Teaching and Teacher Education. 2007;23: 557–571.
- 42. Postareff L, Lindblom- Ylanne S, Nevgi A. A follow-up study of the effect of pedagogical training on teaching in higher education. Higher Education. 2008;56: 29–43.
- 43. Singh T, De Grave W, Ganjiwale J, Supe A, Burdick WP, Van Der Vleuten C. Impact of a fellowship program for faculty development on the self-efficacy beliefs of health professions teachers: A longitudinal study. Medical Teacher. 2013;35: 359–364. pmid:23444892
- 44. Carnes M, Devine PG, Manwell LB, Byars-Winston A, Fine E, Ford CE. Effect of an intervention to break the gender bias habit: A cluster randomized, controlled trial. Academic Medicine. 2015;90: 221–230. pmid:25374039
- 45. Evans L, Tress MB. What drives research-focused university academics to want to teach effectively? Examining achievement, self-efficacy and self-esteem. International Journal for the Scholarship of Teaching and Learning. 2009;3: 12.
- 46. Zhang L, Fu M, Li DT, He Y. Emotions and teaching styles among academics: the mediating role of research and teaching efficacy. Educational Psychology. 2019;39: 370–394.
- 47. Hemmings BC, Kay R. The relationship between research self-efficacy. research disposition and publication output Educational Psychology. 2015;36: 347–361.
- 48. Pasupathy R, Siwatu KO. An investigation of research self-efficacy beliefs and research productivity among faculty members at an emerging research university in the USA. Higher Education Research & Development. 2014;33: 728–741.
- 49. Sharma M, Kaur G. Occupational self-efficiency and procrastination as predictors of occupational stress among female lectures. Journal of Psychosocial Research. 2013;8: 275–285.
- 50. Schunk DH, Greene JA, editors. Handbook of self-regulation of learning and performance. 2nd Edition. New York: Routledge; 2017.
- 51. Hall NC, Goetz T, editors. Emotion, motivation, and self-regulation: A handbook for teachers. Bingley, UK: Emerald; 2013.
- 52. Zhang Q, Zhu W. Exploring emotion in teaching: Emotional labor, burnout, and satisfaction in Chinese higher education. Communication Education. 2018;57: 105–122.
- 53. Hill MB, Hill DA, Chabot AE, Barrall JF. A survey of college faculty and student procrastination. College Student Journal. 1978;12: 256–262.
- 54. Paden N, Stell R. Reducing procrastination through assignment and course design. Journal of Marketing Education Review. 1997;7: 17–25.
- 55. Ackerman DS, Gross BL. My instructor made me do it: Task characteristics of procrastination. Journal of Marketing Education. 2005;27: 5–13.
- 56. Balkis M, Duru E. The evaluation of the major characteristics and aspects of the procrastination in the framework of psychological counseling and guidance. Educational Sciences: Theory and Practice. 2007;7: 376–385.
- 57. Steel P. The nature of procrastination: A meta-analytic and theoretical review of quintessential self-regulatory failure. Psychological Bulletin. 2007;133: 65–94. pmid:17201571
- 58. Baumeister RF, Heatherton TF. Self-regulation failure: An overview. Psychological Inquiry. 1996;7: 1–15.
- 59. Howell AJ, Watson DC. Procrastination: Associations with achievement goal orientation and learning strategies. Personality and Individual Differences. 2007;43: 167–178.
- 60. Pychyl TA. Solving the procrastination puzzle: A concise guide to strategies for change. New York, NY: Tarcher/Penguin; 2013.
- 61. Tuckman BW. The development and concurrent validity of the procrastination scale. Educational and Psychological Measurement. 1991;51: 473–480.
- 62. Ferrari JR. Procrastination as self-regulation failure of performance: Effects of cognitive load, self-awareness, and time limits on ‘working best under pressure.’ European Journal of Personality. 2001;15: 391–406.
- 63. Senécal C, Koestner R, Vallerand RJ. Self-regulation and academic procrastination. The Journal of Social Psychology. 1995;135: 607–619.
- 64. Balkis M, Duru E. Procrastination, self-regulation failure, academic life satisfaction, and affective well-being: Underregulation or misregulation form. European Journal of Psychology Education. 2016;31: 439–459.
- 65. Pychyl TA, Sirois FM. Procrastination, emotion regulation, and well-being. In: Sirois FM, Pychyl T, editors. Procrastination, health, and well-being. London, UK: Academic Press; 2016. pp. 163–188.
- 66. Sirois F, Pychyl T. Procrastination and the priority of short‐term mood regulation: Consequences for future self. Social and Personality Psychology Compass. 2013;7: 115–127.
- 67. Balkis M, Duru E, Bulus M. Analysis of the relation between academic procrastination, academic rational/irrational beliefs, time preferences to study for exams, and academic achievement: A structural model. European Journal of Psychology of Education. 2013;28: 825–839.
- 68. Gareau A, Chamandy M, Klijajic K, Gaudreau P. The detrimental effect of academic procrastination on subsequent grades: the mediating role of coping over and above past achievement and working memory capacity. Anxiety, Stress, & Coping. 2018;32: 141–154.
- 69. Kim KR, Seo EH. The relationship between procrastination and academic performance: A meta-analysis. Personality and Individual Differences. 2015;82: 26–33.
- 70. Klassen RM, Krawchuk LL, Rajani S. Academic procrastination of undergraduates: Low self-efficacy to self-regulate predicts higher levels of procrastination. Contemporary Educational Psychology. 2008;33: 915–931.
- 71. Klassen RM, Ang RP, Chong WH, Krawchuk LL, Huan VS, Wong IY, et al. Academic procrastination in two settings: Motivation correlates, behavioral patterns, and negative impact of procrastination in Canada and Singapore. Applied Psychology. 2010;59: 361–379.
- 72. Schraw G, Wadkins T, Olafson L. Doing the things we do: A grounded theory of academic procrastination. Journal of Educational Psychology. 2007;99: 12–25.
- 73. Pychyl TA, Lee JM, Thibodeau R, Beck A. Five days of emotion: An experience sampling study of undergraduate student procrastination. Journal of Social Behavior and Personality. 2000;15: 239–254.
- 74. Tice DM., Baumeister RF. Longitudinal study of procrastination, performance, stress, and health: The costs and benefits of dawdling. Psychological Science. 1997;8: 454–458.
- 75. Boice R. Professors as writers: A self-help guide to productive writing. Stillwater, OK: New: Forums Press; 1990.
- 76. Rozental A, Carlbring P. Understanding and treating procrastination: A review of a common self-regulatory failure. Psychology. 2014;4: 1488–1502.
- 77. Cerino ES. Relationships between academic motivation, self-efficacy, and academic procrastination. Psi Chi Journal of Psychological Research. 2014;19: 156–163.
- 78. Haycock LA, McCarthy P, Skay CL. Procrastination in college students: The role of self-efficacy and anxiety. Journal of Counseling and Development: JCD. 1998;76: 317–324.
- 79. Hensley LC. Reconsidering active procrastination: Relations to motivation and achievement in college anatomy. Learning and Individual Differences. 2014;36: 157–164.
- 80. Schwerdtfeger A, Konermann L, Schonhofen K. Self-efficacy as a health-protective resource in teachers? A biopsychological approach. Health Psychology. 2008;27: 358–368. pmid:18624601
- 81. Skaalvik EM, Skaalvik S. Teacher self-efficacy and teacher burnout: A study of relations. Teaching and Teacher Education. 2010;26: 1059–1069.
- 82. Wang H, Hall NC, Rahimi S. Self-efficacy and causal attributions in teachers: Effects on burnout, job satisfaction, illness, and quitting intentions. Teaching and Teacher Education. 2015;47: 120–130.
- 83. Ariani DW, Susilo YS. Why do it later? Goal orientation, self-efficacy, test anxiety, on procrastination. Journal of Educational, Cultural and Psychological Studies. 2018;17: 45–73.
- 84. Constantin K, English MM, Mazmanian D. Anxiety, depression, and procrastination among students: rumination plays a larger mediating role than worry. Journal of Rational-Emotive & Cognitive-Behavior Therapy. 2018;36: 15–27.
- 85. Glick DM, Millstein DJ, Orsillo SM. A preliminary investigation of the role of psychological inflexibility in academic procrastination. Journal of Contextual Behavioral Science. 2014;3: 81–88.
- 86. Macher D, Paechter M, Papousek I, Ruggeri K. Statistics anxiety, trait anxiety, learning behavior, and academic performance. European Journal of Psychology of Education. 2012;27: 483–498.
- 87. Onwuegbuzie AJ. Academic procrastination and statistics anxiety. Assessment & Evaluation in Higher Education. 2004;29: 3–19.
- 88. Hall NC. @AcademicsSay: The Story Behind a Social-Media Experiment. The Chronicle of Higher Education. 2015 Jul 1. [Cited 2019 Dec 17]. Available from: https://www.chronicle.com/article/AcademicsSay-The-Story/231195
- 89. Hall NC. The SAS Project: A case study of motivation research recruitment via social media. Paper presented at: Conference on Motivation and Social Perception; 2016 Jul 19–21; Gdansk.
- 90. Hall NC. @AcademicsSay: A case study in faculty engagement via Twitter. Paper presented at: American Educational Research Association Annual Meeting; 2017 Apr 27-May 1; San Antonio.
- 91. Steel P. Arousal, avoidant and decisional procrastinators: Do they exist? Personality and Individual Differences. 2010;48: 926–934.
- 92. McCown W, Johnson J. Differential arousal gradients in chronic procrastination. Paper presented at the Annual Meeting of the American Psychological Association. Alexandria, VA; 1989.
- 93. Mann L, Burnett P, Radford M, Ford S. The Melbourne Decision Making Questionnaire: An instrument for measuring patterns for coping with decisional conflict. Journal of Behavioral Decision Making. 1997;10: 1–19.
- 94. Lay CH. At last, my research article on procrastination. Journal of Research in Personality. 1986;20: 474–495.
- 95. Diener E, Emmons RA, Larsen RJ, Griffin S. The satisfaction with life scale. Journal of Personality Assessment. 1985;49: 71–75. pmid:16367493
- 96. Maslach C, Jackson SE, Leiter MP. Maslach burnout inventory manual. Mountain View. 3rd ed. California: CPP, Inc; 1996.
- 97. Frisby BN, Goodboy AK, Buckner MM. Students’ instructional dissent and relationships with faculty members’ burnout, commitment, satisfaction, and efficacy. Communication Education. 2015;64: 1–18.
- 98. Poghosyan L, Aiken LH, Sloane DM. Factor structure of the Maslach Burnout Inventory: An analysis of data from large scale cross-sectional surveys of nurses from eight countries. International Journal of Nursing Studies. 2009;46: 894–902. pmid:19362309
- 99. Goodman JS, Blum TC. Assessing the non-random sampling effects of subject attrition in longitudinal research. Journal of Management. 1996;22: 627–652.
- 100. Li E, Duncan TE, C. DS, Acock A. Latent growth modeling of longitudinal data: A finite growth mixture modeling approach. Structural Equation Modeling. 2001;8: 493–530.
- 101. Byrne BM. Structural Equation Modeling with AMOS. 3rd ed. New York: Routledge; 2016.
- 102. Duncan TE, Duncan SC, Strycker LA. An introduction to latent variable growth curve modeling: Concepts, issues, and application. 2nd ed. New York: Routledge; 2013.
- 103. Byrne BM. Structural Equation Modeling with AMOS: Basic concepts, applications, and programming. 2nd ed. New York, NY: Routledge; 2010.
- 104. Hu LT, Bentler PM. Evaluating model fit. In: Hoyle RH, editor. Structural equation modeling: Concepts, issues, and applications. Thousand Oaks, CA: Sage; 1995. pp. 76–99.
- 105. Meyers LS, Gamst G, Guarino AJ. Applied multivariate research: Design and interpretation. 3rd ed. Thousand. Oaks, CA: Sage; 2016.
- 106. Bandalos DL. The effect of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling. Structural Equation Modeling. 2002;9: 78–102.
- 107. Little TD, Cunningham WA, Shahar G, Widaman KF. To parcel or not to parcel: Exploring the question weighing the merits. Structural Equation Modeling. 2002;9: 151–173.
- 108. Prentice DA, Miller DT. When small effects are impressive. Psychological Bulletin. 1992;112: 160–164.
- 109. Marsh HW. Academic self-concept: Theory measurement and research. In: Suls J, editor. Psychological perspectives on the self. Hillsdale, NJ: Erlbaum; 1993. pp. 59–98.
- 110. Duncan SC, Duncan TE. Modeling incomplete longitudinal substance use data using latent variable growth curve methodology. Multivariate Behavioral Research. 1994;29: 313–338. pmid:26745232
- 111. Lutter M, Schröder M. Who becomes a tenured professor and why? Panel data evidence from German sociology, 1980–2013. Research Policy. 2016;45: 999–1013.
- 112. Seaman J, Tinti-Kane H. Social media for teaching and learning. Boston, MA: Pearson Learning Solutions; 2013.
- 113. Zhou H, Fishbach A. The pitfall of experimenting on the web: How unattended selective attrition leads to surprising (yet false) research conclusions. Journal of Personality and Social Psychology. 2016:111:493–504. pmid:27295328
- 114. Van Noorden R. Online collaboration: Scientists and the social network. Nature. 2014:512: 126–129. pmid:25119221
- 115. Casler K, Bickel L, Hackett E. Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in Human Behavior. 2013:29: 2156–2160.
- 116. Demerouti E, Bakker AB, Nachreiner F, Schaufeli WB. The job demands-resources model of burnout. Journal of Applied Psychology. 2001;86: 499–512. pmid:11419809