Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The WellNext Scan: Validity evidence of a new team-based tool to map and support physicians’ well-being in the clinical working context

  • Sofiya Abedali ,

    Contributed equally to this work with: Sofiya Abedali, Joost van den Berg, Alina Smirnova, Kiki Lombarts

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Visualization, Writing – original draft, Writing – review & editing

    s.abedali@amsterdamumc.nl

    Affiliations Department of Medical Psychology, Research group Professional Performance and Compassionate Care, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands

  • Joost van den Berg ,

    Contributed equally to this work with: Sofiya Abedali, Joost van den Berg, Alina Smirnova, Kiki Lombarts

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Department of Medical Psychology, Research group Professional Performance and Compassionate Care, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands, Department of Internal Medicine and Geriatrics, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands

  • Alina Smirnova ,

    Contributed equally to this work with: Sofiya Abedali, Joost van den Berg, Alina Smirnova, Kiki Lombarts

    Roles Conceptualization, Formal analysis, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Department of Medical Psychology, Research group Professional Performance and Compassionate Care, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands, Department of Family Medicine, University of Calgary, Calgary, Canada

  • Maarten Debets ,

    Roles Conceptualization, Methodology, Writing – review & editing

    ‡ MD and RB also contributed equally to this work.

    Affiliations Department of Medical Psychology, Research group Professional Performance and Compassionate Care, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands

  • Rosa Bogerd ,

    Roles Methodology, Writing – review & editing

    ‡ MD and RB also contributed equally to this work.

    Affiliations Department of Medical Psychology, Research group Professional Performance and Compassionate Care, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands

  • Kiki Lombarts

    Contributed equally to this work with: Sofiya Abedali, Joost van den Berg, Alina Smirnova, Kiki Lombarts

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Department of Medical Psychology, Research group Professional Performance and Compassionate Care, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands

Abstract

Occupational well-being is inherent to physicians’ professional performance and is indispensable for a cost-effective, robust healthcare system and excellent patient outcomes. Increasing numbers of physicians with symptoms of burnout, depression, and other health issues are demonstrating the need to foster and maintain physicians’ well-being. Assessing physicians’ well-being, occupational demands, and resources can help create more supportive and health-promoting working environments. The WellNext Scan (WNS) is a 46-item questionnaire developed to assess (i) physicians’ well-being and (ii) relevant factors related to physicians’ clinical working environment. We collected data to investigate the validity and reliability of the WNS using a non-randomized, multicenter, cross-sectional survey of 467 physicians (staff, residents, doctors not in training, and fellows) from 17 departments in academic and non-academic teaching medical centers in the Netherlands. Exploratory factor analysis detected three composite scales of well-being (energy and work enjoyment, meaning, and patient-related disengagement) and five explanatory factors (supportive team culture, efficiency of practice, job control and team-based well-being practices, resilience, and self-kindness). Pearson’s correlations, item-total and inter-scale correlations, and Cronbach’s alphas demonstrated good construct validity and internal consistency reliability of the scales (α: 0.67–0.90; item-total correlations: 0.33–0.84; inter-scale correlations: 0.19–0.62). Overall, the WNS appears to yield reliable and valid data and is now available as a supportive tool for meaningful team-based conversations aimed at improving physician well-being.

Introduction

Physician well-being is inherent to effective professional performance and is indispensable for a cost-effective, robust healthcare system and excellent patient outcomes. [15] However, physicians worldwide are encountering threats to their well-being, as evidenced by widespread reports of burnout, symptoms of depression, and other health issues. [612] Individual characteristics such as resilience and self-compassion can also contribute to well-being, while low self-compassion and low resilience are linked to a higher risk of burnout symptoms. [1315]

Although various initiatives have been launched to enhance physicians’ well-being, the focus has leaned towards individual approaches to enhancing well-being. [1317] However, the focus on individual approaches does not sufficiently address essential organizational cultural elements, such as shared ways of thinking, ideas, and behaviors within the working unit [18,19] and structural elements in the organization, including systems used to support and enable good workflow and performance. Moreover, research shows that focusing only on individual approaches without aiming to change professional values or organizational culture can cause physicians to resist well-being interventions. [20] The vital role of colleagues in physicians’ daily professional lives also needs to be acknowledged, as colleagues are essential factors in well-being through the quality of working relationships, social capital and support, and collective decision-making. [11,21] Following the job demands and resources (JD-R) model, one could describe the cultural and structural determinants of physicians’ working environment as job demands and job resources [2224], and an imbalance, i.e., high work demands and insufficient job resources, would elevate the risk for diminished well-being. [1,2528] A health-promoting and supportive culture in the team and the organization could be perceived as a job resource that benefits the well-being of the individual physician or the team. In contrast, research has shown that demanding aspects of the clinical working environment, such as reduced autonomy, high workloads, administrative burdens, and lack of leadership and support, are associated with physician burnout. [7,18,29] These job demands and resources should be addressed on a team- or organizational-level to cultivate a holistic and effective response to physicians’ multifaceted challenges. [17,23,25,30,31]

Research has suggested that the first step in enhancing well-being and creating healthier work environments is to assess and discuss how physicians experience well-being and its underlying influential factors in their daily practice. [16] Discussing shared demands and resources can be a starting point for improving well-being and adapting the working environment by relating to the needs of all team members.

Various valid questionnaires exist for assessing aspects of physicians’ well-being, [32] identifying burnout or distress, [33,34] or evaluating organizational demands and resources affecting occupational well-being. [35] Three issues remain under-addressed in these measures. First, the predominant focus on individual assessments rather than team measures provides limited information and may cause resistance and decrease the effect of following well-being interventions. [20] Second, many current instruments do not incorporate positive and negative well-being indicators, although a more holistic measurement of well-being can be beneficial in designing targeted interventions. [3638] Third, they are not specific to the influencing factors within the working environment of hospital-based physicians in the Netherlands. Therefore, we aimed to develop a new assessment tool, the WellNext Scan (WNS), that is practice-oriented, team-centered, and user-friendly and reflects a comprehensive approach toward well-being by including important influencing factors in the working environment of physicians. The WNS inquires about (i) elements of organizational culture and climate (i.e., psychological safety, team cohesion, and perceived support for self-care), [3941] (ii) factors from the organizational structural context that reflect how supported and enabled physicians feel in their work by the department and institution (i.e., efficiency, career development opportunities, autonomy, and daily work hassles), and lastly incorporates items relating to individual strengths and resources (resilience, self-kindness, and self-care). [18,29,42,43] With this approach, the WNS recognizes the interconnected nature of individual well-being and broader team and organizational influences.

In this paper, we elaborate on the WNS development and aim to investigate 1) the validity and 2) the reliability of the WNS questionnaire. The aim of developing the WNS and its use in practice is to facilitate meaningful physician team dialogues to address and foster physician well-being in the workplace. Utilizing the WNS provides physician teams with tailor-made reports to guide collaborative reflection and prioritize potential improvement actions.

Materials and methods

WellNext scan questionnaire development

Rationale of measuring well-being.

The concept of well-being has been variably defined in the past decades. However, many definitions include descriptions of its multidimensional nature, which encompasses both positive and negative aspects. [32,4248] Using the eudaimonic and hedonic well-being strands in philosophy, well-being can be described as an affective state of emotional, physical, mental, and social nature. Eudaimonic well-being refers to living a purposeful and meaningful life with continued personal growth and quality ties to others. Hedonic well-being describes what makes experience and work life (un)pleasant based on an individual evaluation – such as happiness and satisfaction. [43,4951] Likely, an individual who functions well in life will also have positive feelings about this life. [50,52,53] The combination of both well-being philosophies has been proposed before as research suggests that they are interconnected, and both philosophical perspectives provide a more comprehensive understanding of well-being. [5457] The importance of including positive and negative well-being indicators to provide a more holistic understanding of the dynamic interactions of well-being facets has also been stressed in research before. [36,58] Positive and negative experiences are not merely opposites of each other but are rather distinct dimensions that could contribute to well-being independently. [3638] Including positive and negative well-being indicators also has the potential to allow for designing targeted interventions, preventative measures, and adequate support to enhance positive well-being and mitigate negative well-being by linking specific and common factors in the working context that contribute to positive or negative well-being experiences. This can be useful in identifying root causes for positive affect or distress. [36,37,58,59]

Background and aims of instrument development.

The WNS was built upon a previously developed prototype tool that resulted from a larger well-being intervention by Debets et al. [60] amongst 377 physicians from 48 teams in multiple Dutch hospitals. The project included a literature review, a needs assessment, a 75-item questionnaire assessing well-being and working conditions, the design of a feedback report, and guided follow-up amongst four teams. [60] Physicians’ positive response to the piloted well-being intervention led to the decision to develop a short, practice-focused tool that is easily accessible and facilitates a meaningful discussion by providing teams with a team-level report.

The WNS was designed for hospital-based teams with physicians across roles (faculty, staff, residents, junior doctors, and fellows) to evaluate team members’ experienced well-being, the associated elements of organizational culture and structure within their teams and organizations, and physicians’ psychological strengths. The rationale of the research team for the new instrument prescribed that the WNS would (i) acknowledge the multidimensional nature of well-being and its dependence on individual and organizational factors, (ii) acknowledge measures deemed relevant by physicians as determined in the previous project, (iii) make use of validated constructs when available and (iv) acknowledge the potential administrative burden for its users by limiting each influencing domain to a maximum of 10 items, while considering that it can be filled out in maximum 10 minutes.

Instrument development.

We used multiple approaches to generate items describing the factors influencing physician well-being within the clinical working context. The identified influencing factors were initially grouped into (i) elements of organizational culture and climate, (ii) organizational structural context, and (iii) individual strengths and resources, resembling the three proposed domains of the Stanford model of professional fulfillment framework, that suggests that the culture at work, the efficient organization of practice, and physicians’ resilience are interconnected and affect physicians’ professional fulfilment. [18,61]

The primary information source for the influencing factors was the pilot of the preceding well-being program, described in more detail in the study of Debets et al. [60] Next, KL, MD, and RB updated the literature search (unpublished material), extracted the most relevant factors linked to physicians’ well-being and burnout on individual, team- and organizational levels and sought validated scales for the respective items. [16,30,62,63] KL, MD, and RB selected ten items for the individual, cultural, and structural factors, respectively. We adapted items from existing questionnaires to better fit the context and objectives of the WNS and added items that reflect specific work-related topics and norms. The domain elements of organizational culture and climate will be used as an example. Here, we combined items that reflect psychological safety culture and psychological safety climate with items on team cohesion for a holistic view of the support that physicians experience from their close colleagues and department leadership. The S1 File , Theoretical Background of the WellNext Scan, lists all items and their theoretical origins. [18,61] MD, KL, and RB adapted items to the Dutch language and healthcare context and their cultural relevance to our target population, i.e., Dutch physicians in different training and practice levels working in teams with multiple other physicians.

The final selection of items was presented to physicians independent of the research team regarding the clarity and relevance of the items for studying physicians’ well-being, and significant factors in their working environment, that describe elements of organizational culture and structure. [64] With the feedback from these physicians, we adjusted the WNS questionnaire, which was subsequently piloted.

Measures.

The final WNS questionnaire comprises 46 items, leaving room for free text comments after each section. The response categories for all subscales of the WNS were unified to a 5-point Likert scale, ranging from 1 =  “Not at all true” to 5 =  “Completely true.” Three items were phrased negatively (see Table 3). All definitions of the WNS sub-scales and their measures are explained in more detail in the S1 File, Theoretical Background of the WellNext Scan.

Well-being.

To measure well-being in the WNS, we used a validated measure that assesses physicians’ professional fulfillment, work exhaustion, and interpersonal disengagement that captures both hedonic (i.e., “I feel happy at work”) and eudaimonic (i.e., “My work is meaningful to me”) aspects of physician occupational well-being is the Professional Fulfilment Index (PFI). The PFI has a multidimensional view of well-being, including physical, emotional, mental, and social dimensions. It is measured with professional fulfillment (n = 6), work exhaustion (n = 4), and interpersonal disengagement related to patient care (n = 6). All items are originally scored on a 5-point Likert scale (0–4). The cutoff scores are 3 for professional fulfillment and 1.33 for work exhaustion and interpersonal disengagement and were calculated by averaging all subscale items. The cutoff scores for the Dutch context have not been calculated yet, but a high score on professional fulfillment is positive, and, in contrast, a low score on work exhaustion and interpersonal disengagement can be considered positive.

Influencing factors.

The organizational culture and climate factor elements were measured with items reflecting psychological safety (climate), perceived possibilities of part-time work, and team cohesion. [39,41] The organizational structural context was measured with career development opportunities, [65] autonomy, and perception of supportive workplace systems. Individual strengths and resources reflect the measures for resilience, [66] self-kindness, [67] and self-care strategies, such as daily balance and cognitive awareness. [68] The theoretical links of these concepts to well-being are further elaborated in S1 File.

WellNext scan questionnaire validation

Study setting.

This study was a non-randomized, cross-sectional survey of physician teams consisting of junior doctors, residents, fellows, and staff from multiple (non)-academic medical centers in the Netherlands. In the Netherlands, recent medical graduates can work as junior doctors before residency training or enter residency training directly from medical school. Residency training, lasting up to six years, is a prerequisite for becoming a registered medical specialist. In the Netherlands, there are regulations, mandates and initiatives promoting the well-being of healthcare professionals, including physicians. Specifically, any medical specialist working with residents and junior doctors is expected to provide supervision and education and must, thus, comply with Dutch well-being mandates, according to which resident well-being may be considered part of the quality assessment of residency training programs. [33] These mandates may include working hours regulations, work-life balance provisions, and mental health and well-being support systems. Thus, junior doctors, residents, fellows, and staff collectively contribute to the well-being and influencing factors in the working environment. Furthermore, Dutch residents are increasingly involved in departmental decisions, including decisions about their training program and how healthcare is delivered in their department. This is partly because regularly discussing clinical and teaching performance is common and partially integrated into physicians’ training and re-registration regulations. As a result of recent mandates, monitoring the well-being of physicians has become part of the physician teams’ quality improvement cycle, which is usually initiated by the organization or department. Departments generally have access to multiple tools and interventions including interventional groups, coaches, mindfulness, and resilience trainings, but most interventions target the individual.

Data collection.

Members of physician teams, including faculty, residents, junior doctors, and fellows working in academic and non-academic teaching hospitals in the Netherlands, were invited to participate. Data were collected between March 2021 and July 2023 using a nationally known web-based data collection platform to support regular quality assurance and improvement activities in medical education and professional development. Invitations and several reminders were sent based on the preferences of the local initiator of the WNS, usually departmental leadership or program director. Participation was not mandatory, but team members were encouraged to participate. Participants could fill out the questionnaire at any given moment within the set time frame after receiving their invitation and fill out the questionnaire individually. It was not possible to skip questions on the WNS items, and partial questionnaires were not included in the analysis. Thus, this study has no missing data on the WNS items. However, there is missing demographic information, for example, regarding gender. Participants provided written consent for their data to be used for scientific research on the WellNext Scan before starting the survey. The WNS findings were summarized in team reports and fed back to the participating teams anonymously. For the WNS reports, measures were installed to safeguard and protect physician anonymity.

Statistical analysis

Before conducting the primary analyses, we screened the data using descriptive statistics on the demographic variables of participants’ age (below 25 to above 70 with increments of 5 years), gender (female/male/other), function (medical specialist/ resident/ junior doctor/ fellow), type of hospital (academic hospitals/ specialty clinics/ general hospitals/ top clinical hospitals), and specialty (medical/ surgical/ non-medical/ supportive). Medical specialties were categorized as shown in Table 1 below.

Further, we addressed and identified measurement error outliers by exploring the data and its normality with Kolmogorov-Smirnov tests, which utilize Lilliefors’ significance correction.

To investigate the validity and reliability of the WNS, we conducted analyses concerning construct validity and internal consistency reliability. Construct validity refers to the ability of a test instrument to capture and measure an abstract (theoretical) concept. Ideally, this process is based on multiple sources of information. [69,70] Reliability relates to the consistency of responses across different scales, indicating how consistent the instrument measurement is. [71] Testing reliability supports the interpretation of whether the items within each factor consistently measure the same underlying construct. [72] To examine the construct validity of the WNS, we examined the structure of the well-being constructs separately from the influencing factor constructs using exploratory factor analyses.

Physician well-being.

For the well-being construct, we first examined the original factor structure of the PFI with confirmatory factor analysis (CFA), as it is an already validated measure. We tested a model with three correlating factors (professional fulfillment, work exhaustion, and interpersonal disengagement) with robust maximum likelihood estimation. The model fit was assessed with the Comparative Fit Index (CFI) and the Tucker-Lewis Index (TLI) (>0.95 good fit; ≥  0.90 acceptable fit), the Root Mean Squared Error of Approximation (RMSEA) (<0.06 good fit; < 0.10 poor but acceptable fit), and the x2/ df ratio < 5 rule. [7375] We screened for multicollinearity and tested multiple models, with and without including weaker loading items for each subscale of the PFI. However, the model fit was poor on all indicators (see Appendix, CFA results), which suggested that the PFI model did not fit the data of our study population. Thus, we consequently performed an EFA for all 16 PFI items using principal component analysis with oblimin rotation as used in the original validation study of the PFI. The strategic shift to an EFA aligns with recommended practices in multivariate analysis and instrument development to ensure the model is theoretically sound and empirically validated. [76] The CFA was conducted using the program R, version 4.2.1, with the package lavaan. All other analyses were performed using SPSS, version 26 (IBM et al., 2012).

Influencing factors.

To explore the structure of the influencing factors – theoretically categorized in elements of organizational culture and climate, organizational structural context, and individual strengths and resources—we first conducted sample adequacy tests (Kaiser-Mayer-Olkin measure (>0.6 acceptable), Bartlett’s test of sphericity (p < 0.005)) to assess the significance of all correlations and factorability and sample adequacy of the data for the EFA. [7780] The minimal sample size compliant with the criteria for EFA (between 7–10 cases per variable) suggested in the literature for construct validation and scale refinement was reached with our sample size of 467 participants. [71] Then, we utilized an exploratory factor analysis (EFA) using principal axis factoring with oblique rotation, as the factors were expected to correlate. [71]

For the EFA’s on the well-being construct and the influencing factors, items were assessed for sufficient contribution to the factor model by analyzing communalities (>0.2). Factor structure was determined by analyzing factor loadings (>0.3), the ratio of cross-loadings of items on multiple factors (<75%), the scree plots, and the Kaiser criterion (Eigenvalue > 1). [71] Only items that did not meet these criteria were removed from further analyses.

Reliability and internal consistency.

To assess the internal consistency reliability of all composite scales yielded by the factor analyses and to examine how well individual items correlate with their respective scales and with items in other scales, Cronbach’s α (α=0.60 moderate; α=0.80 strong), item-total, and inter-scale correlations were calculated. Pearson’s correlations with 95% confidence intervals (CI) were used to determine the strength of the item-total and inter-scale correlations. Item-total scale correlations of 0.40 or higher were considered acceptable evidence of the contribution of each item to the scale homogeneity. Inter-scale correlations for the well-being scales and the well-being influencing scales were utilized separately were used to check for the interpretability of the composite scales as distinct albeit correlated constructs (for correlations =< 0.70) (r < 0.30 negligible, r =  0.30 – 0.49 weak, r =  0.50 – 0.70 moderate, and r >  0.71 strong).

Ethical review

The study received a waiver from the Institutional Ethical Review Board of the Amsterdam Medical Centers (reference number W23_124 # 23.151). The waiver concerns ethical aspects, data management, and privacy issues, including general data protection regulation (GDPR).

Results

Participants

The final sample included 467 participants from 17 participating teams from multiple medical specialties. Table 2 shows the descriptive statistics of the study population. The participating teams were diverse in composition, ranging in size from three to fifty members, and included residents, junior doctors, fellows, and staff, usually from a single medical discipline per team.

thumbnail
Table 3. Results from exploratory factor analysis of the well-being subscales in the WNS questionnaire.

https://doi.org/10.1371/journal.pone.0319038.t001

Sample data characteristics.

There were no missing data values for the WNS items. The data was not normally distributed (Kolmogorov-Smirnov Normality Test, p = 0.001). Bartlett’s test of sphericity was significant for the EFA on the well-being constructs (χ2 (120) =  4288.45, p < 0.000) and the influencing factors (χ2 (378) =  3674.24, p < 0.000), showing that the chosen analytic model was appropriate for the given data. The Kaiser-Meyer-Olkin measure of sampling adequacy was high for all scales (KMO: Well-being: 0.90; EFA on influencing factors: 0.87). [81]

The WellNext Scan structure: construct validity, reliability, and internal consistency.

Confirmatory factor analysis on the well-being constructs of the professional fulfillment index.

The original structure of the professional fulfillment index was not confirmed using a robust maximum likelihood confirmatory factor analysis by specifying one model with three correlating scales. The model was significant (Chi2 =  p = 0.00) but suggested a poor fit on all used indicators (CFI = 0.86; TLI = 0.83; RMSEA = 0.11).

In a second model, when analyzing the three subscales separately with a robust maximum likelihood confirmatory factor analysis, professional fulfilment and work exhaustion suggested an acceptable to good model fit according to the CFI (PF: 0.958; WE: 0.995) but an unacceptable fit for interpersonal disengagement (0.852). The Tucker-Lewis-Index only showed an acceptable fit for the subscale work exhaustion (WE: 0.985) but not for professional fulfillment and interpersonal disengagement (PF: 0.935; ID = 0.753). Finally, RMSEA was acceptable for professional fulfillment and work exhaustion but not for ID (PF: 0.103; WE: 0.061; ID: 0.261). The models were significant (x2 =  0.00)

Physician well-being.

The exploratory factor analysis on the well-being construct showed a new structure of three composite sub-scales, which we labeled ‘energy and work enjoyment’ (n = 9), ‘meaning’ (n = 3), and ‘patient-related disengagement’ (n = 4). Table 3 reports the factor loadings, explained variance, communalities, reliability coefficients (Cronbach’s alpha), and the corrected item-total correlations for the three identified well-being subscales. Energy and work enjoyment capture happiness, physical and emotional exhaustion, connectedness, and empathy toward colleagues. Meaning refers to a sense of purpose and value alignment with work, and patient-related disengagement captures aspects specifically related to patients. The factor loadings for all scales were above 0.60, except for one item, ‘I feel in control when dealing with difficult problems at work’ (part of the energy and work enjoyment scale), which still loaded at 0.48. Cronbach’s alphas were high for all three composite scales, varying from α =  0.76 for meaning to α =  0.90 for patient-related disengagement. The item-total correlations were above 0.50 for all items within their respective scales and varied between 0.53 and 0.84. The explained variance for the extracted three scales was satisfactory, and the communalities for each item were acceptable to good (range 0.49 - 0.82).

The inter-scale correlations were below the targeted 0.70 threshold and ranged from 0.34 between meaning and patient-related disengagement to 0.62 between energy and work enjoyment and meaning. Pearson’s correlations between the well-being constructs (Table 4) were significant with the strongest correlation between meaning and energy and work enjoyment (0.62), and the lowest between patient-related disengagement and meaning (0.36).

thumbnail
Table 4. Pearson’s correlations of the WNS well-being scales.

https://doi.org/10.1371/journal.pone.0319038.t004

Influencing factors.

Table 5 gives an overview of the psychometrics of the influencing factor scales resulting from the EFA. The EFA on the 30 items revealed five influencing factors consisting of four to seven items per scale. Three factors described organizational aspects of the working environment: (1) ‘supportive team culture’ ‘ (n=6), (2) ‘job control and team-based well-being practices’ (n = 7), and (3) ‘efficiency of practice’ (n=5). Two factors related to individual physicians’ psychological coping ability are (4) ‘resilience’ (n = 4) and (5) ‘self-kindness’ (n = 6) (see Fig 1). Two items, “I experience a lot of administrative burden in my work” from the factor describing the organizational structural context and “Working part-time is considered quite normal in our department,” did not fit any scale and were therefore excluded from further analyses but will be retained as independent items in the WNS as they are informative for practice.

thumbnail
Table 5. Results from exploratory factor analysis of the influencing factors subscales in the WNS questionnaire.

https://doi.org/10.1371/journal.pone.0319038.t005

thumbnail
Fig 1. The WellNext Scan structure.

Well-being and influencing factors in the working environment.

https://doi.org/10.1371/journal.pone.0319038.g001

The factor loadings were acceptable to good and ranged between 0.40 and 0.73 for all scales, with one item in each factor loading between 0.30 and 0.40. Cronbach’s alphas were moderate to good for all five composite scales, varying from α =  0.67 for resilience to α =  0.79 for job control and team-based practices. The item-total correlations for all items within their respective scales ranged from 0.33, ‘I am adequately supported if I have ICT problems during my work’ (factor 3), to 0.59, for the item, ‘I am comfortable discussing my well-being with colleagues’ (factor 1). The explained variance for the extracted five scales was good, and the communalities for most retained items sufficiently contributed to the factor model (commonalities 0.14 – 0.58). The inter-scale correlations (Table 6) were below the targeted 0.70 threshold. They ranged from 0.19 between self-kindness and efficiency of practice and 0.53 between supportive team culture, and job control and team-based well-being practices.

thumbnail
Table 6. Pearson’s correlations of the WNS influencing factors.

https://doi.org/10.1371/journal.pone.0319038.t006

Discussion

Main findings

This study introduces a new practice-oriented team-based tool – the WellNext Scan—to help map the well-being of physicians working in hospitals and the individual and organizational factors that influence their well-being. The findings suggest that physicians’ well-being can be captured and reliably measured by three correlating scales: energy and work enjoyment, meaning, and patient-related disengagement. Additionally, we identified five influencing factors related to individual (resilience, self-kindness) and organizational (supportive team culture, efficiency of practice, and job control and team-based well-being practices) characteristics. All scales showed good construct validity and moderate to strong internal consistency reliability.

Explanation of results

Physician well-being.

To have a meaningful team dialogue about well-being, insight into how team members experience their well-being in the working context may be a helpful start. To measure physicians’ well-being, as part of the WNS, we used the three-factor professional fulfillment index developed by Trockel et al. (2018), previously validated in the US context. Our exploratory factor analysis demonstrated three factors but with differently composed scales compared to previous PFI research [31,63,82,83], underpinning the importance of additional validation of instruments when used in new contexts. Two things stand out when comparing the original PFI and the well-being scales we identified. First, where the original professional fulfillment (PF) scale combines eudaimonic well-being aspects (i.e., experiencing meaning in work) and hedonic aspects of well-being (i.e., being happy), Dutch physicians view these two as different. We extracted a robust, separate new scale, which we labeled meaning, representing the three eudemonic items referring to fulfillment, meaning, and recognition of one’s values in work. The other three PF items were grouped with those measuring work exhaustion as part of a new scale measuring energy and work enjoyment. Second, the original PFI contains the subscale Interpersonal Disengagement, which includes items referring to relationships with colleagues and patients. Again, Dutch physicians have a different view: items relating to patients clustered strongly as a separate new scale, named patient-related (dis)engagement, whereas the colleagues-related items were part of the newly identified energy and work enjoyment scale. This finding resonates with previous studies, showing that physicians might absorb joy and anger from their colleagues more strongly than from their patients through emotional contagion. [84] Colleagues can be perceived as psychosocial job resources (or demands) – contributing to energy and job satisfaction – potentially moderating the relationship between workload and well-being. [85] A study with Dutch physicians showed that whereas patients observed a professional attitude, colleagues were able to detect changes in physicians’ psychological states, such as high or low work engagement. [86] Similarly, our results mirror previous findings that, on the one hand, emotionally demanding interactions with patients are experienced as a typical job demand of physicians. However, on the other hand, physicians can also derive energy from patient interaction as they are essential for the meaning and fulfillment related to their work. [1,87,88]

Although the well-being constructs’ structure differed in our sample, the analyses showed that three distinct well-being constructs best fit the data. The factor loadings, communalities, and the corrected item-total correlations of each item in the subscales were good according to the selection criteria previously explained. Cronbach’s alphas also demonstrated that the internal consistency of the new subscales is reliable, and Pearson’s correlations indicated that the constructs are correlated but distinct. Professional fulfillment may be perceived differently across cultures due to variations in healthcare organizational structures and cultures, policies, and practices. The linguistic adaptation of the PFI could also have affected physicians’ interpretation of the PFI items.

Influencing factors.

To measure influencing factors in the working context of physicians, we grouped multiple previously validated scales into three overarching factors: 1) elements of organizational culture and climate, 2) organizational structural context, and 3) individual strengths and resources. However, our analysis revealed five factors in total. The individual strengths and resources factor components are subdivided into two scales: resilience and self-kindness. Items from the self-care scale addressing cognitive strategies loaded with resilience, and items relating to daily balance loaded with self-kindness, showing the importance of recognizing and addressing early signs of stress, fatigue, and irritability for both resilience and self-kindness. [68] This clustering resonates with previous research, as resilience and self-kindness are separate important predictors of physicians’ well-being and performance that stimulate professional fulfillment [14,32,89,90], and self-care strategies are hypothesized to promote resilience and self-kindness. [68] Previous research has shown that self-kindness, mindfulness, and self-care actions, reflected in the items of the self-kindness scale, are often employed as coping strategies by physicians. [8,1315] A recent study in the Netherlands showed that self-kind physicians were more fulfilled because they were more resilient and could balance work with private life. [91]

Next, elements of organizational culture and organizational structural context items were grouped into three scales representing organizational aspects differently than we had constructed them. From the items in the theoretically designed structural factor, efficiency and supportive workplace systems comprised the new factor of efficiency of practice. The remaining items of this initial factor—autonomy and career development opportunities—grouped with items representing organizational culture that measure psychological safety, perceived appreciation of one’s skills, and departmental well-being practices in the factor we named job control and team-based well-being practices. This new clustering reflects the views on practicing physicians in the Netherlands in hospital-based contexts compared to the initial theoretical structure. It provides additional validity evidence for the WNS as a new tool for use in clinical practice. The results also highlight the need to investigate the validity and reliability of the new tools. Researchers may start from an organizational knowledge base, approaching a work environment in terms of its organizational culture and structure, as done in this study. However, the results exposed how physicians view their work contexts. Through their eyes, the new factor of job control and team-based well-being practices indicates perceived leadership trust in prioritizing well-being, employee growth, and autonomy on a departmental level. In previous studies, all named concepts show positive associations with professional well-being and satisfaction among physicians [29,30,9294]. This new factor combines aspects relating to self-perception of person-organization fit and how enabled physicians feel to function and thrive at their job, which is in line with previous research. [88,95,96]

Lastly, the remaining items in the theory-based factor measuring elements of organizational culture (psychological safety, psychological safety climate, and team cohesion) composed the new factor supportive team culture, which enquires about perceptions of workplace consequences tied to interpersonal risk-taking, mutual support, inclusivity, trust, care, and open communication among colleagues. [41,97,98]

Implications for clinical practice and medical education.

Using the WNS as a general scan of physicians’ well-being in the occupational context may be instrumental to starting an open dialogue about well-being in teams. It may be supportive in getting to know team members’ perspectives on well-being and work contexts, raising awareness about (un)healthy behaviors or practices, or monitoring well-being improvement actions. In the Netherlands, a recent national study amongst physicians showed severe threats to social safety in clinical work environments, with more than half of the participants reporting having experienced a form of intimidation, sexual harassment, bullying, or discrimination. [99] Professional societies or healthcare institutions could introduce or suggest the WNS for their members or teams to start conversations about social safety at work. We recommend that experienced professionals facilitate these conversations, as this could benefit the understanding, acceptance, and integration of the feedback, often available in Dutch hospitals through human resources or the medical education departments. [41,100102] The WNS offers a valuable, comprehensive tool for physician teams to assess and address these concerns, providing insights into the culture within their working teams and guiding efforts to promote well-being. The rich information provided by the WNS can be used to elucidate points for improvement and help create a meaningful conversation about the results in the department. These points for improvement are deducted from factors or specific items within the WNS report that score very low or high on a team level. We recommend that teams discuss the results of the WNS with a professional coach or facilitator, who will help team members to find solutions together and aim to include all team members in the discussion. This meaningful conversation, in which points for improvement and maintenance are found together as well as solutions, is an important step in creating a better working environment as a team. [97,103]

Teams participating in the WNS can receive anonymized feedback reports with the summarized data of their evaluation. Within Dutch healthcare settings, hierarchical structures often exist, with specific team members holding more authority or decision-making power than others. [104] These power differences may affect how respondents perceive and report on the working culture in daily work, potentially leading to underreporting negative experiences or hesitancy in expressing dissenting opinions. [104,105] The WNS and its report serve as valuable tools in overcoming the challenges posed by potential formal and informal power structures within the team. By providing a platform for all team members to share their insights and suggestions in an anonymized report, the WNS aims to foster inclusivity and equal participation. This approach ensures that strengths and areas for improvement within the working environment are sourced from diverse perspectives, contributing to a more comprehensive understanding of the team dynamics, and facilitating collaborative efforts towards positive change. Repeated measurement and regular discussion of the measurement results are recommended to ensure continuous improvement. We suggest a two-step approach to discussing the WNS report in physician teams. At first, residents and faculty meet separately, guided by a facilitator, to discuss the results and topics raised in the WNS. Afterward, assisted by a facilitator, both groups collectively analyze the main points and formulate conclusions and suggestions for follow-up actions. After 6 to 12 months, the WNS evaluation is repeated, and previously formulated goals are reviewed.

For medical education, a better understanding of positive and negative well-being and its determining factors in the work context of residents can inform well-being interventions and the design of residency training curricula that are better aligned with the well-being needs of residents. By providing information on the workplace, the residents, and the clinical supervisors, the WNS can elucidate points for improvement and assist leadership in providing tailored guidance in maintaining well-being, for example, through coaching. [16,106]

Dutch hospitals’ organizational structures and healthcare practices may not directly translate to other healthcare systems. Factors such as healthcare financing, governance models, and cultural norms within the Dutch context could influence the applicability of WNS findings in diverse international settings as they impact organizational structures, practices, and workforce dynamics.

Additionally, the relatively open view around well-being and performance measures in the Dutch medical culture must be accounted for when considering how the WNS might perform in other cultures and organizational contexts, as cultural norms, hierarchy structures, and organizational aspects can affect how physicians prioritize and interpret the items and the usefulness of the WellNext Scan. In the Netherlands, well-being is likely more openly discussed than in other countries, as it is a formal part of the quality assessment of residency training. Although they are limited, available structures from previously implemented policies can be used for follow-ups of the WNS measurement, such as available coaches that can facilitate the discussion of the results.

The influencing domains of the WNS were designed by incorporating elements that are broadly applicable across various healthcare contexts, however, their interpretation and impact might differ for different physician groups or practice settings. Cross-cultural validations should consider assessing how social and cultural elements, and organizational norms impact the interpretation and relevance of WNS items. [64]

Implications for research and policy.

Physician well-being is not solely an individual responsibility but is also linked to key roles outlined in the CanMEDS framework, a competency framework widely adopted in the Netherlands to maintain professional standards. [107,108] The “Professional” role asks physicians to maintain their health to uphold high standards of professionalism, recognizing the interdependence between personal well-being and optimal patient care. By adopting a comprehensive approach to addressing well-being, such as utilized in the WNS, physicians may be better able to comply with the requirement of self-care in the professional roles of the CanMEDS and share this responsibility with other healthcare professionals in their teams.

This study has multiple implications for research. In this initial phase in the validation process of the WNS, we established the factor structure of well-being and a range of its predictors in the working environment. Kane [69] refers to this type of validity evidence as the ‘scoring argument,’ one of four necessary first steps to take in any systematic instrument development and validation approach. Validation of any socially embedded instrument, such as the WNS, is continuous, and repeated validation over time is recommended. To further advance the robustness of the WNS, future research could continue the validation process of the WNS regarding the subsequent inferences of the argument in Kane’s validity framework, including generalization, extrapolation, and, ultimately, implications of using the WNS. [70] This could include the social impact and consequences on physicians’ well-being and team follow-up decisions based on their usage of the WNS.

While physicians’ well-being and many influencing factors in the working context represent common resources and demands for physicians internationally, cross-cultural adaptations of the WNS are necessary to account for unique characteristics and (national and inter-organizational) cultural and systemic variations in healthcare that affect organizational support towards physicians’ well-being, and social support and cohesion in the team. [64] Future research could also investigate whether the structure of the WNS varies for different contexts within healthcare (private practices, non-teaching medical centers) or for different respondent groups, i.e., female, male, and gender-diverse residents versus faculty. Additionally, a specialty-specific use of the WNS can be explored. [109111] With larger sample sizes, a generalizability analysis could estimate the minimum number of questionnaires needed for the sub-scale scores on the team level and confirm the structure of the questionnaire using confirmatory factor analysis. [74] Given the poor fit of the original PFI model resulting from the CFA, it is possible that the differences in the characteristics of our sample population, i.e., diversity in training levels and specialties, introduced a variability that the initial model did not capture. The different structure of the well-being constructs in our study compared to the original PFI highlights the need for future studies to investigate whether the newly defined structure is also robust on a faculty-only sample and when including residents, fellows, or other (non) hospital-based medical professionals.

Strengths and limitations of this study.

The study’s strengths include utilizing the multifaceted view of positive and negative well-being with the hedonic and eudaimonic well-being perspectives. [50,55,56,112] Second, this study was conducted in multiple (non-)academic teaching medical centers in the Netherlands with a physician population from various specialties, supporting and strengthening the results’ generalizability.

This study has two main limitations. The current sample size allowed us to conduct an EFA to investigate the construct validity of the WNS but not a CFA to evaluate the construct validity, which is considered ideal for instrument validation. [74,113] Further, the perception of the measure as potentially mandatory or linked to negative repercussions might have contributed to an increased social desirability bias, particularly as initiating the WNS measure was typically driven by team leadership. It is possible that teams with proactive well-being-oriented leadership were more likely to engage with the WNS, potentially overlooking teams with less emphasis on well-being in their leadership. Therefore, a CFA on a larger sample that includes a higher variability in team leadership styles would be desired.

Conclusion

To support physicians’ well-being and professional performance in contemporary medical practice, the WellNext Scan provides a team-based instrument that informs about well-being and its influencing factors in the work context. The results suggest that the WellNext Scan can validly and reliably inform physician teams about their well-being and its associated determinants within the occupational context. Clinical teams may use the WNS as a first step in discussing and enhancing their well-being. Future research must continue to validate the WNS, for example, by demonstrating improvements in well-being and working conditions over time. Lastly, cross-cultural comparative studies can help in understanding how perceptions of well-being and professional fulfillment and the impact of factors in the working environment vary across different cultures and healthcare systems.

Supporting information

S1 File. Supplementary material.

Theoretical background of the WellNext Scan.

https://doi.org/10.1371/journal.pone.0319038.s001

(DOCX)

References

  1. 1. Schrijver I, Brady KJS, Trockel M. An exploration of key issues and potential solutions that impact physician wellbeing and professional fulfillment at an academic center. PeerJ. 2016;4:e1783. pmid:26989621
  2. 2. Scheepers RA, Boerebach BCM, Arah OA, Heineman MJ, Lombarts KMJMH. A systematic review of the impact of physicians’ occupational well-being on the quality of patient care. Int J Behav Med. 2015;22(6):683–98. pmid:25733349
  3. 3. Hamidi MS, Bohman B, Sandborg C, Smith-Coggins R, de Vries P, Albert MS, et al. Estimating institutional physician turnover attributable to self-reported burnout and associated financial burden: a case study. BMC Health Serv Res. 2018;18(1):851. pmid:30477483
  4. 4. Thomas LR, Ripp JA, West CP. Charter on physician well-being. JAMA. 2018;319(15):1541–2. pmid:29596592
  5. 5. Dewa CS, Loong D, Bonato S, Thanh NX, Jacobs P. How does burnout affect physician productivity? A systematic literature review. BMC Health Serv Res. 2014;14:325. pmid:25066375
  6. 6. Rothenberger DA. Physician burnout and well-being: a systematic review and framework for action. Dis Colon Rectum. 2017;60(6):567–76. pmid:28481850
  7. 7. West CP, Dyrbye LN, Sinsky C, Trockel M, Tutty M, Nedelec L, et al. Resilience and burnout among physicians and the general us working population. JAMA Netw Open. 2020;3(7):e209385. pmid:32614425
  8. 8. McKinley N, McCain RS, Convie L, Clarke M, Dempster M, Campbell WJ, et al. Resilience, burnout and coping mechanisms in UK doctors: a cross-sectional study. BMJ Open. 2020;10(1):e031765. pmid:31988223
  9. 9. Khan N, Palepu A, Dodek P, Salmon A, Leitch H, Ruzycki S, et al. Cross-sectional survey on physician burnout during the COVID-19 pandemic in Vancouver, Canada: the role of gender, ethnicity and sexual orientation. BMJ Open. 2021;11(5):e050380. pmid:33972345
  10. 10. Scheepers RA, Geerlings SE, van der Meulen M, Lombarts K. Supporting resident well-being on and outside the ICU during the COVID-19 pandemic: the use and value of institutional interventions and individual strategies. Med Educ Online. 2021;26(1):1978129. pmid:34545767
  11. 11. van Steijn ME, Scheepstra KWF, Yasar G, Olff M, de Vries MC, van Pampus MG. Occupational well-being in pediatricians-a survey about work-related posttraumatic stress, depression, and anxiety. Eur J Pediatr. 2019;178(5):681–93. pmid:30783762
  12. 12. Baas MAM, Scheepstra KWF, Stramrood CAI, Evers R, Dijksman LM, van Pampus MG. Work-related adverse events leaving their mark: a cross-sectional study among Dutch gynecologists. BMC Psychiatry. 2018;18(1):73. pmid:29566667
  13. 13. Aggarwal R, Deutsch JK, Medina J, Kothari N. Resident wellness: an intervention to decrease burnout and increase resiliency and happiness. MedEdPORTAL. 2017;1310651. pmid:30800852
  14. 14. Epstein RM, Krasner MS. Physician resilience: what it means, why it matters, and how to promote it. Academic Medicine. 2013;88(3):301–3.
  15. 15. Scheepers RA, Emke H, Epstein RM, Lombarts KMJMH. The impact of mindfulness-based interventions on doctors’ well-being and performance: a systematic review. Med Educ. 2020;54(2):138–49. pmid:31868262
  16. 16. West CP, Dyrbye LN, Erwin PJ, Shanafelt TD. Interventions to prevent and reduce physician burnout: a systematic review and meta-analysis. Lancet. 2016;388(10057):2272–81. pmid:27692469
  17. 17. Sinskey JL, Margolis RD, Vinson AE. The wicked problem of physician well-being. Anesthesiol Clin. 2022;40(2):213–23. pmid:35659395
  18. 18. Bohman B, Dyrbye L, Sinsky CA, Linzer M, Olson K, Babbott S, et al. Physician well-being: the reciprocity of practice efficiency, culture of wellness, and personal resilience. NEJM Catalyst. n.d.;3(4):xxx–xxx.
  19. 19. Watling CJ, Ajjawi R, Bearman M. Approaching culture in medical education: three perspectives. Med Educ. 2020;54(4):289–95. pmid:31872497
  20. 20. LaDonna KA, Cowley L, Touchie C, LeBlanc VR, Spilg EG. Wrestling with the invincibility myth: exploring physicians’ resistance to wellness and resilience-building interventions. Acad Med. 2022;97(3):436–43.
  21. 21. van den Berg JW, Verberg CPM, Scherpbier AJJA, Jaarsma ADC, Arah OA, Lombarts KMJMH. Faculty’s work engagement in patient care: impact on job crafting of the teacher tasks. BMC Med Educ. 2018;18(1):312. pmid:30567540
  22. 22. Bakker AB, Demerouti E, Sanz-Vergel A. Job demands–resources theory: ten years later. Annu Rev Organ Psychol Organ Behav. 2023;10:25–53.
  23. 23. Scheepers R, Silkens M, van den Berg J, Lombarts K. Associations between job demands, job resources and patient-related burnout among physicians: results from a multicentre observational study. BMJ Open. 2020;10(9):e038466. pmid:32973063
  24. 24. van den Berg JW, Verberg CPM, Berkhout JJ, Lombarts MJMH, Scherpbier AJJA, Jaarsma ADC. A qualitative interview study on the positive well-being of medical school faculty in their teaching role: job demands, job resources and role interaction. BMC Res Notes. 2015;8:401. pmid:26329102
  25. 25. West CP, Dyrbye LN, Shanafelt TD. Physician burnout: contributors, consequences and solutions. J Intern Med. 2018;283(6):516–29. pmid:29505159
  26. 26. Bakker AB, Demerouti E. The job demands‐resources model: state of the art. J Manag Psychol. 2007;22(3):309–28.
  27. 27. Bakker AB, Demerouti E, Sanz-Vergel AI. Burnout and work engagement: the jd–r approach. Annu Rev Organ Psychol Organ Beha, 2014;1(1):389–411.
  28. 28. Schaufeli WB, Bakker AB, Van Rhenen W. How changes in job demands and resources predict burnout, work engagement, and sickness absenteeism. J Organ Behav. 2009;30(7):893–917.
  29. 29. Shanafelt TD, Noseworthy JH. Executive leadership and physician well-being: nine organizational strategies to promote engagement and reduce burnout. Mayo Clin Proc. 2017;92(1):129–46. pmid:27871627
  30. 30. Shanafelt TD, Wang H, Leonard M, Hawn M, McKenna Q, Majzun R, et al. Assessment of the association of leadership behaviors of supervising physicians with personal-organizational values alignment among staff physicians. JAMA Netw Open. 2021;4(2):e2035622. pmid:33560424
  31. 31. Olson K, Marchalik D, Farley H, Dean SM, Lawrence EC, Hamidi MS, et al. Organizational strategies to reduce physician burnout and improve professional fulfillment. Curr Probl Pediatr Adolesc Health Care. 2019;49(12):100664. pmid:31588019
  32. 32. Lall MD, Gaeta TJ, Chung AS, Chinai SA, Garg M, Husain A, et al. Assessment of physician well-being, part two: beyond burnout. West J Emerg Med. 2019;20(2):291–304. pmid:30881549
  33. 33. Dyrbye LN, Satele D, Sloan J, Shanafelt TD. Ability of the physician well-being index to identify residents in distress. J Grad Med Educ. 2014;6(1):78–84. pmid:24701315
  34. 34. Maslach C, Jackson SE, Leiter MP. Maslach burnout inventory. Scarecrow Education 1997.
  35. 35. Sharma HP. Enhancing practice efficiency: a key organizational strategy to improve professional fulfillment in allergy and immunology. Ann Allergy Asthma Immunol. 2021;126(3):235–9. pmid:33309885
  36. 36. Karademas EC. Positive and negative aspects of well-being: common and specific predictors. Pers Individ Diff. 2007;43(2):277–87.
  37. 37. Diener E, Wirtz D, Tov W, Kim-Prieto C, Choi D, Oishi S, et al. New well-being measures: short scales to assess flourishing and positive and negative feelings. Soc Indic Res. 2009;97(2):143–56.
  38. 38. Diener E, Sandvik E, Pavot W. Happiness is the frequency, not the intensity, of positive versus negative affect. Assessing well-being: the collected works of Ed Diener. 2009 Dordrecht : Springer Netherlands;. 213–31.
  39. 39. Hall GB, Dollard MF, Winefield AH, Dormann C, Bakker AB. Psychosocial safety climate buffers effects of job demands on depression and positive organizational behaviors. Anxiety Stress Coping. 2013;26(4):355–77. pmid:22793792
  40. 40. Dollard MF, Bakker AB. Psychosocial safety climate as a precursor to conducive work environments, psychological health problems, and employee engagement. J Occupat & Organ Psyc. 2010;83(3):579–99.
  41. 41. Edmondson A. Psychological safety and learning behavior in work teams. Administ Sci Quart. 1999;44(2):350–83.
  42. 42. Steverink N, Lindenberg S, Spiegel T, Nieboer AP. The associations of different social needs with psychological strengths and subjective well-being: an empirical investigation based on social production function theory. J Happiness Stud. 2020;21(3):799–824.
  43. 43. Bartels AL, Peterson SJ, Reina CS. Understanding well-being at work: development and validation of the eudaimonic workplace well-being scale. PLoS One. 2019;14(4):e0215957. pmid:31022285
  44. 44. Stewart MT, Reed S, Reese J, Galligan MM, Mahan JD. Conceptual models for understanding physician burnout, professional fulfillment, and well-being. Curr Probl Pediatr Adolesc Health Care. 2019;49(11):100658. pmid:31629639
  45. 45. Fotiadis A, Abdulrahman K, Spyridou A. The mediating roles of psychological autonomy, competence and relatedness on work-life balance and well-being. Front Psychol. 2019. 10.
  46. 46. Brady KJS, Trockel MT, Khan CT, Raj KS, Murphy ML, Bohman B, et al. What do we mean by physician wellness? a systematic review of its definition and measurement. Acad Psychiatry. 2018;42(1):94–108. pmid:28913621
  47. 47. Babenko O. Professional well-being of practicing physicians: the roles of autonomy, competence, and relatedness. Healthcare (Basel). 2018;6(1):12. pmid:29393875
  48. 48. Brower KJ, Riba MB. Physician mental health and well-being. Res Pract. 2017.
  49. 49. Kahneman D. Objective happiness. 1999.
  50. 50. Ryan RM, Deci EL. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66. pmid:11148302
  51. 51. Kubovy M, On the pleasures of the mind. Well-being Found Hedonic Psychol. 1999:134–154.
  52. 52. Ryan RM, Huta V, Deci EL. Living well: a self-determination theory perspective on eudaimonia. J Happiness Stud. 2006;9(1):139–70.
  53. 53. Ryan RM, Deci EL. From ego depletion to vitality: theory and findings concerning the facilitation of energy available to the self. Social Amp Personality Psych. 2008;2(2):702–17.
  54. 54. Keyes CLM. The mental health continuum: from languishing to flourishing in life. J Health Soc Behav. 2002;43(2):207–22. pmid:12096700
  55. 55. Kashdan TB, Biswas-Diener R, King LA. Reconsidering happiness: the costs of distinguishing between hedonics and eudaimonia. The J Posit Psychol. 2008;3(4):219–33.
  56. 56. Doe J. Sample article title. Sample J Name. 2023;10(2):100–10.
  57. 57. Bhullar N, Schutte NS, Malouff JM. The nature of well-being: the roles of hedonic and eudaimonic processes and trait emotional intelligence. J Psychol. 2013;147(1):1–16. pmid:23472441
  58. 58. Rook KS. Social networks in later life: weighing positive and negative effects on health and well-being. Current Direct Psychol Sci. 2015;24(1):45–51.
  59. 59. Ross KM, Rook K, Winczewski L, Collins N, Schetter CD. Close relationships and health: the interactive effect of positive and negative aspects. Soc Personal Psychol Compass. 2019;13(6):e12468. pmid:32922511
  60. 60. Debets MP, Lombarts KM, Hugenholtz NI, Scheepers RA. Developing and piloting a well-being program for hospital-based physicians. Perspect Med Edu, 2021;10(1):64–9.
  61. 61. Dyrbye L, Shanafelt T. A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50(1):132–49. pmid:26695473
  62. 62. Shanafelt TD. Physician well-being 2.0: where are we and where are we going? In Mayo Clinic Proceedings. 2021. Elsevier.
  63. 63. Trockel M, Bohman B, Lesure E, Hamidi MS, Welle D, Roberts L, et al. A brief instrument to assess both burnout and professional fulfillment in physicians: reliability and validity, including correlation with self-reported medical errors, in a sample of resident and practicing physicians. Acad Psychiatry. 2018;42(1):11–24. pmid:29196982
  64. 64. DeVellis RF, Thorpe CT. Scale development: theory and applications. 2021. Sage publications
  65. 65. Veldhoven M, Prins J, van der Laken P, Dijkstra L. VBBA2.0: Update van de standaard voor vragenlijstonderzoek naar werk, welbevinden en prestaties. 2014;
  66. 66. Vaishnavi S, Connor K, Davidson JRT. An abbreviated version of the Connor-Davidson Resilience Scale (CD-RISC), the CD-RISC2: psychometric properties and applications in psychopharmacological trials. Psychiatry Res. 2007;152(2–3):293–7. pmid:17459488
  67. 67. NEFF KD. The development and validation of a scale to measure self-compassion. Self Ident. 2003;2(3):223–50.
  68. 68. Dorociak KE, Rupert PA, Bryant FB, Zahniser E. Development of the professional self-care scale. J Couns Psychol. 2017;64(3):325–34. pmid:28277686
  69. 69. Kane MT. Validating the interpretations and uses of test scores. J Edu Measure. 2013;50(1):1–73.
  70. 70. Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ. 2015;49(6):560–75. pmid:25989405
  71. 71. Wetzel AP. Factor analysis methods and validity evidence: a review of instrument development across the medical education continuum. Acad Med. 2012;87(8):1060–9. pmid:22722361
  72. 72. Taber KS. The use of cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ. 2017;48(6):1273–96.
  73. 73. Kline RB. Principles and practice of structural equation modeling. 2015: Guilford publications.
  74. 74. Brown TA, Confirmatory factor analysis for applied research. 2015: Guilford publications.
  75. 75. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equation Model Multidiscip J. 1999;6(1):1–55.
  76. 76. Hair JF, Black WC., Babin BJ, Anderson RE. Multivariate data analysis. Seventh edition, Pearson new international edition ed. 2014. Harlow: Pearson Education Limited.
  77. 77. Bartlett MS. A note on the multiplying factors for various χ2 approximations. J R Stat Soc Ser B Method.1954;16(2):296–8.
  78. 78. Pallant J. SPSS survival manual: a step by step guide to data analysis using IBM SPSS. 2020.
  79. 79. Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39(1):31–6.
  80. 80. Kaiser HF. A second generation little jiffy. 1970;
  81. 81. Sarmento RP, Costa V. Confirmatory factor analysis—a case study. ArXiv. 2019.
  82. 82. Silva-Junior JS, Author2 F, Author3 F, et al. Validity evidence of brazilian portuguese version of the professional fulfillment index. Am J Health Promot. 2022;36(7):1112–22.
  83. 83. Vetter M, Vetter M, Cohn D, Yeager K, Fowler J. Utility of the Stanford Professional Fulfillment Index as a single survey instrument to assess holistic physician wellbeing. Gynecol Oncol. 2021;162:S327–8.
  84. 84. Petitta L, Jiang L, Härtel CEJ. Emotional contagion and burnout among nurses and doctors: do joy and anger from different sources of stakeholders matter?. Stress Health. 2017;33(4):358–69. pmid:27723240
  85. 85. Aalto A-M, Heponiemi T, Josefsson K, Arffman M, Elovainio M. Social relationships in physicians’ work moderate relationship between workload and wellbeing-9-year follow-up study. Eur J Public Health. 2018;28(5):798–804. pmid:29365062
  86. 86. Scheepers RA, Lases LS, Arah OA, Heineman MJ, Lombarts KM. Job resources, physician work engagement, and patient care experience in an academic medical setting. Acad Med. 2017;92(10):1472–9.
  87. 87. Ratanawongsa N, Wright SM, Carrese JA. Well-being in residency: effects on relationships with patients, interactions with colleagues, performance, and motivation. Patient Educ Couns. 2008;72(2):194–200. pmid:18541401
  88. 88. Bogerd R, Silkens ME, Keuken DG, Hassink RJ, Henriques JP, Lombarts KM. Work-related well-being among dutch cardiologists—a national survey. Curr Prob Cardiol. 2023;48(4):101538.
  89. 89. Balme E, Gerada C, Page L. Doctors need to be supported, not trained in resilience. BMJ. 2015;351.
  90. 90. Zwack J, Schweitzer J. If every fifth physician is affected by burnout, what about the other four? Resilience strategies of experienced physicians. Acad Med. 2013;88(3):382–9. pmid:23348093
  91. 91. Bogerd R, Debets MPM, Keuken DG, Hassink RJ, Henriques JPS, Lombarts KMJMH. The relationship between physicians’ self-kindness and professional fulfillment and the mediating role of personal resilience and work-home interference: a cross-sectional study. PLoS One. 2023;18(4):e0284507. pmid:37093877
  92. 92. Arnetz BB. Physicians’ view of their work environment and organisation. Psychother Psychosom. 1997;66(3):155–62. pmid:9176910
  93. 93. Debets M, Scheepers R, Silkens M, Lombarts K. Structural equation modelling analysis on relationships of job demands and resources with work engagement, burnout and work ability: an observational study among physicians in Dutch hospitals. BMJ Open. 2022;12(12):e062603. pmid:36585143
  94. 94. Kruskal JB, Shanafelt T, Eby P, Meltzer CC, Rawson J, Essex LN, et al. A road map to foster wellness and engagement in our workplace-a report of the 2018 summer intersociety meeting. J Am Coll Radiol. 2019;16(6):869–77. pmid:30559039
  95. 95. Kristof AL. Person‐organization fit: an integrative review of its conceptualizations, measurement, and implications. Person Psychol. 1996;49(1):1–49.
  96. 96. Herkes J, Churruca K, Ellis LA, Pomare C, Braithwaite J. How people fit in at work: systematic review of the association between person-organisation and person-group fit with staff outcomes in healthcare. BMJ Open. 2019;9(5):e026266. pmid:31076470
  97. 97. Cave D, Pearson H, Whitehead P, Rahim-Jamal S, CENTRE: creating psychological safety in groups. Clinic Teach 2016;13(6): 427–31.
  98. 98. Scheepers RA, van den Goor M, Arah OA, Heineman MJ, Lombarts KMJMH. Physicians’ perceptions of psychological safety and peer performance feedback. J Contin Educ Health Prof. 2018;38(4):250–4. pmid:30346339
  99. 99. DJS. Nationale a(n)ios-enquête 2022. Gezond en veilig werken. 2022: The Netherlands. Gezond en veilig werken. Nationale a(n)ios-enquête. 2022.
  100. 100. Bindels E, van den Goor M, Scherpbier A, Lombarts K, Heeneman S. Sharing reflections on multisource feedback in a peer group setting: stimulating physicians’ professional performance and development. Acad Med. 2021;96(10):1449–56. pmid:33951680
  101. 101. Cooke LJ, Duncan D, Rivera L, Dowling SK, Symonds C, Armson H. How do physicians behave when they participate in audit and feedback activities in a group with their peers?. Implement Sci. 2018;13(1):104. pmid:30064509
  102. 102. Sargeant J, Lockyer J, Mann K, Holmboe E, Silver I, Armson H, et al. Facilitated reflective performance feedback: developing an evidence- and theory-based model that builds relationship, explores reactions and content, and coaches for performance change (R2C2). Acad Med. 2015;90(12):1698–706. pmid:26200584
  103. 103. Tims M, Bakker AB, Derks D, van Rhenen W. Job crafting at the team and individual level. Group Organ Manage. 2013;38(4):427–54.
  104. 104. Bynum WE 4th, Sukhera J. Perfectionism, power, and process: what we must address to dismantle mental health stigma in medical education. Acad Med. 2021;96(5):621–3. pmid:33885411
  105. 105. Fernandopulle N. To what extent does hierarchical leadership affect health care outcomes?. Med J Islam Repub Iran. 2021;35117. pmid:34956963
  106. 106. Lagina M, Grum C, Sandhu G, Ruff AL. Sources of joy in medical educators as described by the PERMA model. Teach Learn Med. 2022;1–8.
  107. 107. Hall J, Atkinson A, Chan MK, Tourian L, Thoma B, Pattani R. The clinical learning environment in CanMEDS 2025. Canad Med Educ J. 2023;14(1):41–5.
  108. 108. Puddester D, CanMEDS physician health guide: a practical handbook for physician health and well-being. Flynn L, Cohen J. (Editors). 2009, Royal College of Physicians and Surgeons of Canada.
  109. 109. Hodkinson A, Zhou A, Johnson J, Geraghty K, Riley R, Zhou A, et al. Associations of physician burnout with career engagement and quality of patient care: systematic review and meta-analysis. BMJ. 2022;378:e070442. pmid:36104064
  110. 110. Hoff T, Lee DR. Burnout and physician gender: what do we know?. Med Care. 2021;59(8):711–20.
  111. 111. Garcia LC, Shanafelt TD, West CP, Sinsky CA, Trockel MT, Nedelec L, et al. Burnout, depression, career satisfaction, and work-life integration by physician race/ethnicity. JAMA Network Open. 2020;3(8):e2012762.
  112. 112. Seligman ME. Flourish: a visionary new understanding of happiness and well-being. 2011: Simon and Schuster.
  113. 113. Atkinson TM, Rosenfeld BD, Sit L, Mendoza TR, Fruscione M, Lavene D, et al. Using confirmatory factor analysis to evaluate construct validity of the Brief Pain Inventory (BPI). J Pain Symptom Manage. 2011;41(3):558–65. pmid:21131166