Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Development of a survey and worry score to evaluate physician burnout and wellness interventions during COVID-19 in the Rio Grande Valley: A pilot study

  • Victoria Jacobsen ,

    Contributed equally to this work with: Victoria Jacobsen, Ericka A. Vazquez, Lauren Herrera

    Roles Resources, Visualization, Writing – original draft, Writing – review & editing

    Affiliation University of Texas Rio Grande Valley, School of Medicine, Edinburg, Texas, United States of America

  • Ericka A. Vazquez ,

    Contributed equally to this work with: Victoria Jacobsen, Ericka A. Vazquez, Lauren Herrera

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Writing – review & editing

    Affiliation University of Texas Rio Grande Valley, School of Medicine, Edinburg, Texas, United States of America

  • Lauren Herrera ,

    Contributed equally to this work with: Victoria Jacobsen, Ericka A. Vazquez, Lauren Herrera

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Writing – review & editing

    Affiliation University of Texas Rio Grande Valley, School of Medicine, Edinburg, Texas, United States of America

  • Ruth Escalera,

    Roles Formal analysis, Methodology, Visualization, Writing – original draft

    Affiliation University of Texas Rio Grande Valley, School of Medicine, Edinburg, Texas, United States of America

  • Daniel Salinas,

    Roles Formal analysis, Software, Visualization, Writing – review & editing

    Affiliation University of Texas Rio Grande Valley, School of Medicine, Neurology and Behavioral Health Integrated Service Unit, Edinburg, Texas, United States of America

  • Bharathi S. Gadad,

    Roles Resources, Software, Validation, Visualization, Writing – review & editing

    Affiliation University of Texas Rio Grande Valley, School of Medicine, Edinburg, Texas, United States of America

  • Juan Carlos Lopez-Alvarenga,

    Roles Formal analysis, Validation, Visualization, Writing – review & editing

    Affiliations University of Texas Rio Grande Valley, School of Medicine, Edinburg, Texas, United States of America, Division of Population Health & Biostatistics, School of Medicine, University of Texas Rio Grande Valley, Edinburg, Texas, United States of America

  • Kelsey Potter-Baker

    Roles Conceptualization, Data curation, Investigation, Methodology, Resources, Supervision, Writing – original draft, Writing – review & editing

    kelsey.baker@utrgv.edu

    Affiliations University of Texas Rio Grande Valley, School of Medicine, Edinburg, Texas, United States of America, University of Texas Rio Grande Valley, School of Medicine, Neurology and Behavioral Health Integrated Service Unit, Edinburg, Texas, United States of America

Abstract

Background

Current research on physician burnout is limited in rural communities and physicians caring for the medically underserved. This study aimed to create an instrument to quantify the rate of physician burnout during the COVID-19 pandemic and identify effective coping interventions in an underserved mixed rural-urban region along the Texas–Mexico border.

Methods

We conducted a regional study in a sample of US physicians using a structured questionnaire developed by a multidisciplinary group. Thirty-one participants were contacted over a five-week period between December 2022 to January 2023. Participants self-selected based on their experiences of burnout during various phases of the COVID-19 pandemic (e.g., Initial Surge, Lock Down, Adjustment Period, Vaccine Distribution, Delta Variant, Booster Available). A 5-point Likert scale was used to assess and rank the perceived effectiveness of services employed to cope with burnout and its negative implications.

Results

We found that 43% of participants experienced burnout during the COVID-19 pandemic, with flexible schedules and personal wellness being the top alleviators of burnout. The survey showed good internal consistency and reliability (Cronbach’s alpha coefficient = 0.7680), McDonald’s omega was 0.80, and identified three “worry types” through latent factor analysis. Worry types included: (1) physicians with a desire to self-preserve but showed negative coping, (2) physicians with a desire for occupational harmony but with concerns about patient safety, and (3) physicians with concerns about personal safety and their mortality potential. Additionally, latent factor analysis showed that 9 questions from the survey could be used to create a Worry Score to classify burnout and coping strategies related to the COVID-19 pandemic.

Conclusion

These findings suggest that healthcare administrators and policymakers should prioritize implementing and promoting flexible work schedules and opportunities for personal time as part of comprehensive strategies to improve physician wellness and mitigate burnout. Additional research is needed to determine the effectiveness of the interventions in addressing physician burnout.

Introduction

The Coronavirus Disease 2019 (COVID-19) pandemic highlighted several critical concerns within the American healthcare system, including resource allocation, healthcare worker safety, and systemic inefficiencies [15]. Physician burnout, or “long-term stress reaction marked by emotional exhaustion, depersonalization, and a lack of sense of personal accomplishment”, emerged as a significant concern during the pandemic, primarily due to increased workloads, emotional strain, and the rapid adaptation to new clinical protocols [611]. Studies have suggested that physician burnout can result in early career departure, increased medical errors, poorer continuity of care, and ultimately threaten patient safety [1223]. For example, Shanafelt et al. (2010) reported a 45% higher incidence of medical errors among burned-out physicians [22]. In addition, physician burnout has been associated with impaired critical thinking function [14,24]. According to a 2022 Medscape report, 58% of physicians report experiencing burnout, with 68% saying it negatively affects their relationships and 54% noting a severe impact on their personal and professional life. Similar trends have also been noted after the COVID-19 pandemic [2528].

Studies have found that workplace activities significantly impact burnout levels [2934]. For example, the introduction of computerized order entry has been associated with a 29% increase in burnout. Additionally, the shift in workplace activities, with physicians now spending two hours on electronic health records (EHR) and desk work for every hour of direct patient interaction, exacerbates the issue of burnout [3538]. Additionally, other studies have found organizational issues such as long work hours, overnight calls, and lack of leadership support have been identified as significant risk factors for physician burnout [19,39,40]. Effective solutions to burnout often combine personal wellness activities, such as stress-management techniques and exercise with organizational changes, including the reduction of work hours and optimization of EHR systems [4143]. Further, recognizing the critical impact of physician burnout, the World Health Organization recently defined it as an organizational issue requiring an organizational solution, underscoring the importance of systemic interventions over individual ones [4446].

To institute organizational solutions to burnout, it is critical to understand the localized triggers of burnout. Unfortunately, readily available burnout surveys have very limited and reported use in rural populations [13,4749]. Further, while aspects of physician burnout have been well described from the COVID-19 pandemic, physicians practicing in rural and medically underserved areas may have different causes of burnout and require different systemic interventions [18,24,41,5053]. In particular, border regions and urban-rural communities often face unique challenges, such as limited healthcare resources, high patient loads, and socioeconomic disparities, necessitating tailored strategies to address physician burnout [51,54]. For example, the Rio Grande Valley (RGV) is a mixed urban-rural community located on the Texas-Mexico border and is home to many unique conditions that increase the risk of physician burnout. Specifically, in 2013 it was estimated that over half of the RGV population is uninsured, not including a large and ever-evolving population of undocumented immigrants [55]. Further, primary and specialty physician shortages have been reported throughout the state of Texas, with the RGV region showing extreme shortages [56,57]. For example, in 2021, Texas county health records indicated that there were only 62 primary care physicians per 100,000 residents in the RGV, compared to the national average of 91 per 100,000. Such complex work environment for RGV physicians may contribute to different degrees of physician burnout, with the COVID-19 pandemic exaggerating it due to increased patient loads, heightened emotional stress, and the rapid implementation of new clinical protocols and telehealth services.

Given the unique burden and factors influencing physician burnout in rural areas and limited assessment tools, this study primarily sought to build a new survey instrument to measure burnout experienced by physicians working in rural and medically underserved populations before and during the COVID-19 pandemic. Other burnout inventory tools, such as the Copenhagen burnout inventory or Maslach burnout inventory have inherent limitations for use in our settings. The Maslach burnout inventory measures three different constructs of burnout that limit interpretability, due to possible bias [58,59]. In addition, the Copenhagen burnout inventory has been suggested to be subject to cultural bias, an influence that is exaggerated in a rural and culturally diverse area [6065]. Further, each of these surveys would have increased the burden of the participant when evaluating burnout in a cross-sectional study design at multiple phases of the COVID-19 pandemic, given the length of the inventory instrument.

We desired to identify if specific worry factors (worry score) contributing to burn out could be identified in our population, which would allow for development of organizational solutions. Specifically, we sought to evaluate the frequency and trends of burnout, identify common wellness practices that served to prevent or mitigate burnout and evaluate how wellness interventions may be tailored for our underserved region. Our study also aimed to evaluate the development of burnout and worry factors during different periods of the COVID-19 pandemic (i.e., initial surge, lockdown phase, vaccine distribution period, etc.), to provide more specific associations with experienced burnout. Our main objectives included proof of survey internal consistency, dimensionality, and characterization of personal perception regarding burnout associated with specific stressors. We hypothesized that we would be able to identify unique coping mechanisms affecting burnout in the RGV and suggest potential systemic changes to address the problem in rural areas.

Materials and methods

Study design and setting

A structured, web-based questionnaire was designed to assess perceived burnout status as defined by the Agency for Healthcare Research and Quality (2022) in a participant population of Doctor of Medicine (M.D.) physicians across the Rio Grande Valley region (Appendix A). We used nine questions (described in Tables 3 and 4, below) on a 1–5 Likert scale; higher scores indicate greater endorsement of the item. The Worry score was computed with the sum of the 9 items, with a maximum of 45 points. Q65 [How often did you find yourself relying on positive coping mechanisms during the selected time course period?] was conceptually positive coping and opposite direction loading, so we implemented reverse coding to maintain higher scores to reflect greater worry. Study data were collected and managed using REDCap electronic data capture tools hosted at University of Texas Rio Grande Valley (UTRGV) [66,67]. REDCap (Research Electronic Data Capture) is a secure, web-based software platform designed to support data capture for research studies, providing 1) an intuitive interface for validated data capture; 2) audit trails for tracking data manipulation and export procedures; 3) automated export procedures for seamless data downloads to common statistical packages; and 4) procedures for data integration and interoperability with external sources.

To ensure content validity, the questionnaire was developed, following similar methodology of other studies [68,69], through a collaborative process involving feedback and rigorous review from five medical students, three M.D. physicians, two Doctor of Philosophy (Ph.D.) researchers, and two other Ph.Ds, selected for their expertise in clinical practice, research methodology, and statistical analysis. Their input helped contribute to the questionnaire’s validity, reliability, and comprehensive coverage of burnout indicators. The questionnaire was distributed online using REDCap to avoid in-person interactions and make it easier to tailor specific needs to our study, as paper surveys are utilized less and result in reduced response rates. The following demographic data were collected as part of the questionnaire: ethnicity, biological sex, marital status, medical specialty, workplace setting, and whether medical training was completed in the United States (US MD, or US Medical Degree) or internationally (IMG or International Medical Degree). These variables were selected to explore potential demographic influences on burnout rates among physicians. Within our questionnaire, we included identifying the presence or absence of burnout during a specific time-period in the pandemic, defined by six Time Course Period variables (Table 1) that captured variations in pandemic intensity and associated stressors. The online questionnaire categorized coping strategies as either “negative” or “positive” based on established psychological frameworks [7072]. Negative coping strategies refer to behaviors such as avoidance or substance use, while positive coping strategies include problem-solving and seeking social support. Our goal was to identify potential modifications in burnout during COVID-19 development, response, and medical discovery. This would help identify specific periods where interventions might be most needed. Survey questions also included language referencing standardized burnout surveys to increase internal consistency [13,38,7376]. The questionnaire and study design were reviewed and approved by the University of Texas Rio Grande Valley Institutional Review Board (IRB) (IRB-22–0116). Ethical considerations, including informed consent and confidentiality of participant data, were strictly adhered to throughout the study.

thumbnail
Table 1. Defined Time Course Period variable options for use within the web-based questionnaire regarding the COVID-19 pandemic.

https://doi.org/10.1371/journal.pone.0342993.t001

Participants

Participants who worked within the University of Texas Health Rio Grande Valley medical system in either the inpatient, outpatient, or both settings were invited to take the structured 5-point Likert scale questionnaire (answered only once) over a five-week period from 12/2022–01/2023. For recruitment, physicians were contacted directly three times via listed work emails and indirectly through weekly invites included in the Employee E-bulletin. Prior to taking the survey, all physicians provided electronic consent to participate in the study. Eligibility criteria for participation included 1) an adult over 18 years old, 2) a physician holding an M.D. degree, 3) actively practicing within any medical specialty in the two years between 01/2020 and 12/2021, and 4), informed consent to participate in the questionnaire.

Statistical methods

Descriptive statistics provided a summary of participant characteristics with calculated frequencies (percentages) for categorical variables and mean (standard deviation) for continuous variables. The missing values by item were common because respondents were not required to answer all questions. The analyses used available data; a description of each item was summarized in Supplementary Table 1. The Worry Score was calculated as the sum of the nine items using available responses. No imputation was performed, given the pilot sample size. The prevalence of self-reported career burnout (Q13. Have you ever experienced burnout?), and COVID-19 pandemic burnout (Q14. Did you experience burnout during COVID-19?) was determined by calculating the proportion of participants reporting burnout at any point specifically during the defined COVID-19 periods. We measured the perceived burnout status and used it for known-group validation. The internal consistency across questionnaire items was assessed with Cronbach’s alpha coefficient where values indicated internal reliability, and higher values suggested agreement between standardized items (e.g., mean of 0, and standard deviation of 1) [77]. The factor analysis (see below) revealed item redundancy and unequal loadings; McDonald’s omega was calculated under a single-factor model using maximum likelihood. Additionally, the average inter-item correlation and 95% confidence interval (95% CI) were calculated through bootstrapping with 100 repetitions to provide a more robust estimate of the correlation and its uncertainty, particularly in the context of this study’s small sample size and non-normality of the data or correlation coefficient [78]. Sensitivity analyses were conducted by assessing the influence of individual items on the coefficient through item omission. To explore dimensionality, latent factor analysis was performed using Principal Component Analysis (PCA) on nine questionnaire items [79,80]. In this process, we identified the underlying factors by examining factor loadings associated with the items, providing a composite score that reflects the participant’s level of worry (i.e., a total Worry Score) based on the principal components identified. Particularly, Kaiser-Varimax rotation revealed three factors with factor loadings above 0.4, explaining 80% of the total variation [81]. The three factors identified included [1] patient safety and occupational harmony, [2] negative coping mechanisms and [3] personal safety.

Due to the robustness against non-normally distributed data, a Wilcoxon Rank-Sum test was used to contrast the three factor’s Worry Score against the presence of known-group validity burnout (yes/no), biological sex (Male/Female), and country of medical training completion (US/International Medical Graduate (IMGs)). The sensitivity of the Worry Score in detecting differences between groups was evaluated across different Time Course Periods of COVID-19 pandemic development using the Kruskal-Wallis test [82], which is designed for group comparisons of non-parametric data. Statistical analyses were performed using Stata v18 (StataCorp, College Station, TX), and McDonald’s omega with R (version 4.5.2., 2025) package psych.

Results

Participants and descriptive data

Of the 224 physicians contacted, 33 physicians participated, and 31 physicians met all eligibility criteria for inclusion within the dataset analyses, resulting in a 14.7% response rate (Table 2). The low response rate may limit the generalization of findings, but it is consistent with the typical response rates for physician surveys [34,83,84]. As seen in Table 2, demographics included the following: 61% Hispanic or Latinx, 35% female, 61% male, 4% preferred not to answer biological sex, 77% married, 84% in academia, 55% US M.D. graduates, and 45% IMGs. Ages ranged from 38–69 years old, with a mean age of 43.

Questionnaire results and internal consistency reliability

We observed that the prevalence of burnout perception at any point during participants medical career was self-reported by 63% of participants. Specifically, 43% of participants indicated experiencing burnout during the COVID-19 pandemic from January 2020 to December 2021. Descriptive statistics for the nine Worry Score items are in Supplementary Table 1. The response rates in participants with positive perceived burnout varied across items (48–68%). The mean scores were high (3.6 to 4.5) on a 5-point scale. Participants could select “N/A” for individual items, meaning the absence of endorsed worry. Therefore, “N/A” was coded by zero, not a Likert-scale response, and included in the total Worry Score. We did not have missing values in the sample. We evaluated the reliability or internal consistency of the questionnaire using Cronbach’s alpha coefficients. Table 3 displays Cronbach’s alpha coefficients, valid observation counts, and collective influence on the questionnaire. Questions were optional for respondents; thus, the total sample size varied per question. The estimated correlation among the items within the same domain stood at 0.87 (Cronbach’s alpha = 0.76, 95% CI: 0.48, 1.0), with an average inter-item correlation of 0.26 (95% CI: 0.07, 0.44), indicating a measure of internal consistency among the questions. The estimated McDonald’s omega was 0.80, complementing the alpha values and giving conceptual appropriateness.

thumbnail
Table 3. Cronbach’s Alpha Analysis with individuals with perception of burnout.

https://doi.org/10.1371/journal.pone.0342993.t003

Survey question #24 (Q74) among all correlations exhibited the lowest value (−0.009), suggesting potential distortion of the overall measurement. Subsequent analysis after excluding Q74 resulted in a slight increase in the alpha coefficient to 0.79 (95% CI: 0.59, 0.98) and an increase in average inter-item correlation of 0.32 (95% CI: 0.09, 0.54). The analysis of omitted items displayed consistent coefficients, ranging from 0.69 to 0.79.

Creation of a worry score and types of worriers

We sought to develop a Worry Score that incorporated three factors from the survey data: [1] patient safety and occupational harmony, [2] negative coping, and [3] personal safety. We evaluated the uniqueness in the variance shared with survey questions for each factor, where lower uniqueness values were relevant for the items in each of the three factors. Uniqueness represented the proportion of variance not accounted for by the extracted factors. In other words, the more unique a question was, the lower the chance was that it would not fit with or be categorized as one of the three factors in the Worry Score. For example, a uniqueness value of 0.1 indicated that only 10% of the variability in the variable was unique and not explained by the factors. Conversely, a value of 0.7 suggested that 70% of the variability in that variable was unique to that variable and was not explained by the underlying factors identified in the analysis. We found that 9 questions from the survey provided unique relationships for factors (Table 3) supporting the structure of the extracted factors and indicating different types of worry. The latent factor analysis showed that both Q74 and Q82 stood in opposition to Q43. Additionally, Q65 was in opposition to both Q25 and Q35, but still significant enough to potentially include it under Negatively Coping (Factor 2, Green), with note of a weaker correlation (−0.4326) and high uniqueness value (0.7053). Additional data is needed to decide for Q65, as it could present as its own unique factor with additional questions added to the analysis. Based on latent factor analysis with varimax rotation, we identified that physicians displayed 3 distinct worry types or factors (Fig 1). Worry types included: (Factor 1, Yellow) physicians with a desire to self-preserve but showed negative coping, (Factor 2, Green) physicians with a desire for occupational harmony but with concerns about patient safety, and (Factor 3, Blue) physicians with concerns about personal safety and their mortality potential. Thus, we utilized the sum of scores for the nine questions (Table 4) to develop a Worry Score for each study participant (max of 45). We found that the Worry Score fluctuated over the course of the COVID-19 time period (Fig 2). Specifically, Worry Scores for time periods before the rollout of the booster vaccine were significantly higher in physicians with self-reported burnout compared to physicians who did not experience burnout (p = 0.01). In addition, physicians demonstrated the highest Worry Scores during the adjustment period (June 2020 – November 2020), likely due to ongoing uncertainties and adjustments requires as the initial surge of cases stabilized but new challenges emerged.

thumbnail
Fig 1. A model with factor loadings displaying three factors after latent factor analysis with varimax rotation.

Physicians fell into three clusters of distinct worrier types. Factor 1 or Yellow = concerns about patient safety and occupational harmony. Factor 2 or Green = desire to self-preserve and negatively cope. Factor 3 or Blue = concerns about personal safety and their own mortality potential. Question numbers, as outlined in Table 4, are shown for each of the factor classifications. Q25 represents those who experienced burnout during COVID-19. Q65 represents a reliance on positive coping mechanisms, but has a negative sign belonging to Factor 2, as indicated by the arrow.

https://doi.org/10.1371/journal.pone.0342993.g001

thumbnail
Fig 2. Worry score associated with Time Course Selection during the COVID-19 time period.

Physicians felt the most burnout during the Adjustment Period from June 2020 – November 2020. Red diamonds are the determined median values for each group. Worry Scores analyzed by Time Course Period showed clear differences by group (Kruskal-Wallis, p = 0.01). The first four time periods were statistically different from the same time periods among physicians who did not experience burnout (indicated as N/A on the graph).

https://doi.org/10.1371/journal.pone.0342993.g002

Coping mechanisms and strategies to address perceived burnout

As the questionnaire (Appendix A) outlined, all physicians self-reported burnout. We found that during COVID-19, regardless of feelings of burnout, physicians ranked flexible schedules significantly higher than other means of interventions to relieve burnout experience (p = 0.048) (Fig 3A). In addition, personal wellness activities were found to mitigate and relieve burnout experience regardless of feelings of burnout (p = 0.0411) (Fig 3B).

thumbnail
Fig 3. Ranking of flexible schedule and personal wellness activities relieving burnout in RGV physicians.

(A) During COVID-19, both physician groups who did and did not experience burnout ranked Flexible Schedule significantly higher than other means of interventions to mitigate and relieve burnout experience. Flexible Schedule scores were perceived as beneficial in coping with burnout (p = 0.048). (B) In addition, both physician groups who did and did not experience burnout ranked Personal Wellness Activities significantly higher than other means of interventions to mitigate and relieve burnout experience. Personal Wellness Activity scores showed a benefit in coping with burnout (p = 0.041).

https://doi.org/10.1371/journal.pone.0342993.g003

Discussion

This pilot study developed a novel survey and score to measure the perceived burnout status in healthy medical personnel during the pandemic in a rural and medically underserved area. The Worry Score included the stressors faced by physicians practicing in rural settings during the COVID-19 pandemic, offering a nuanced understanding of concerns about personal safety, strategies to cope with burnout, and occupational alternatives. The COVID-19 pandemic exposed many challenges of the American medical system, including physician burnout. This issue not only harms individual physicians, but also impacts patients, coworkers, and families through a trickle-down mechanism, where the well-being of the healthcare providers directly impacts the quality of care and overall healthcare system efficacy [3,4,30,33,38,50]. The true cost of physician burnout has not fully been measured, but certainly impacts many areas, with reports of worsened patient outcomes, longer recovery times, and increased healthcare costs due to higher rates of medical errors and staff turnover [15,16,18,24,29,35,36,41,50,53,56,75,85]. Education and awareness of physician burnout have been on the rise recently, with initiatives such as resilience training programs, mental health support services, and institutional changes aimed at reducing workload [86,87]. The COVID-19 pandemic has acted as a call to action for all those who participate in our medical system, highlighting the urgent need for systemic solutions.

Our study aimed to measure the rate of burnout in physicians practicing in the RGV, an area already home to significant medical disparities and lack of healthcare access [54,57,8893]. We found that of the 31 physicians surveyed, 63% experienced burnout at some point during their career, with 43% experiencing burnout during the COVID-19 pandemic. Through our collected data, we created a novel tool to assess responses to burnout, particularly in rural settings. The Worry Score tool classifies responses regarding burnout into three categories: those that used negative mechanisms to cope, those primarily concerned with personal safety, and those most concerned with patient safety; with the latter two categories involved in using positive coping mechanisms. Additionally, we asked physicians to rank specific burnout interventions on a Likert scale and found that flexible scheduling and time for personal wellness activities were the most beneficial to our study group. Our findings are in alignment with other studies that have suggested organizational efforts such as reducing workload, optimizing clinical staff, and implementing peer support programs are effective at reducing burnout [13,37,44,45,94,95].

In recent years, the medical community has become more diverse and copes with stressors in varying ways. Our Worry Score identified three distinct groupings when analyzing responses regarding coping mechanisms during the COVID-19 pandemic. Group one relied on negative coping mechanisms and was most concerned with self-preservation. Groups two and three both relied on positive coping mechanisms, with the prior primarily concerned with personal safety and the latter concerned with patient safety. These groupings suggest that physicians are human beings with individual motivations and desires, which must be addressed when discussing systemic burnout interventions. A French study conducted in 2020 used a similar analysis model to find protective and harmful personality traits for burnout in future neurosurgeons [85]. Overall, the Worry Score we created has comparable potential in identifying physicians at risk of burnout, particularly in rural areas, and may help administrative and program departments better support physician well-being.

Combating burnout using wellness practices is essential to the health and well-being of physicians and the patients they treat. Our study aimed to assess how important specific wellness interventions (flexible schedules, wellness check-ins/surveys/education, workplace wellness activities, personal wellness activities, and mental health services) were to physicians practicing in the RGV during the COVID-19 pandemic. When asked to rank on a Likert scale of 1–5 how beneficial each wellness activity was to their mental and physical health, RGV physicians chose to have a flexible schedule and personal wellness activities as the most impactful interventions (Fig 3). Other studies have also found that physicians who engage in wellness activities in their free time have less burnout compared to their peers [9,42,45,56,96]. Our data suggests that for healthcare systems in similar environments as the RGV, it may be essential to combat burnout in their workplaces and improve patient outcomes using flexible schedules and personal wellness activities. However, while personal wellness interventions may be beneficial on an individual level, they are a response to a much larger problem that will require a systems-based model to eliminate [13,19,41,56,94]. Researchers at the Pennsylvania State School of Medicine have developed The Health Professionals Hierarchy of Needs that aims to simplify healthcare worker needs so leaders may better care for their staff, and thus, their patients [35]. The identification and alleviation of burnout is essential, but still follows the typical American model of healthcare- treating the symptoms instead of preventing the disease. With the use of our Worry Score tool, healthcare systems may be able to identify physicians at risk of burnout and intervene early, addressing the issue before it even occurs. The Worry Score tool may also be a helpful adjunct to current systems levels practices, such as resiliency training, mindfulness and stress management systems. As the American healthcare system continues to develop and shift to huge hospital systems and conglomerate-owned practices, information on individual and organization-wide burnout reduction strategies becomes ever more vital.

Our study assessed burnout specifically during the COVID-19 pandemic (December 2019-June 2021) in the RGV as it placed a significant amount of additional stress on an underserved population. The RGV is a border community of approximately 1.4 million people with an undocumented immigrant population estimated to range in the 100,000’s as of 2019 [89,97]. Approximately 50% of the population does not have health insurance and almost 30% cannot afford to see a doctor [57,89,92,97]. These are significant barriers to care and place many patients in vulnerable situations regarding their health. The COVID-19 pandemic acutely worsened access to healthcare, not just in the RGV but worldwide [51]. Patients were no longer able to see physicians in person, and for many in the RGV telemedicine was not an option due to lack of technology and internet access [9,55,90,91]. Additionally, 45% of the RGV population is obese and 18% is diabetic, both conditions which place patients in an immunosuppressed state [89]. Concurrently, we found that 43% of the 31 RGV physicians surveyed experienced burnout during the COVID-19 pandemic. Given the negative effect burnout has on patient outcomes in addition to the many healthcare barriers already in place in the RGV, it is of the utmost importance to our community to identify potential burnout and design our system to alleviate that burden. However, RGV physicians are not alone, as an international meta-analysis of 45 observational studies found that the prevalence of physician burnout between December 2019 and May 2022 was 54.60% [73]. The COVID-19 pandemic was a source of significant burnout for physicians all over the world. Our healthcare systems will continue to feel this effect until we take steps to alleviate and prevent burnout.

While our study is novel and highlights several components relevant to RGV physician burnout, we acknowledge several limitations. First, all this is a cross-sectional study design and self-reported rankings, limiting the causal effects. Second, because it was a pilot study, we did not use other burnout tools to contribute to a convergent validation of the questionnaire. However, we addressed the known-groups validation instead, obtaining sensitive results. Another limitation was M.D. physicians reached were those involved in university clinics and hospitals to varying degrees, and thus bias may have been introduced by not including a wider range of community physicians, locum tenens physicians, or those who may have retired or were no longer affiliated with the university at the time of data collection. Another additional contributor to bias may have been the lack of inclusion and capture of burnout in other varieties of healthcare workers (e.g., Doctor of Osteopathic Medicine [D.O.], Certified Physician Assistant [PA-C], Advanced Practice Registered Nurse-Nurse Practitioner [APRN-NP], Bachelor of Science in Nursing Registered Nurse [BSN RN]). In addition, here we chose to create a unique questionnaire that would target areas of burnout and coping in the RGV area. Our survey included elements from other standardized burnout surveys [5865], but we acknowledge the use of a novel survey tool. Development of a novel survey and tool did allow us to identify unique challenges to our population but required substantial review prior to implementation. Our statistical analysis suggests that our questionnaire demonstrated good internal consistency and reliability, comparable to other published survey instruments. However, a limitation of this study is that it did not test convergent and discriminant validity against an established questionnaire.

The purpose of this study was to develop a survey and tool that could assess the prevalence of physician burnout in rural populations. Our study evaluated RGV physicians directly and identified protective and negative factors that contributed to burnout. Our findings showed that a significant proportion of physicians in the RGV experienced burnout, with most encountering it during the adjustment period of June to September 2020. A Worry Score tool was created to measure individuals’ responses to stress and was used to find distinct types of coping mechanisms. The Worry Score is a novel tool to assess how individual physicians respond to burnout and can be used as a preventative measure within healthcare systems. Our study also evaluated ways to alleviate burnout and found the most merit in flexible scheduling and personal wellness activities. Few studies have assessed the prevalence of burnout in underserved areas, and our study is the first to evaluate RGV physicians. Larger surveys should be taken of RGV physicians, with more focus on community physicians, as the majority of our responses came from university-based physicians. Also, future studies include an established burnout instrument to reinforce the validation. Also, future studies should be expanded beyond the RGV and include other healthcare workers to obtain more generalizable data. We suggest that the Worry Score be used in other situations, such as during natural disasters or in times with no additional stressors, to assess its applicability beyond the COVID-19 pandemic.

Supporting information

S1 Table. Descriptive statistics for each Worry Score item.

The survey items’ responses varied because participants were not required to answer all items. Q65 was reverse-coded for scoring because conceptually it is a positive coping mechanism. ** Represents the sum of all available items from those with perception of burnout. ***Total Score of all 31 participants.

https://doi.org/10.1371/journal.pone.0342993.s001

(DOCX)

Acknowledgments

We thank Dr. Humberto Hidalgo, Dr. Scott Spear, and Dr. Michael Dobbs for providing feedback on the questionnaire during development.

References

  1. 1. Filip R, Gheorghita Puscaselu R, Anchidin-Norocel L, Dimian M, Savage WK. Global challenges to public health care systems during the covid-19 pandemic: a review of pandemic measures and problems. J Pers Med. 2022;12(8):1295. pmid:36013244
  2. 2. Haldane V, De Foo C, Abdalla SM, Jung A-S, Tan M, Wu S, et al. Health systems resilience in managing the COVID-19 pandemic: lessons from 28 countries. Nat Med. 2021;27(6):964–80. pmid:34002090
  3. 3. Haldane V, Morgan GT. From resilient to transilient health systems: the deep transformation of health systems in response to the COVID-19 pandemic. Health Policy Plan. 2021;36(1):134–5. pmid:33319220
  4. 4. Haldane V, Zhang Z, Abbas RF, Dodd W, Lau LL, Kidd MR, et al. National primary care responses to COVID-19: a rapid review of the literature. BMJ Open. 2020;10(12):e041622. pmid:33293398
  5. 5. Lee J-K. How to transform the medical care system after the COVID-19 pandemic. Osong Public Health Res Perspect. 2023;14(6):439–40. pmid:38204423
  6. 6. West CP, Dyrbye LN, Sinsky C, Trockel M, Tutty M, Nedelec L, et al. Resilience and Burnout Among Physicians and the General US Working Population. JAMA Netw Open. 2020;3(7):e209385. pmid:32614425
  7. 7. Yates SW. Physician stress and burnout. Am J Med. 2020;133(2):160–4. pmid:31520624
  8. 8. El-Aswad N. A simple response to physician burnout. Am J Med. 2020;133(8):e442. pmid:32741449
  9. 9. Rothenberger DA. Physician Burnout and Well-Being: A Systematic Review and Framework for Action. Dis Colon Rectum. 2017;60(6):567–76. pmid:28481850
  10. 10. Ozcoban K, Altunkurek SZ. The relationship between physician and nurses’ burnout and stress levels and healthy lifestyle behavior in the COVID-19 pandemic. Perspect Psychiatr C. 2024;2024.
  11. 11. Wekenborg MK, von Dawans B, Gienger NT, Wierick A, Weitz J, Dobroschke JC. Beliefs about stress moderate the association between COVID-19-related work demands and burnout symptoms in physicians. Stress Health. 2024;40(1):e3278. pmid:37246721
  12. 12. Zuccarella-Hackl C, Princip M, Holzgang SA, Sivakumar S, Kuenburg A, Pazhenkottil AP, et al. Cortisol Reactivity to Acute Psychosocial Stress in Physician Burnout. Biomedicines. 2024;12(2):335. pmid:38397938
  13. 13. Zhang M, Li S, Han D, Wu Y, Zhao J, Liao H, et al. Association of job characteristics and burnout of healthcare workers in different positions in rural china: a cross-sectional study. Int J Public Health. 2023;68:1605966. pmid:37600525
  14. 14. Cano-López I, Pérez MI, Puig-Pérez S. Burnout is related to executive dysfunction in primary healthcare professionals working in rural areas. Rev Neurol. 2023;76(3):91–9. pmid:36703502
  15. 15. Ofei-Dodoo S, Loo-Gross C, Kellerman R. Burnout, depression, anxiety, and stress among family physicians in Kansas: 18 months into the COVID-19 pandemic. J Am Board Fam Med. 2022;35(5):921–32.
  16. 16. Appiani FJ, Rodríguez Cairoli F, Sarotto L, Yaryour C, Basile ME, Duarte JM. Prevalence of stress, burnout syndrome, anxiety and depression among physicians of a teaching hospital during the COVID-19 pandemic. Arch Argent Pediatr. 2021;119(5):317–24. pmid:34569739
  17. 17. Selamu M, Hanlon C, Medhin G, Thornicroft G, Fekadu A. Burnout among primary healthcare workers during implementation of integrated mental healthcare in rural Ethiopia: a cohort study. Hum Resour Health. 2019;17(1):58. pmid:31319872
  18. 18. Asante JO, Li MJ, Liao J, Huang YX, Hao YT. The relationship between psychosocial risk factors, burnout and quality of life among primary healthcare workers in rural Guangdong province: a cross-sectional study. BMC Health Serv Res. 2019;19(1):447. pmid:31269949
  19. 19. West CP, Dyrbye LN, Shanafelt TD. Physician burnout: contributors, consequences and solutions. J Intern Med. 2018;283(6):516–29. pmid:29505159
  20. 20. Shanafelt TD, Dyrbye LN, Sinsky C, Hasan O, Satele D, Sloan J, et al. Relationship Between Clerical Burden and Characteristics of the Electronic Environment With Physician Burnout and Professional Satisfaction. Mayo Clin Proc. 2016;91(7):836–48. pmid:27313121
  21. 21. Sinsky C, Colligan L, Li L, Prgomet M, Reynolds S, Goeders L, et al. Allocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties. Ann Intern Med. 2016;165(11):753–60. pmid:27595430
  22. 22. Shanafelt TD, Balch CM, Bechamps G, Russell T, Dyrbye L, Satele D, et al. Burnout and medical errors among American surgeons. Ann Surg. 2010;251(6):995–1000.
  23. 23. Halbesleben JRB, Rathert C. Linking physician burnout and patient outcomes: exploring the dyadic relationship between physicians and patients. Health Care Manage Rev. 2008;33(1):29–39. pmid:18091442
  24. 24. Moses AC, Dreyer AR, Robertson L. Factors associated with burnout among healthcare providers in a rural context, South Africa. Afr J Prim Health Care Fam Med. 2024;16(1):e1–10. pmid:38299543
  25. 25. Omar AS, Alchalabi H, Gordon A. Impact of the COVID-19 Pandemic on Medical Career Aspirations Among Children of Physicians and Other Healthcare Workers: A Scoping Review. Cureus. 2025;17(6):e85994. pmid:40661998
  26. 26. Rodriguez N, Cho LD, Memtsoudis SG, Poeran J. Trends in the U.S. health care workforce: a decade of staffing and compensation practices across care settings. Med Care. 2025;63(9):666–71. pmid:40793914
  27. 27. Rotenstein LS, Shah P, Shanafelt T, Sinsky CA. Incomplete team staffing, burnout, and work intentions among US physicians. JAMA Intern Med. 2025;185(6):739–42. pmid:40367518
  28. 28. Sarode AL, Hu X, Dill MJ. COVID-19 and physician burnout in the united states: cross-sectional and longitudinal evidence from a national survey. Health Serv Res. 2025;60(6):e70003. pmid:40801267
  29. 29. Ariely D, Lanier WL. Disturbing Trends in Physician Burnout and Satisfaction With Work-Life Balance: Dealing With Malady Among the Nation’s Healers. Mayo Clin Proc. 2015;90(12):1593–6. pmid:26653295
  30. 30. Surawattanasakul V, Siviroj P, Kiratipaisarl W, Sirikul W, Phetsayanavin V, Pholvivat C, et al. Physician burnout, associated factors, and their effects on work performance throughout first-year internships during the COVID-19 pandemic in Thailand: a cross-sectional study. BMC Public Health. 2025;25(1):1967. pmid:40437382
  31. 31. Wang J, Feng L, Meng N, Yang C, Cai F, Huang X, et al. Balancing mental health through predictive modeling for healthcare workers during public health crises. Sci Rep. 2025;15(1):28788. pmid:40770397
  32. 32. Wen L, Zheng J, Hu N, Xu W, Fang Y, Ma S, et al. Support measures and demand among healthcare workers during the COVID-19 pandemic: a survey in high-workload provinces of China, 2023. BMJ Open. 2025;15(5):e088799. pmid:40413048
  33. 33. Williams AM, Bullock A, LaGrotte CA, Jesse MT, Dowd SM, Yozwiak JA. Psychologists’ well-being, stressors, and practices in academic health centers: a peri-pandemic update. J Clin Psychol Med Settings. 2025.
  34. 34. Woolcock SC, Patterson DG, Dunn JA, Peterson LE, Andrilla CHA. Rural and urban differences in family physician burnout before and during the COVID-19 pandemic. J Rural Health. 2025;41(3):e70051. pmid:40643282
  35. 35. Schaufeli WB, Leiter MP, Maslach C. Burnout: 35 years of research and practice. Career Development International. 2009;14(3):204–20.
  36. 36. Tai-Seale M, Baxter S, Millen M, Cheung M, Zisook S, Çelebi J, et al. Association of physician burnout with perceived EHR work stress and potentially actionable factors. J Am Med Inform Assoc. 2023;30(10):1665–72. pmid:37475168
  37. 37. West CP, Dyrbye LN, Erwin PJ, Shanafelt TD. Interventions to prevent and reduce physician burnout: a systematic review and meta-analysis. Lancet. 2016;388(10057):2272–81. pmid:27692469
  38. 38. West CP, Dyrbye LN, Erwin PJ, Shanafelt TD. Interventions to Prevent and Reduce Physician Burnout: A Systematic Review and Meta-analysis. Obstet Gynecol Surv. 2017;72(3):147–9.
  39. 39. Chen X, Zhou R, Zhang X, Han J, Ju F, Zhou Y, et al. Correlation between job burnout, psychological status, and job satisfaction among anesthesiologists in the post-COVID-19 era: a cross-sectional study in China. Front Public Health. 2025;13:1555141. pmid:40600159
  40. 40. Tajirian T, Lo B, Tasca A, Poynter B, Zai G, Strudwick G. Advancing system-level strategies: perspectives and recommendations for EHR-related burnout in Canada. Stud Health Technol Inform. 2025;327:412–3.
  41. 41. Selamu M, Thornicroft G, Fekadu A, Hanlon C. Conceptualisation of job-related wellbeing, stress and burnout among healthcare workers in rural Ethiopia: a qualitative study. BMC Health Serv Res. 2017;17(1):412. pmid:28629360
  42. 42. Smith ML, Crowley M, Liese BS. Physician wellness: Managing stress and preventing burnout. J Fam Pract. 2023;72(4):172–8. pmid:37224542
  43. 43. West CP, Dyrbye LN, Sinsky C, Trockel M, Tutty M, Nedelec L, et al. Resilience and burnout among physicians and the general US working population. JAMA Netw Open. 2020;3(7):e209385. pmid:32614425
  44. 44. Hansen N, Jensen K, MacNiven I, Pollock N, D’Hont T, Chatwood S. Exploring the impact of rural health system factors on physician burnout: a mixed-methods study in Northern Canada. BMC Health Serv Res. 2021;21(1):869. pmid:34433434
  45. 45. Seitz R, Robertson J, Moran TP, Zdradzinski MJ, Kaltiso SAO, Heron S. Emergency medicine nurse practitioner and physician assistant burnout, perceived stress, and utilization of wellness resources during 2020 in a large urban medical center. Adv Emerg Nurs J. 2022;44(1):63–73.
  46. 46. Bianchi R, Schonfeld IS. Examining the evidence base for burnout. Bull World Health Organ. 2023;101(11):743–5. pmid:37961064
  47. 47. Tham R, Pascoe A, Willis K, Kay M, Smallwood N. Differences in psychosocial distress among rural and metropolitan health care workers during the COVID-19 pandemic. Aust J Rural Health. 2022;30(5):683–96. pmid:35511109
  48. 48. Song J, Fan C, Li Q, Wang A, Wang W, Zhou L, et al. The status of emotional labour and its influence on job burnout among village doctors during the COVID-19 pandemic in China: a cross-sectional study. BMC Prim Care. 2023;24(1):19. pmid:36650448
  49. 49. Bailey BC, Cox S, Terris L, van Oppen D, Howsare J, Berry JH, et al. Rural health care worker wellness during COVID-19: Compassion fatigue, compassion satisfaction & utilization of wellness resources. PLoS One. 2023;18(12):e0295020. pmid:38064476
  50. 50. Bethea A, Samanta D, Kali M, Lucente FC, Richmond BK. The impact of burnout syndrome on practitioners working within rural healthcare systems. Am J Emerg Med. 2020;38(3):582–8. pmid:31706660
  51. 51. Harry ML, Sudak NL, Engels MJ, Horn KK, Dean K, Poplau S, et al. Physician and advanced practice clinician burnout in rural and urban settings. J Am Board Fam Med. 2024;37(1):43–58. pmid:38448238
  52. 52. Leskovic L, Erjavec K, Leskovar R, Vukovič G. Burnout and job satisfaction of healthcare workers in Slovenian nursing homes in rural areas during the COVID-19 pandemic. Ann Agric Environ Med. 2020;27(4):664–71. pmid:33356076
  53. 53. Mazur A, Czarkowska M, Goś A, Humeniuk E. Existential attitudes as predictors of burnout in Polish nurses employed in rural primary healthcare settings. Ann Agric Environ Med. 2018;25(3):552–8. pmid:30260175
  54. 54. Tanne JH. AMA raises alarm over crisis in rural healthcare in US. BMJ. 2024;385:q1085. pmid:38744485
  55. 55. Ramirez AG, Thompson IM, Vela L. The South Texas health status review: A health disparities roadmap. Cham. 2013.
  56. 56. Walker R, Pine H. Physician wellness is an ethical and public health issue. Otolaryngology Head and Neck Surgery. 2018;158(6):970–1.
  57. 57. Bialaszewski RP, Gaddis JM, Martin B, Dentino P, Ronnau J. Bridging bone health: osteoporosis disparities in the Rio Grande Valley. Cureus J Med Science. 2023;15(12).
  58. 58. Bianchi R, Swingler G, Schonfeld IS. The maslach burnout inventory is not a measure of burnout. Work. 2024;79(3):1525–7. pmid:38759089
  59. 59. Soares JP, Lopes RH, Mendonça PB de S, Silva CRDV, Rodrigues CCFM, Castro JL de. Use of the maslach burnout inventory among public health care professionals: protocol for a scoping review. JMIR Res Protoc. 2022;11(11):e42338. pmid:36318252
  60. 60. Aiello EN, Fiabane E, Margheritti S, Magnone S, Bolognini N, Miglioretti M, et al. Psychometric properties of the Copenhagen Burnout Inventory (CBI) in Italian Physicians. Med Lav. 2022;113(4):e2022037. pmid:36006095
  61. 61. Alahmari MA, Al Moaleem MM, Hamdi BA, Hamzi MA, Aljadaani AT, Khormi FA, et al. Prevalence of burnout in healthcare specialties: a systematic review using copenhagen and maslach burnout inventories. Med Sci Monit. 2022;28:e938798. pmid:36536586
  62. 62. Demetres MR, Wright DN, DeRosa AP. Burnout among medical and health sciences information professionals who support systematic reviews: an exploratory study. J Med Libr Assoc. 2020;108(1):89–97. pmid:31897056
  63. 63. Fadare OO, Andreski M, Witry MJ. Validation of the Copenhagen Burnout Inventory in Pharmacists. Innov Pharm. 2021;12(2).
  64. 64. Mahmoudi S, Atashzadeh-Shoorideh F, Rassouli M, Moslemi A, Pishgooie AH, Azimi H. Translation and Psychometric Properties of the Copenhagen Burnout Inventory in Iranian Nurses. Iran J Nurs Midwifery Res. 2017;22(2):117–22. pmid:28584549
  65. 65. Oluwadiya KS, Owoeye OK, Adeoti AO. Evaluating the factor structure, reliability and validity of the Copenhagen Burnout Inventory-Student Survey (CBI-SS) among faculty of arts students of Ekiti State University, Ado-Ekiti, Nigeria. Sci Rep. 2024;14(1):10476. pmid:38714782
  66. 66. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform. 2019;95:103208. pmid:31078660
  67. 67. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. pmid:18929686
  68. 68. Collis A, Garimella K, Moehring A, Rahimian MA, Babalola S, Gobat NH, et al. Global survey on COVID-19 beliefs, behaviours and norms. Nat Hum Behav. 2022;6(9):1310–7. pmid:35606513
  69. 69. Verma SS, Dudek S, Williamson JL, Verma A, Robinson S, Rader DJ, et al. Research on COVID-19 through patient-reported data: a survey for observational studies in the COVID-19 pandemic. J Clin Transl Sci. 2020;20:1–5.
  70. 70. Stanislawski K. The coping circumplex model: An integrative model of the structure of coping with stress. Frontiers in Psychology. 2019;10:694.
  71. 71. Zou M, Liu B, Ji J, Ren L, Wang X, Li F. The Relationship Between Negative Coping Styles, Psychological Resilience, and Positive Coping Styles in Military Personnel: A Cross-Lagged Analysis. Psychol Res Behav Manag. 2024;17:13–21. pmid:38192275
  72. 72. Bäckman L, Dixon RA. Psychological compensation: a theoretical framework. Psychol Bull. 1992;112(2):259–83. pmid:1454895
  73. 73. Ortega MV, Hidrue MK, Lehrhoff SR, Ellis DB, Sisodia RC, Curry WT, et al. Patterns in Physician Burnout in a Stable-Linked Cohort. JAMA Netw Open. 2023;6(10):e2336745. pmid:37801314
  74. 74. Shanafelt TD, Boone S, Tan L, Dyrbye LN, Sotile W, Satele D, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):1377–85. pmid:22911330
  75. 75. Somville F, Van der Mieren G, De Cauwer H, Van Bogaert P, Franck E. Burnout, stress and Type D personality amongst hospital/emergency physicians. Int Arch Occup Environ Health. 2022;95(2):389–98. pmid:34652534
  76. 76. Xu W, Pan Z, Li Z, Lu S, Zhang L. Job Burnout among primary healthcare workers in rural China: a multilevel analysis. Int J Environ Res Public Health. 2020;17(3):727. pmid:31979154
  77. 77. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53–5. pmid:28029643
  78. 78. Dwivedi AK, Mallawaarachchi I, Alvarado LA. Analysis of small sample size studies using nonparametric bootstrap test with pooled resampling method. Stat Med. 2017;36(14):2187–205. pmid:28276584
  79. 79. Fujisawa K, Shimo M, Taguchi Y-H, Ikematsu S, Miyata R. PCA-based unsupervised feature extraction for gene expression analysis of COVID-19 patients. Sci Rep. 2021;11(1):17351. pmid:34456333
  80. 80. Kumar V, Biswas S, Rajput DS, Patel H, Tiwari B. PCA-based incremental extreme learning machine (PCA-IELM) for COVID-19 patient diagnosis using chest X-ray images. Comput Intell Neurosci. 2022;2022:9107430.
  81. 81. Kaiser HF. The varimax criterion for analytic rotation in factor analysis. Psychometrika. 1958;23(3):187–200.
  82. 82. Chan Y, Walmsley RP. Learning and understanding the Kruskal-Wallis one-way analysis-of-variance-by-ranks test for differences among three or more independent groups. Phys Ther. 1997;77(12):1755–62. pmid:9413454
  83. 83. Brtnikova M, Crane LA, Allison MA, Hurley LP, Beaty BL, Kempe A. A method for achieving high response rates in national surveys of U.S. primary care physicians. PLoS One. 2018;13(8):e0202755. pmid:30138406
  84. 84. Wiebe ER, Kaczorowski J, MacKay J. Why are response rates in clinician surveys declining?. Can Fam Physician. 2012;58(4):e225-8.
  85. 85. Baumgarten C, Michinov E, Rouxel G, Bonneterre V, Gay E, Roche P-H. Personal and psychosocial factors of burnout: A survey within the French neurosurgical community. PLoS One. 2020;15(5):e0233137. pmid:32469930
  86. 86. Saddawi-Konefka D, Moutier CY, Ehrenfeld JM. Reducing Barriers to Mental Health Care for Physicians: An Overview and Strategic Recommendations. JAMA. 2025;:10.1001/jama.2025.12587. pmid:40810984
  87. 87. Schröter M, Koch AK, Berschick J, Schiele JK, Bogdanski M, Steinmetz M, et al. Feasibility of a tailored, combined intervention with mind-body elements to prevent burnout in healthcare professionals (LAGOM) in a mixed-methods multicenter single-arm trial. Sci Rep. 2025;15(1):27414. pmid:40721457
  88. 88. Chavez JC, Wren SM, Knowlton LM. Disparities in Outcomes after Emergency Surgery in the Rio Grande Valley of Texas. J Am College of Surgeons. 2021;233(5):S129–30.
  89. 89. Lopez-Alvarenga JC, Rasa C, Banu J, Mito S, Chavez AO, Reyna SM. Commentary on Metabolic Health Disparities Affecting the Rio Grande Valley Mexican American Population: Seeking Answers Using Animal Models. Ethn Dis. 2023;33(1):55–60. pmid:38846261
  90. 90. Manusov EG, Diego VP, Williams-Blangero S. Frailty index in the Colonias of the Rio Grande Valley: health related quality of life and resilience. Front Med (Lausanne). 2023;10:1240494. pmid:38089876
  91. 91. Palacio CH, Cruz B, Vanier C, Cano J, Scott BG. The mechanism and pattern of injuries of undocumented immigrants crossing the Texas-Mexico border along the Rio Grande Valley. Inj Epidemiol. 2021;8(1):58. pmid:34706773
  92. 92. Salcedo MP, Gowen R, Rodriguez AM, Fisher-Hoch S, Daheri M, Guerra L, et al. Addressing high cervical cancer rates in the Rio Grande Valley along the Texas-Mexico border: a community-based initiative focused on education, patient navigation, and medical provider training/telementoring. Perspect Public Health. 2023;143(1):22–8. pmid:34130548
  93. 93. Salinas LMB, Machiorlatti M, Romero Z, Wang L, Alanis E, Treviño-Peña R. The Relationship Between Food Insecurity and Food Assistance Program Participation in Families of Preschool Children in the Rio Grande Valley. Journal of Hunger & Environmental Nutrition. 2023;19(1):67–85.
  94. 94. Fred HL, Scheid MS. Physician burnout: causes, consequences, and (?) cures. Tex Heart I J. 2018;45(4):198–202.
  95. 95. Macaron MM, Segun-Omosehin OA, Matar RH, Beran A, Nakanishi H, Than CA, et al. A systematic review and meta analysis on burnout in physicians during the COVID-19 pandemic: A hidden healthcare crisis. Front Psychiatry. 2023;13:1071397. pmid:36713915
  96. 96. Shapiro DE, Duquette C, Abbott LM, Babineau T, Pearl A, Haidet P. Beyond Burnout: A Physician Wellness Hierarchy Designed to Prioritize Interventions at the Systems Level. Am J Med. 2019;132(5):556–63. pmid:30553832
  97. 97. Dawkins-Cavazos M. Racial tension, public mistrust, and policing: Insights from police leaders in the Rio Grande Valley (RGV)- a research note. Journal of Ethnicity in Criminal Justice. 2022;20(3):248–69.