Peer Review History

Original SubmissionNovember 18, 2024
Decision Letter - Francesco Marcatto, Editor

PONE-D-24-35973Leadership Development as a Novel Strategy to Mitigate Burnout Among Female PhysiciansPLOS ONE

Dear Dr. Sears,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Feb 16 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols .

We look forward to receiving your revised manuscript.

Kind regards,

Francesco Marcatto, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.  Please include a separate caption for each figure in your manuscript.

3. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files"

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript titled "Leadership Development as a Novel Strategy to Mitigate Burnout Among Female Physicians" examines a critical issue in healthcare, focusing on the prevalence of burnout among female physicians and proposing the Women Leaders in Medicine (WLiM) program as a novel intervention. The study is well-structured and methodologically sound, providing a detailed evaluation of how leadership development can mitigate burnout and enhance career trajectories in this population. The intervention itself is comprehensive, incorporating bi-annual leadership summits, networking opportunities, and continuous support programs, which are designed to address burnout from multiple dimensions.

The study demonstrates considerable methodological rigor. It employs validated tools, such as the Maslach Burnout Index (MBI), to assess burnout dimensions and uses a combination of internal and external control groups to strengthen the robustness of the findings. The longitudinal nature of the data collection, spanning over two years with surveys conducted at three time points, adds depth to the analysis and ensures the reliability of the results. The findings reveal statistically significant improvements in emotional exhaustion, depersonalization, and personal accomplishment among participants of the WLiM program, as well as an increase in leadership aspirations compared to non-participants. These results underscore the potential of leadership development programs to not only reduce burnout but also empower female physicians in their professional growth.

Despite its strengths, the study has some limitations that could impact its generalizability. The self-selection of participants into the WLiM program introduces a potential bias, as those already motivated to seek leadership roles or address burnout may be overrepresented. Additionally, the study is confined to a specific healthcare system, which may limit its applicability to other institutional or cultural contexts. The reliance on self-reported data further raises concerns about response bias, and the non-randomized design restricts causal inferences. While the manuscript acknowledges these limitations, a more detailed discussion of their implications would enhance the study's transparency and credibility.

External factors, such as concurrent social movements like #MeToo and #TimesUpHealthcare, might have also influenced the outcomes, and the manuscript could benefit from further exploration of these potential confounders. Expanding the analysis to include demographic subgroups could provide additional insights into the intervention's differential impacts. Furthermore, a follow-up assessment of long-term outcomes would be valuable to determine the sustainability of the observed benefits.

Overall, this manuscript makes a significant contribution to the literature on physician burnout and leadership development. The intervention is practical, evidence-based, and addresses a pressing issue in healthcare. With minor revisions to address its limitations and to broaden the scope of its discussion, the manuscript is well-suited for publication and will provide valuable insights for healthcare institutions aiming to support their workforce and promote leadership among female physicians.

Have you bought the licence for Maslach Burnout Inventory?

Reviewer #2: I read this study with great interest given its relevance to many themes around important issues of burnout, retention, leadership, and gender disparities within these issues. Overall it is written clearly, contributes to the literature, and contains interesting information. The following comments and suggestions are to aid the authors in making sure the content is clear to readers.

Minor typos:

Abstract / Results paragraph:

Change “improved levels personal accomplishment…” to “improved levels (of) personal accomplishment…”

Results section / Paragraph beginning “Baseline demographics…”

Change “The TMA and WLiM groups had similar work hours, with 74.8 of 10 211 WiLM and 76.7% of TMA physicians working 40 hours per week” to “The TMA and WLiM groups had similar work hours, with 74.8(%) of 10 211 WiLM and 76.7% of TMA physicians working 40 hours per week”

Other comments / questions:

Abstract:

Consider stating whether the results found were statistically significant or not within the abstract

Results:

Paragraph beginning “Baseline demographics of female…”

“Early career physicians were more prevalent in non-attendees versus attendee cohorts (less than 5 years in practice 29% vs. 16.5%).”

This statement stood out and if word count allows, there could be additional reflection or exposition on this. Early career physicians are a particularly vulnerable group, with unique stressors, and would benefit from this kind of support, though may be less likely to identify as “ready for leadership” and therefore less likely to self-select.

Paragraph beginning “At baseline…”

“A longitudinal comparison of the 143 women physicians who completed all questions on surveys in 2018 and 2020 demonstrated that participants in WLiM events had lower MBI-EE scores (2.9 at baseline to 2.5 at follow-up) while non-participants showed a less significant decrease from 3.2 at baseline to 3.0 at follow-up. Improvement in single-item MBI-EE scores among the WLiM group was double the improvement seen in female non-participant controls (cohort 1).”

This shows that even without the WLiM program, a woman physician had a 6% decrease in EE compared to a 13.8% decrease in EE for participants - so the proportion “left over” that can be accounted for by the WMiL program is smaller - can the authors comment on whether it is still a significant change?

Paragraph beginning “Participants in WLiM demonstrated an increase in leadership aspirations…”

“Female non-participant controls (cohort 1) experienced the most improvement”

0.36 / 4.8% change for WLiM participants, 0.91 / 17% for cohort 1, 0.11 / 1.7% TMA group

Less improvement in cohort participants for leadership aspiration - wonder why? Interesting to discuss and explore potential factors for this disparity

Discussion:

Paragraph beginning “At baseline, more than ⅓ of all physicians surveyed…”

“The female physicians participating in WLiM events were the only group to demonstrate a statistically significant decrease in emotional exhaustion and, at follow up, WLiM participants demonstrated 13 the lowest MBI-EE scores of all groups surveyed.“

This is notable. I read it twice. “Emotional exhaustion” is such a pervasive and relatable term for women physicians at all stages of career. Again, causes me to reflect on how a program like this might benefit early career physicians (who were less likely to participate in this leadership program)

Paragraph “WLiM participants showed higher leadership aspirations on baseline surveys compared to the other groups. BSWH non-participant female physicians (cohort 1) scored lowest on this domain, which may indicate a bias toward WLiM participation for female physicians who are interested in leadership.”

At first read, this statement seemed to contradict the prior conclusions that cohort 1 participants had the greatest improvement in leadership aspirations. After re-reading, it is clear that the authors are now comparing the baseline numbers and showing how this could be a limitation. Perhaps this would fit better under the paragraph describing “limitations” or be included in the results section to help explain WHY cohort 1 shows more improvement?

Paragraph beginning “A unique strength of this paper…”

“This study evaluated a practical real-world program that can help physician retention…”

This may be misleading. When reviewing the actual data, it appears that retention with organization actually increased MORE for the non-WLiM participants. And if looking at the median value (instead of the mean value), the retention rate of the WLiM group actually got WORSE.

Data table 2

Related to the previous point - the text below the table starts “All parameters (Burnout, leadership aspirations and intention to stay) improved for the women who participated in WLiM events compared to those who did not…” however “intention to stay” did not improve for women who participated in WLiM events COMPARED TO those who did not.

Other potential limitations to address:

The intervention WLiM group had APPs in addition to physicians. By including APPs as participants, this may have an unknown effect or impact on the culture and nature of the programs and the physicians who participated in them

Only binary gender is included in the study and may have limited participation and understanding of non-binary, transgender, or gender-fluid individuals

TMA physicians were older, more experienced, and less likely to have young children. All 3 of these things may have an unknown impact on the outcome of the results

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .

Reviewer #1: Yes:  Izabella Uchmanowicz

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step.

Revision 1

PLOS One Reviewers

RE: PONE-D- 24-35973: Leadership Development as a Novel Strategy to Mitigate Burnout Among Female Physicians

February 4, 2025

Thank you so much for taking the time to review our manuscript and send us your thoughts to enhance the quality of this work and help it be relevant to your audiences. We greatly appreciate your support for promoting evidence-based solutions for the crisis of physician burnout, which disproportionately affects women physicians.

Specific concerns addressed:

Reviewer 1:

1. Despite its strengths, the study has some limitations that could impact its generalizability. The self-selection of participants into the WLiM program introduces a potential bias, as those already motivated to seek leadership roles or address burnout may be overrepresented. Additionally, the study is confined to a specific healthcare system, which may limit its applicability to other institutional or cultural contexts. The reliance on self-reported data further raises concerns about response bias, and the non-randomized design restricts causal inferences. While the manuscript acknowledges these limitations, a more detailed discussion of their implications would enhance the study's transparency and credibility.

Thank you for these recommendations. We have further expanded our discussion of potential biases and limitations with could impact the generalizability of our experience. (second to last paragraph in discussion section, pages 14- 15, lines 323-337). We agree that this should lend to more transparency of our findings and conclusions.

2. External factors, such as concurrent social movements like #MeToo and #TimesUpHealthcare, might have also influenced the outcomes, and the manuscript could benefit from further exploration of these potential confounders. Expanding the analysis to include demographic subgroups could provide additional insights into the intervention's differential impacts. Furthermore, a follow-up assessment of long-term outcomes would be valuable to determine the sustainability of the observed benefits.

We agree that long-term follow up assessments would be of great value as well as further exploration of the external factors of #TimesUpHealthcare and #MeToo for future studies. This study began in 2017, when these provocative programs were in their infancy, and information was not collected about these external factors. We hope to examine the role of these social movements in future studies. For demographic subgroups, we found that non-participation was higher in early career women physicians and that participants who identified as mixed race had some of the highest burnout scores. Detailed subgroup analysis is not possible due to the size of the cohort. We agree that long-term outcomes would be very valuable to determine the sustainability of the observed benefits. We hope to be able to pursue this in a future study.

Have you bought the license for Maslach Burnout Inventory?

Yes, we utilized Funds from The Physicians Foundation to secure the license for the full Maslach Burnout Inventory. We clarified this point in the Survey Measurement’s section of our manuscript (page 7, line 159)

Reviewer #2

1. Minor typos:

Abstract / Results paragraph:

Change “improved levels personal accomplishment…” to “improved levels (of) personal accomplishment…”

Thank you for noting this, modified.

2. Results section / Paragraph beginning “Baseline demographics…”

Change “The TMA and WLiM groups had similar work hours, with 74.8 of 10 211 WiLM and 76.7% of TMA physicians working 40 hours per week” to “The TMA and WLiM groups had similar work hours, with 74.8(%) of 10 211 WiLM and 76.7% of TMA physicians working 40 hours per week”

Thank you for the suggestion, manuscript reflects this change.

3. Paragraph beginning “Baseline demographics of female…”

“Early career physicians were more prevalent in non-attendees versus attendee cohorts (less than 5 years in practice 29% vs. 16.5%).”

This statement stood out and if word count allows, there could be additional reflection or exposition on this. Early career physicians are a particularly vulnerable group, with unique stressors, and would benefit from this kind of support, though may be less likely to identify as “ready for leadership” and therefore less likely to self-select.

We agree that early career physicians are the highest risk for burnout and could benefit greatly from these programs, yet participation is less robust. We have found that being the sole bread winner as well as having young children were potential boundaries to participation. We have added this to the paragraph “WLiM participants showed...” (page 13, lines 291-294). Thank you for highlighting this important group.

4. “A longitudinal comparison of the 143 women physicians who completed all questions on surveys in 2018 and 2020 demonstrated that participants in WLiM events had lower MBI-EE scores (2.9 at baseline to 2.5 at follow-up) while non-participants showed a less significant decrease from 3.2 at baseline to 3.0 at follow-up. Improvement in single-item MBI-EE scores among the WLiM group was double the improvement seen in female non-participant controls (cohort 1).”

This shows that even without the WLiM program, a woman physician had a 6% decrease in EE compared to a 13.8% decrease in EE for participants - so the proportion “left over” that can be accounted for by the WMiL program is smaller - can the authors comment on whether it is still a significant change?

Regarding the decrease in MBI-EE within different groups. Thank you for highlighting such an important part of our data collection. Yes, we can confirm that the decreased of EE specific for the participants of WLiM (relative to non-participants) is independently significant.

5. Paragraph beginning “Participants in WLiM demonstrated an increase in leadership aspirations…”

“Female non-participant controls (cohort 1) experienced the most improvement”

0.36 / 4.8% change for WLiM participants, 0.91 / 17% for cohort 1, 0.11 / 1.7% TMA group

Less improvement in cohort participants for leadership aspiration - wonder why? Interesting to discuss and explore potential factors for this disparity

We are happy to further expand on the magnitude of change on leadership aspirations between groups. The methodology involved a Likert scale. Therefore, when baseline for one group (participants) was anchors towards an extreme (above 7) there is less “room” left for further improvement. Therefore, the continued climb was a positive finding. We believe that events outside the study, such as #MeToo, and #TimesUpHealthcare, also helped to increase leadership aspirations even among non-participants. We hypothesis that the climb was higher within the organization due to more senior physician obtaining visible leadership positions during this period. Thank you for allowing us to explore this.

6. Paragraph beginning “At baseline, more than ⅓ of all physicians surveyed…”

“The female physicians participating in WLiM events were the only group to demonstrate a statistically significant decrease in emotional exhaustion and, at follow up, WLiM participants demonstrated 13 the lowest MBI-EE scores of all groups surveyed.“

This is notable. I read it twice. “Emotional exhaustion” is such a pervasive and relatable term for women physicians at all stages of career. Again, causes me to reflect on how a program like this might benefit early career physicians (who were less likely to participate in this leadership program)

Thank you for taking the time to let this most impactful reality set in. We agree, other studies reveal that EE is the single factor that is most predictive for suicide, maladaptive behavior, divorce and quitting the profession. Thank you for your support as we highlight programs which move this needle and hopefully save lives and careers.

7. Paragraph “WLiM participants showed higher leadership aspirations on baseline surveys compared to the other groups. BSWH non-participant female physicians (cohort 1) scored lowest on this domain, which may indicate a bias toward WLiM participation for female physicians who are interested in leadership.”

At first read, this statement seemed to contradict the prior conclusions that cohort 1 participants had the greatest improvement in leadership aspirations. After re-reading, it is clear that the authors are now comparing the baseline numbers and showing how this could be a limitation. Perhaps this would fit better under the paragraph describing “limitations” or be included in the results section to help explain WHY cohort 1 shows more improvement?

Thank you for this thoughtful suggestion. We did move this discussion to the limitations section as we reflect on the population what was ultimately served with this program design.

8. Paragraph beginning “A unique strength of this paper…”

“This study evaluated a practical real-world program that can help physician retention…”

This may be misleading. When reviewing the actual data, it appears that retention with organization actually increased MORE for the non-WLiM participants. And if looking at the median value (instead of the mean value), the retention rate of the WLiM group actually got WORSE

Thank you for pointing this out. We modified our conclusion to only state the burnout and leadership interests.

9. Data table 2

Related to the previous point - the text below the table starts “All parameters (Burnout, leadership aspirations and intention to stay) improved for the women who participated in WLiM events compared to those who did not…” however “intention to stay” did not improve for women who participated in WLiM events COMPARED TO those who did not.

Thank you for the opportunity to clarify the outcomes. We have modified this text on table 2.

10. Other potential limitations to address:

The intervention WLiM group had APPs in addition to physicians. By including APPs as participants, this may have an unknown effect or impact on the culture and nature of the programs and the physicians who participated in them

Only binary gender is included in the study and may have limited participation and understanding of non-binary, transgender, or gender-fluid individuals

TMA physicians were older, more experienced, and less likely to have young children. All 3 of these things may have an unknown impact on the outcome of the results

Thank you for these thoughtful considerations. We agree that many factors are at play in these populations, due to word count restraints and scope we could not address multiple nuances in this manuscript. The APP data is not included in this analysis. As we started this project in 2017, we did not collect information for non-binary, transgender, and gender-fluid participants, but plan to for future projects. More work is needed to look at physician populations and how to best include and serve everyone to thrive in their careers and lives. We look forward to continuing to explore this in future projects.

Thank you to the editors and reviewers for your very thoughtful and detailed input. We feel that the revisions have strengthened this work and we hope that these changes are acceptable to you and your reviewers. We look forward to hearing from you in the near future and we greatly value your partnership.

Dawn Sears, MD, FACG

Attachments
Attachment
Submitted filename: Response to Reviewers 2.4.2025.docx
Decision Letter - Francesco Marcatto, Editor

Leadership Development as a Novel Strategy to Mitigate Burnout Among Female Physicians

PONE-D-24-35973R1

Dear Dr. Sears,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager®  and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Francesco Marcatto, Ph.D.

Academic Editor

PLOS ONE

Formally Accepted
Acceptance Letter - Francesco Marcatto, Editor

PONE-D-24-35973R1

PLOS ONE

Dear Dr. Sears,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Francesco Marcatto

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .