Peer Review History

Original SubmissionJanuary 22, 2024
Decision Letter - Asli Suner Karakulah, Editor

PONE-D-24-02400Expert decision-making in clinicians: An auto-analytic ethnographic study of operational decision-making in urgent carePLOS ONE

Dear Dr. Irvine,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Sep 13 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Asli Suner Karakulah, PhD

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that your Data Availability Statement is currently as follows: [All relevant data are within the manuscript and its Supporting Information files.]

Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods (https://journals.plos.org/plosone/s/data-availability#loc-minimal-data-set-definition).

For example, authors should submit the following data:

- The values behind the means, standard deviations and other measures reported;

- The values used to build graphs;

- The points extracted from images for analysis.

Authors do not need to submit their entire data set if only a portion of the data was used in the reported study.

If your submission does not contain these data, please either upload them as Supporting Information files or deposit them to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories.

If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. If data are owned by a third party, please indicate how others may request data access.

3. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Your manuscript has been reviewed and requires modifications prior to making a decision. The comments of the reviewers are included at the bottom of this letter. Reviewers indicated that introduction, methods and discussion sections should be improved. We would be glad to consider a substantial revision of your work, where the reviewer’s comments will be carefully addressed one by one.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear Author,

Congratulation for conducting this study. I found your study valuable.

Please consider these comments:

Abstract:

1. It is important to briefly describe the setting of study since it influences readers understanding of the study.

2. As your context is specific, I think your study is focused Ethnography.

Methods:

1. Triangulation in method of data gathering, data sources and investigators is necessary. Please declare them as your limitations if they are not committed in your study.

2. Setting of the ward including number of beds, physicians, private or public, exact duration of spending time in the ward for study is necessary.

3. Diverse background of participants should be pointed out by more details.

4. You should have thick description in fact you should explain about relationships and events in addition to physical environment.

5. Detailed explanations about interviews are needed including time, being face-to-face and etc.

6. Was data analysis according to inductive or deductive methods?

7. Describe about considerations of rigor and also triangulation in analysis.

8. Please describe that data collection and data analysis happened simultaneously.

9. Conducting focus group should be described by more details including number of FGs, participants, time, questions, etc.

10. Please describe about participants characteristics.

Discussion:

Please explain about limitations of your work like possibility of social desirability bias or other biases.

Reviewer #2: Overall, this paper significantly contributes to our understanding of expert decision-making in urgent care settings. Addressing the above suggestions could further enhance its impact and clarity. It offers a fresh look at intuitive decision-making in expert clinicians within urgent care, a subject that's not been deeply explored before. Focusing on the cognitive processes behind early expert decision-making, especially in telephone triage, addresses a noticeable gap in current research. Combining analytic autoethnography with ethnographic observation is an innovative method that adds depth to the collected data. This dual approach provides a richer understanding of decision-making processes from both a personal and observational perspective, boosting the study's credibility. Creating a grounded theoretical model of expert decision-making using the Gioia methodology is an inventive way to categorize decision types and processes. This model has potential as a basis for future research and training programs.

The manuscript can be further enhanced if the authors consider the following comments:

1- Clarify the methodological details, particularly how the Gioia method was applied, to help readers better understand the thematic analysis and model development process.

2- Provide a broader contextualization by comparing the findings with decision-making processes in other high-stakes domains, strengthening the argument that intuitive decision-making is a universal skill among experts.

3-Discuss the study's limitations in more detail, including the small sample size and potential bias from the lead author’s dual role. Address the generalizability of the findings to other settings and specialties.

4- Expand on future research directions, particularly in developing training programs or AI systems, providing specific suggestions for experimental studies or simulations to build on these findings.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

We thank the reviewers for their very helpful and constructive feedback on our article. We also thank them for supportive comments about the importance of research in this field and the methodology employed.

We have reviewed the comments and agree with all points made. We have amended our manuscript to reflect the recommendations.

Please note the line referenced refer to the tracked changes manuscript to allow comparison with previous submission.

Reviewer #1:

Abstract:

1. It is important to briefly describe the setting of study since it influences readers understanding of the study.

We have updated the original manuscript to include a brief description of the urgent care facility, setting, and population (lines 29-30).

2. As your context is specific, I think your study is focused Ethnography.

We have updated the description of methods in the abstract to incorporate the reviewers recommendations of the term ‘Focused Ethnography’ (line 27-28). As a crucial component of the study, the analytic autoethnographic component is also included.

Methods:

1. Triangulation in method of data gathering, data sources and investigators is necessary. Please declare them as your limitations if they are not committed in your study.

A limitations section has been added to the manuscript. This explains the limits of the triangulation that was possible. Lines 590-592

2. Setting of the ward including number of beds, physicians, private or public, exact duration of spending time in the ward for study is necessary.

3. Diverse background of participants should be pointed out by more details.

4. You should have thick description in fact you should explain about relationships and events in addition to physical environment.

We have provided a richer description of the ward setting as advised. This includes the resources, types of patients, relationships, and events pertinent to the study Lines 153 – 196

The duration of time spent has been added to the data collection section at Lines 214-217

Participants descriptions have been updated to provide more details Lines 198-206

5. Detailed explanations about interviews are needed including time, being face-to-face and etc.

A fuller description of the particulars of the interviews and notes taken has been added Lines 217-238

6. Was data analysis according to inductive or deductive methods?

Description of the Gioia Methodology of analysis has been updated to specify inductive analysis Lines 251-266.

7. Describe about considerations of rigor and also triangulation in analysis.

Methodology section has been updated to improve descriptions of rigor in the method and sources for triangulation. Limitations in triangulation added to end of discussion as described above Lines 120-139

8. Please describe that data collection and data analysis happened simultaneously.

Manuscript adjusted to explain simultaneous collection and analysis of data Line 147

9. Conducting focus group should be described by more details including number of FGs, participants, time, questions, etc.

10. Please describe about participants characteristics.

Description of the focus group has been updated to include more detail as recommended including the participant characteristics Lines 268-285

Discussion:

Please explain about limitations of your work like possibility of social desirability bias or other biases.

Line 588-614 Limitations section added and include biases as recommended by the reviewer

Reviewer #2:

The manuscript can be further enhanced if the authors consider the following comments:

1- Clarify the methodological details, particularly how the Gioia method was applied, to help readers better understand the thematic analysis and model development process.

Lines 248-266 Methodology section updated as recommended

2- Provide a broader contextualization by comparing the findings with decision-making processes in other high-stakes domains, strengthening the argument that intuitive decision-making is a universal skill among experts.

Lines 572-586 Expansion on discussion of intuitive expertise in other domains

3-Discuss the study's limitations in more detail, including the small sample size and potential bias from the lead author’s dual role. Address the generalizability of the findings to other settings and specialties.

Line 588-614 Limitations section added and include biases as recommended by the reviewer

4- Expand on future research directions, particularly in developing training programs or AI systems, providing specific suggestions for experimental studies or simulations to build on these findings.

We thank the reviewer for this suggestion. Indeed, we did initially consider including more detail about how our work could inform future research into AI systems for decision support in this domain. However, on further reading we realised it is an expansive topic in which we are to advise upon re: methodology of future studies. We acknowledge our limitations in being able to expand upon this further in the final section (Line 629-633)

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Asli Suner Karakulah, Editor

Expert decision-making in clinicians: An auto-analytic ethnographic study of operational decision-making in urgent care

PONE-D-24-02400R1

Dear Dr. Irvine,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Asli Suner Karakulah, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

The authors addressed the reviewers' concerns and substantially improved the content of the manuscript. So, based on my own assessment as an academic editor, no further revisions are required and the manuscript can be accepted in its current form.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

Formally Accepted
Acceptance Letter - Asli Suner Karakulah, Editor

PONE-D-24-02400R1

PLOS ONE

Dear Dr. Irvine,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Asli Suner Karakulah

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .