Peer Review History

Original SubmissionJuly 9, 2024
Decision Letter - Naeem Mubarak, Editor

PONE-D-24-25666Validating Quality Standards in Palestinian Emergency Departments: An e-Delphi Survey ApproachPLOS ONE

Dear Dr. Bani Odeh,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 05 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Naeem Mubarak, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include a complete copy of PLOS’ questionnaire on inclusivity in global research in your revised manuscript. Our policy for research in this area aims to improve transparency in the reporting of research performed outside of researchers’ own country or community. The policy applies to researchers who have travelled to a different country to conduct research, research with Indigenous populations or their lands, and research on cultural artefacts. The questionnaire can also be requested at the journal’s discretion for any other submissions, even if these conditions are not met.  Please find more information on the policy and a link to download a blank copy of the questionnaire here: https://journals.plos.org/plosone/s/best-practices-in-research-reporting. Please upload a completed version of your questionnaire as Supporting Information when you resubmit your manuscript.

3. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”).

For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research.

4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information

5. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

The manuscript has a good deal of merit for publication but needs minor revisions to further improve its quality and impact.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for providing me the opportunity to review the manuscript entitled “Validating Quality Standards in Palestinian Emergency Departments: An e-Delphi Survey Approach” by Alr’oof Bani Odeh et al. The approach taken to validate quality standards within Palestinian emergency healthcare settings was crucial. The authors laid a strong foundation for future assessments and the implementation of improved service standards. With the involvement of a diverse panel of experts, the study effectively aimed at achieving consensus through a thorough examination of clinical and administrative domains. This comprehensive evaluation affirmed the robustness of the Emergency Department Quality Standards (EDQS).

While the manuscript fulfils its objective of laying the groundwork for assessing and validating quality standards in Palestinian Emergency Departments, I would like to offer a few minor recommendations that may further enhance the clarity and flow of your work:

1. Introduction (Elaboration on Previous Shortcomings in Literature): It would be beneficial to elaborate on the shortcomings of past researches in their attempts to better elucidate on the gap bridged by the study. ‘Unlike traditional methods of setting quality standards ..’ This statement may be supported by highlighting such previous orthodox methodologies adopted, allowing the study’s innovations to stand out more clearly. Kindly consider this addition under the introduction.

2. Methods:

a. Delphi panel recruitment and sample: In the sentence “In the two rounds only 53... and too long a survey to complete,” it is implied that the length of the survey may have introduced bias. Could you kindly elaborate on the measures taken to ensure that participants who completed the survey were not influenced by the survey's length, and how potential bias was mitigated?

b. Readability, clarity and comprehensiveness: It is recommended to provide further details on the sources utilized for determining these as the three key validation criteria. This will enhance understanding of the criteria selection and strengthen the study's methodological transparency.

c. Delphi rounds (Subheading – Round 1 Evaluation and Shortlisting) : In the line “…with consensus threshold defined at ≥ 80% agreement and IQR ≤ 1,” I suggest elaborating on the tool, instrument, or method used to determine these thresholds. Providing this additional information would aid in further validating the standards used to analyze the findings.

3. Discussion (Literature comparison): While the approach is novel it is advisable to further support your findings by comparing them to existing or past research under discussion. The authors note that "the progress of its development is still in its nascent phase" and that the research "aligns with existing literature on EDQS in several ways." By citing relevant previous studies, the authors can strengthen their arguments, provide clearer context, and reinforce the credibility of their findings. Additionally, the statement "The research aligns with ongoing healthcare system enhancements" would benefit from further elaboration, highlighting how the study contributes to current advancements in the field.

4. Literature Review sources as the Foundation of the Validation Process: The literature review serves as a critical foundation for the development of the quality standards being validated. It has been noted that "these standards were compiled through a combination of literature review" and that "the EDQS subjected to validation were previously identified through a literature review." To strengthen this validation process, it is recommended to provide specific examples of previous research that informed the standards. This would not only support the process but also clarify the criteria for selection.

5. Formatting Adjustments: To improve the professional presentation of the manuscript, I suggest the following formatting adjustments:

a. Including line numbers would facilitate easier referencing for both the author and reviewer, and using "Page X of Y" for page numbering would enhance organization and navigation.

b. Additionally, please maintain font size consistency, as the font size under the subheading “Consensus Achievement” appears to decrease from 11 to 10 in the line referencing “workforce staffing and training subdomain.” Consistent font size will aid in readability.

c. It is recommended to rename the "Background" section to "Introduction" to more accurately reflect its content. The title "Introduction" better captures the broader elements discussed, such as research gaps, objectives, and global impact, as opposed to the historical context implied by "Background."

Reviewer #2: Abstract Is too long especially methodology and conclusion

Give more idea about previously Palestine's derived emergency department quality standards in introduction

Real Trauma quality standards have no space in this eDelphi survey which should have been priority

Better is results in place of findings.

103 quality standards specific to Palestinian EDs were too excess, should have evalusated less nimber , yield would have been more prosperous and cutting edge research.

You have done eDelphi survey, need to know what new learning from your survey is for the Palestine.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Response to Reviewers

Manuscript Title: Validating Quality Standards in Palestinian Emergency Departments: An e-Delphi Survey Approach

Manuscript ID: PONE-D-24-25666

Date: 27/11/2024

Dear Naeem Mubarak,

Academic Editor / PLOS ONE

Dear Reviewers,

We sincerely thank you for your time and constructive feedback, which has significantly enhanced the quality of our manuscript. Below, we provide detailed responses to each comment raised by the editor and reviewers. All revisions are highlighted (track changes) in the manuscript for your convenience.

Responses to Editorial Comments

Comment 1: PLOS ONE's style requirements.

Response: The manuscript has been revised to meet the PLOS style requirements.

Comment 2: Please include a complete copy of the PLOS questionnaire on inclusivity in global research in your revised manuscript.

Response: We have included the full text of the PLOS inclusivity questionnaire as Supporting Information (S1 Attachment) in the manuscript.

Comment 3: Please provide additional details regarding participant consent.

Response: Additional details have been added to the methods section under the subheading Delphi Panel Recruitment and Sample (Page 8). The study did not involve minors. These details have also been added to the “Ethics Statement” field of the submission form.

Comment 4: Please include captions for your Supporting Information files at the end of your manuscript and update any in-text citations accordingly.

Response: Captions for all Supporting Information files have been added to the end of the manuscript. Additionally, all in-text citations have been updated to match these files, ensuring consistency.

Comment 5: Please review your reference list to ensure that it is complete and correct.

Response: The reference list has been reviewed and confirmed to be complete and accurate.

Responses to Reviewer #1 Comments

Comment 1: Introduction – Elaboration on previous shortcomings in the literature.

Response: A paragraph has been added to the introduction on Page 5 / line 127, discussing conventional methods and the approach utilized in this study.

Comment 2: Methods – Delphi panel recruitment and sample.

Response: Measures to mitigate potential bias during Delphi rounds have been detailed under the Delphi Panel Recruitment and Sample section on Page 7 / line 168. Additionally, participants were allowed to complete the survey in stages using the Lime Survey platform to ensure thoughtful responses. Summarized the mitigation action as follows:

(Measures were taken at several stages to mitigate potential bias related to survey length. First, Previous efforts aimed to streamline standards by identifying appropriate ones for the Palestinian context through literature review and input from local experts, enhancing the clarity of the standards and aligning them with the study objectives. Second, Participants received clear instructions and guidance before starting the survey, including its purpose and estimated completion time. This transparency helped manage expectations and encouraged thoughtful responses. Additionally, reminders were sent during the survey period to encourage participation without exerting pressure, which could have compromised the quality of responses. Finally, the survey design through the Lime Survey platform allowed for completing the survey in several stages and not at the same time, as the participant can save the answers at the last point and complete it at another time if he feels bored, tired, or busy).

Comment 3: Methods – Readability, clarity, and comprehensiveness.

Response: A short paragraph is added within the methods section/study instrument/on page 8 / line 199.

Comment 4: Methods – Round 1 evaluation and shortlisting.

Response: The paragraph under Round 1 Evaluation and Shortlisting (Page 9 / line 219) has been rephrased, with added elaboration on the interquartile range (IQR).

Comment 5: Discussion – Literature comparison.

Response: The second paragraph of the discussion on (Page 14 / lines 331-340) has been rewritten to include a comparison with existing literature and explain the contribution of these criteria to ongoing improvements.

Comment 6: Literature Review – Examples of standards.

Response: Examples of standards from prior studies and literature have been included in the introduction on (Page 4/ lines 107 -118).

Comment 7: Formatting adjustments.

• Inclusion of line numbers: Resolved.

• Consistent page numbering format: Resolved.

• Renaming "Background" to "Introduction": Resolved.

Responses to Reviewer #2 Comments

Comment 1: The abstract is too long.

Response: The abstract has been shortened, particularly the methodology and conclusion sections.

Comment 2: Provide more details about Palestine's previously derived EDQS in the introduction.

Response: Additional details have been added on Page 7, Lines 138–149.

Comment 3: Trauma quality standards should have priority.

Response: These EDQS are comprehensive, covering all emergency services, including standards specific to trauma (e.g., equipment, resuscitation room, ACLS/BLS training). Details are provided in Appendix S 5.

Comment 4: 103 quality standards for Palestinian EDs are too many; fewer would be better.

Response: The final list comprises 100 validated EDQS. While comprehensive, the standards are divided into manageable domains, subdomains, and standards. Future research may explore their application to identify areas for consolidation.

We thank the reviewers and editor again for their valuable comments. Please do not hesitate to contact me if further clarification is needed. We look forward to your feedback.

Sincerely,

Abed Alra'oof Bani Odeh

UCT – PhD candidate

27/11/2024

Attachments
Attachment
Submitted filename: Response to reviewers.DOCX
Decision Letter - Naeem Mubarak, Editor

Validating quality standards in Palestinian emergency departments: an e-Delphi survey approach

PONE-D-24-25666R1

Dear Dr. Abed Alra'oof Saleem Bani Odeh,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Naeem Mubarak, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

The authors have convincingly addressed all the comments. No further changes are needed. Best of luck with your publication

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: All the comments have been addressed by the authors, and I have no further suggestions to make. The modifications introduced are commendable, as they enhance clarity, address prior limitations, and provide thorough elaboration while acknowledging previous findings. The authors have demonstrated significant dedication to addressing feedback, particularly in advancing the objective of validating Emergency Department Quality Standards (EDQS) in Palestine using a unique approach.

Reviewer #2: The comments have been responded well to reach standard of worth of Publishing in PLOS One. The study is going to improve quality standards in Palestinian emergency departments

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Imtiaz Wani

**********

Formally Accepted
Acceptance Letter - Naeem Mubarak, Editor

PONE-D-24-25666R1

PLOS ONE

Dear Dr. Bani Odeh,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr Naeem Mubarak

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .