Peer Review History

Original SubmissionOctober 11, 2023
Decision Letter - Olushayo Oluseun Olu, Editor

PONE-D-23-32934A community-engaged approach to assess climate resilience and disaster priorities: Survey results and evaluationPLOS ONE

Dear Dr. Errett,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 27 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Olushayo Oluseun Olu

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This study used a modified CDC CASPER approach and conducted evaluations of the approaches. The results, discussion, and conclusion section of the manuscript are well written, and the findings are important to academics and practitioners. The introduction needs to be improved as the rationale of the study needs to be expanded. The structure of the introduction is also disjointed. I would also add more details on the results section about the resources needed for the CASPER/SASPER.

Introduction:

• Remove the comma that comes after Participatory

“Participatory, community-centered research can help demonstrate the disproportionate impacts of climate change on low-income populations, people of color, older adults, people living unhoused, and other groups that have been marginalized.”

• A paragraph introducing CASPER is needed in the introduction. In this paragraph, I would also include the rationale for using CASPER as a starting point to assess climate resilience. I would also expand on the rationale of using the SASPER.

• The introduction could be improved significantly to frame the objectives of the manuscript better, and most importantly, to provide more context about the rationale of the study. I would recommend providing more depth to the rationale of the research. The authors identify some of the advantages of the co-production of climate knowledge and bottom-up approaches in the energy sector. I would recommend expanding on this to provide a more robust rationale for the study.

• The transition to the “Setting” section seems disjointed from the introduction. I would recommend embedding the setting of the study early on in the introduction as a way to improve the rationale of the study.

• I would also provide information on the possible scalability/replicability (or not) of the tool in other contexts.

Methodology

• The first sentence of the overview is a bit hard to read. I suggest to break this in two sentences. One with the collaborating institutions, and another with the aims.

• In the sentence below, from the community partner section, the word “level” seems to be misplaced. Also, the citation is after the period and should be moved.

“To promote research reciprocity, improve transparency, level real or perceived power differentials, and build trust, we grounded our work in a written community partnership agreement.[27]”

• I would include the nine languages the instruments were translated to. Also, I suggest including a statement about how translations were made to ensure that the meaning of the surveys was not lost (e.g., translated by members of the study team, or official translating services).

• I would provide the number of surveys done with SASPER volunteers in the main text and not only in the figure.

Results

• I would also suggest including how many surveys were completed in each language (English=X, Spanish=Y, etc.).

• There are several mentions of the approach being resource and labor-intensive. It would benefit readers and those who wish to implement the tool, if the authors could provide more detail on the required resources.

• I would reword the volunteer experience section of the results to more accurately represent the findings. The study did not use measures to assess whether volunteers developed skills or achieved any learning outcomes. If this results are based on the interviews, phrases such as the one below should be modified to say that participants perceived an improvement in those skills.

“Youth volunteers developed new interpersonal and public speaking skills, learned about public health and research methods”

Reviewer #2: The paper is well written and demonstrates an objective and comprehensive evaluation of the process undertaken. It is technically sound having applied sound qualitative analysis on the users descriptive experience of the application of an adopted form of the research tool. From a readers perspective, the paper content (particularly the description of the findings and discussion section) is predominantly focused on this in-depth evaluation of the process rather than the results of the survey (i.e. the qualitative aspect). A suggestion to the authors would be to consider changing the title to reflect that. For example, Evaluation of a community assessment tool used to assess……..and survey results. A summary of recommendations in bullet form might also be useful.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

We very much appreciate the thoughtful critique of our manuscript previously titled, “A community-engaged approach to assess climate resilience and disaster priorities: Survey results and evaluation”, which we have now titled, “Evaluating an equity-focused approach to assess climate resilience and disaster priorities through a community survey” in response to Reviewer comments. Below we respond to each of the Reviewers’ comments raised in the December 13th, 2023 email correspondence. Reviewer comments are provided in italics and are followed by itemized responses. Please note every response is linked to a page and line demarcation in the revised manuscript submission.

Journal Requirements:

1. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Thank you for providing these references. We have confirmed that our revised manuscript complies with PLOS ONE’s style requirements, as outlined in the documents provided.

2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

We have reviewed our reference list for completeness and accuracy. As part of the revisions requested by the Reviewers, we have added the following additional references:

1. Cascadia Consulting Group. Seattle Climate Vulnerability Assessment. Seattle Office of Planning & Community Development; 2023 Jun. Available: https://seattle.gov/documents/departments/opcd/seattleplan/seattleclimatevulnerabilityassessmentjuly2023.pdf

2. Murti M, Bayleyegn T, Stanbury M, Flanders WD, Yard E, Nyaku M, et al. Household emergency preparedness by housing type from a community assessment for public health emergency response (CASPER), Michigan. Disaster Med Public Health Prep. 2014;8: 12–19.

3. Ferguson RW, Kiernan S, Spannhake EW, Schwartz B. Evaluating Perceived Emergency Preparedness and Household Preparedness Behaviors: Results from a CASPER Survey in Fairfax, Virginia. Disaster Med Public Health Prep. 2020;14: 222–228.

Reviewers' comments:

Reviewer #1:

1. This study used a modified CDC CASPER approach and conducted evaluations of the approaches. The results, discussion, and conclusion section of the manuscript are well written, and the findings are important to academics and practitioners. The introduction needs to be improved as the rationale of the study needs to be expanded. The structure of the introduction is also disjointed. I would also add more details on the results section about the resources needed for the CASPER/SASPER.

We thank Reviewer #1 for their thorough and overall positive review of the manuscript, and agree that the findings presented in the manuscript are of interest to both academics and practitioners. We appreciate Reviewer #1’s suggestions to improve the Introduction section of the manuscript, and have added additional text to this section to describe the study rationale and setting (see items #4 and #5 below) and to provide an overview of the CASPER process (see item #3). We have also added a description of the resources required to conduct the SASPER to the Discussion section (see item #12 below).

Introduction:

2. Remove the comma that comes after Participatory

“Participatory, community-centered research can help demonstrate the disproportionate impacts of climate change on low-income populations, people of color, older adults, people living unhoused, and other groups that have been marginalized.”

We agree with Reviewer #1’s suggestion to remove the comma in the above sentence, and have done so in the revised manuscript (page 5, line 116).

3. A paragraph introducing CASPER is needed in the introduction. In this paragraph, I would also include the rationale for using CASPER as a starting point to assess climate resilience. I would also expand on the rationale of using the SASPER.

We thank Reviewer #1 for their suggestion to include an overview of the CASPER method in the Introduction. We have added a paragraph that provides an overview of CASPER and its previous use in pre-disaster contexts to this section, to clarify the rationale for choosing this method for our project. We have also clarified in this paragraph that the SASPER approach employed the CASPER method, with several additional steps to ensure the project centered community voice and equity (page 6, lines 142-157).

4. The introduction could be improved significantly to frame the objectives of the manuscript better, and most importantly, to provide more context about the rationale of the study. I would recommend providing more depth to the rationale of the research. The authors identify some of the advantages of the co-production of climate knowledge and bottom-up approaches in the energy sector. I would recommend expanding on this to provide a more robust rationale for the study.

We appreciate Reviewer #1’s comment that we could improve our framing of the study’s objectives and rationale in the Introduction section of the manuscript. To better clarify the objectives and rationale, we have added text describing the pre-existing network of community partnerships in the Duwamish Valley to support successful community-engaged research, the purpose of newly established Duwamish Valley Resilience District, and that our study intends to complement and inform the efforts of the Duwamish Valley Resilience District (pages 5-6, lines 131-145). We have also included text describing the limited prior evaluations of the CASPER method, and the lack of evidence exploring how community-engaged approaches can foster community partnerships and advance research on climate health impacts, as rationale for conducting an evaluation of our chosen survey approach (pages 6-7, lines 159-176).

5. The transition to the “Setting” section seems disjointed from the introduction. I would recommend embedding the setting of the study early on in the introduction as a way to improve the rationale of the study.

We agree with Reviewer #1 that the details originally provided in the Setting section of the manuscript are important to help readers understand the rationale for our study. We have now embedded this section at the beginning of the Introduction section (pages 3-4, lines 73-99).

6. I would also provide information on the possible scalability/replicability (or not) of the tool in other contexts.

We appreciate Reviewer #1’s suggestion to add commentary on the replicability and scalability of the CASPER approach. We have added text in the Introduction that clarifies that CASPER has been replicated in other contexts (page 6, lines 149-155). We have also added comments in the Discussion section that discuss how the resource-intensiveness of our adapted CASPER approach may limit its scalability and replicability as a tool for conducting community-engaged research (page 34, lines 943-946).

Methodology

7. The first sentence of the overview is a bit hard to read. I suggest to break this in two sentences. One with the collaborating institutions, and another with the aims.

We appreciate Reviewer #1’s suggestion to break apart this sentence, and agree that separating the collaborating institutions and the aims into separate sentences improves clarity. The sentences now read, “Building on long-standing community partnerships, the SASPER project is a collaborative effort between the University of Washington, the City of Seattle, the Duwamish River Community Coalition and the organization’s Duwamish Valley Youth Corps, the Washington State Department of Health, and Public Health–Seattle & King County. The project aims to assess household- and community-level climate change and health impacts, access to and needs for information and resources to promote resilience, and pathways for community input into ongoing climate change adaptation planning. In addition, it aims to evaluate the CDC’s CASPER method, as well as the modifications to this method that sought to center equity and community in the process.” (pages 7-8, lines 190-292).

8. In the sentence below, from the community partner section, the word “level” seems to be misplaced. Also, the citation is after the period and should be moved.

“To promote research reciprocity, improve transparency, level real or perceived power differentials, and build trust, we grounded our work in a written community partnership agreement.[27]”

We agree with Reviewer #1 that the meaning of the word “level” is unclear in this sentence. We have replaced it with the word “balance”, which more clearly communicates the intended meaning. We also thank Reviewer #1 for pointing out that our citation was misplaced, and have moved it before the period (page 8, line 297)

9. I would include the nine languages the instruments were translated to. Also, I suggest including a statement about how translations were made to ensure that the meaning of the surveys was not lost (e.g., translated by members of the study team, or official translating services).

We agree with Reviewer #1’s comment that we should list the languages that the survey instrument was translated into, and have now listed all the languages in the text . We have also clarified the wording slightly, to make it clear that the nine languages the survey was offered in includes English (page 10, lines 430-432). We have also added text to clarify that a professional translation service was used to ensure the accuracy and clarity of translated surveys (page 10, line 430).

10. I would provide the number of surveys done with SASPER volunteers in the main text and not only in the figure.

We thank Reviewer #1 for pointing out that we should also include the number of volunteer feedback surveys we collected in the manuscript text. We have now provided this information at the beginning of the Feedback Survey section under Results (page 21, lines 629).

Results

11. I would also suggest including how many surveys were completed in each language (English=X, Spanish=Y, etc.).

We agree with Reviewer #1 that we should provide a breakdown of the languages in which the paper surveys were completed. We have added text reporting this breakdown in the SASPER Survey section under Results (page 16, lines 576-578).

12. There are several mentions of the approach being resource and labor-intensive. It would benefit readers and those who wish to implement the tool, if the authors could provide more detail on the required resources.

We thank Reviewer #1 for their suggestion to include more details about the resources required to design and implement the SASPER project, and agree that this information will benefit readers. We have added several sentences to the Discussion section that describe the grant funds, in-kind donations, and volunteer hours that supported the project (pages 34, lines 923-935).

13. I would reword the volunteer experience section of the results to more accurately represent the findings. The study did not use measures to assess whether volunteers developed skills or achieved any learning outcomes. If this results are based on the interviews, phrases such as the one below should be modified to say that participants perceived an improvement in those skills.

“Youth volunteers developed new interpersonal and public speaking skills, learned about public health and research methods”

We appreciate Reviewer #1’s comment that the sentence above should be modified to clarify that we are reporting the results of evaluation interviews. We have added text to the beginning of this sentence to clarify this; the sentence now reads, “Interviewees with insight into the experiences of the youth volunteers described how they had developed new interpersonal and public speaking skills, learned about public health and research methods, and built confidence by being part of the broader project effort related to community priorities” (page 27, lines 753-756).

Reviewer #2:

1. The paper is well written and demonstrates an objective and comprehensive evaluation of the process undertaken. It is technically sound having applied sound qualitative analysis on the users descriptive experience of the application of an adopted form of the research tool. From a readers perspective, the paper content (particularly the description of the findings and discussion section) is predominantly focused on this in-depth evaluation of the process rather than the results of the survey (i.e. the qualitative aspect). A suggestion to the authors would be to consider changing the title to reflect that. For example, Evaluation of a community assessment tool used to assess……..and survey results.

We greatly appreciate Reviewer #2’s thoughtful review of and positive feedback on our manuscript. We agree that the original title did not align with the manuscript’s predominant focus on the evaluation. We have updated the title to “Evaluating an equity-focused approach to assess climate resilience and disaster priorities through a community survey” in order to better reflect the manuscript’s content.

2. A summary of recommendations in bullet form might also be useful.

We thank Reviewer #2 for their comment. We have included a summary of the specific process recommendations provided by interviewees who participated in the evaluation in Table 2 (pages 24-25). We welcome additional suggestions from Reviewer #2 about how to present the recommendations in the format that is most useful for readers.

Attachments
Attachment
Submitted filename: Response to Reviewers_updated.docx
Decision Letter - Olushayo Oluseun Olu, Editor

Evaluating an equity-focused approach to assess climate resilience and disaster priorities through a community survey

PONE-D-23-32934R1

Dear Dr. Errett,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Olushayo Oluseun Olu

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .