Peer Review History
| Original SubmissionMay 28, 2019 |
|---|
|
PONE-D-19-15140 Effectiveness of Participatory Community Solutions Strategy on Improving Household and Provider Health Care Behaviors and Practices: A Mixed Method Evaluation PLOS ONE Dear Mr Tiruneh, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. I found your article of great interest and commend you for the important work you are doing in Ethiopia. In order to avoid further delay, I have made the decision of Major Revision based on one external reviewer and my own assessment of the manuscript. In addition to Reviewer #1’s comments, please see my additional comments below. We would appreciate receiving your revised manuscript by Oct 03 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Emily A Hurley, M.P.H., Ph.D. Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. Data availability. Please note that authors should not be the sole named individuals responsible for ensuring data access. If these data cannot be publicly deposited or included in the supporting information, e.g. due to patient privacy, legal reasons, or being provided by a third party, please explain why and explain how researchers may access them via a named data access committee or named ethics committee. 3. Please specify in your financial disclosure whether the funders played any role in the study. This information should be included in your cover letter; we will change the online submission form on your behalf. 4. Please specify whether an interview guide was used to interview the participants in your study. If yes, please describe and/or include a copy as a Supporting Information file. 5. Please include additional information regarding the survey used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information. 6. Please carefully proof read your manuscript. For example, there is a missing space in the abstract “…November 2017.Propensity scores…”. 7. Please amend your current ethics statement to address the following concerns: a) Did participants provide their written or verbal informed consent to participate in this study? b) If consent was verbal, please explain: i) Why was written consent not obtained? ii) How did you record/document participant consent? iii) Did the ethics committees/IRBs approve this consent procedure? 8. Thank you for stating the following in the Competing Interests section: "The authors have declared that no competing interests exist." We note that one or more of the authors are employed by a commercial company: JSI Research & Training Institute, Inc a. Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form. Please also include the following statement within your amended Funding Statement. “The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.” If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement. b. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc. Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. c. Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf. Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests 9. Thank you for including your ethics statement: "Ethical clearances for the surveys were obtained from the ethical review boards of Amhara, Oromia, SNNP, Tigray Regional Health Bureaus, and JSI. All the study participants were informed about the purpose of the study; benefits and hazards of the study were explained to all study participants, and each participant was notified of their right to opt out when responding to questions. Consent was sought before conducting any interviews. Moreover, the information obtained from the research participants were kept in private (codes were used during reporting of the IDI quotes)." a. Please amend your current ethics statement to confirm that your named institutional review board or ethics committee specifically approved this study. b. Once you have amended this/these statement(s) in the Methods section of the manuscript, please add the same text to the “Ethics Statement” field of the submission form (via “Edit Submission”). For additional information about PLOS ONE ethical requirements for human subjects research, please refer to http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research. 10. We note that you have included the phrase “data not shown” in your manuscript. Unfortunately, this does not meet our data sharing requirements. PLOS does not permit references to inaccessible data. We require that authors provide all relevant data within the paper, Supporting Information files, or in an acceptable, public repository. Please add a citation to support this phrase or upload the data that corresponds with these findings to a stable repository (such as Figshare or Dryad) and provide and URLs, DOIs, or accession numbers that may be used to access these data. Or, if the data are not a core part of the research being presented in your study, we ask that you remove the phrase that refers to these data. 11. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. Additional Editor Comments (if provided): I commend the authors for this important work and hope they can sufficiently address the comments from myself and Reviewer #1. Major Comments: The qualitative results are difficult to interpret given the lack of detail about the methods of data collection and analysis. Please give more detail about the qualitative portion of the study, referring to PLOS ONE guidelines below: Qualitative research studies should be reported in accordance to the Consolidated criteria for reporting qualitative research (COREQ) checklist. Further reporting guidelines can be found in the Equator Network's Guidelines for reporting qualitative research The qualitative section “improved service utilization and qualitative of care” does not seem to add much to the overall study. What value does perceived effectiveness add if there is quantitative data to more objectively assess effectiveness? How do we know the answers of the WDA to their funders were not influenced by social desirability bias? I agree with Reviewer #1’s comment about the multiple outcomes. Was there a primary outcome that was chosen prior to the trail as the indicator of intervention success, or one that the intervention was most focused on achieving? Or, among the many indicators, was there any statistical adjustment for multiple outcomes? The literature review could be more robust, especially when referencing evidenced-based intervention (e.g. kangaroo care), please take care to add appropriate citations. Minor Comments: Abstract Please edit for grammar: line 21 “We evaluated the effects of this strategy using a mixed methods research” and again in line 80 (take out “a” or rephrase to: “a mixed-methods research strategy) Line 25 A general reader would not know what is meant by “kebeles”. Please define or reword Intro Grammar: line 45 “there is high fall out rates” Table 2 Readiness to perform signal functions - Please indicate if the “availability of…” indicators use a dichotomous (yes/no) response, or if there is some other measure of levels of availability Lines 238-248: Please justify your choice of these variables as potential confounders, and if appropriate add references Please justify with a reference or other explanation the choice of a 0.2 p-value for the logit stepwise backward selection Line numbers stop on page 31. There appears to be a missing quotation in the middle of page 34 Middle of page 36: Please give some more detail about the “previous study in Ethiopia” and how the results of the present study align with it. Middle of page 38: “synthesized to unpack” sounds contradictory Throughout: Recommend italicizing “woreda” and other local terms Be consistent in capitalization for Family Conversation and Birth Notification [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: I commend the authors on synthesising results of this important evaluation of a complex intervention strategy in multiple regions of Ethiopia. I wish to offer the following substantive and minor comments. Substantive comments: 1. This is an evaluation of a complex intervention with multiple components. It would be helpful to include a table with all intervention components, their timeframes and geographical coverage in the methods section. 2. Strengthen and move qualitative sections: In this article, the qualitative sections are used to: (a) help describe the interventions; (b) highlight barriers and facilitators to implementation; and (c) derive lessons for future implementation. Unfortunately all this is done without presenting any actual qualitative data. I would recommend simplifying this and using a table or diagramme to present the content of interventions (the innovation and implementation mechanisms, line 287 onwards) and removing the sections where qualitative data on intervention implementation are summarised. I would also recommend condensing sections on lessons learned or providing data to support the statements made there. The most valuable use of the qualitative data is in the section on barriers and facilitators. This can be strengthened through the use of quotes and reporting of discrepant cases, otherwise they is no actual qualitative analysis, just a brief summary of views from programme insiders. Consider moving remaining qualitative sections (barriers and facilitators) after the DID results so they help explain your results. If you do not feel like you can do the above, I would recommend publishing the qualitative analysis in a separate article where you can really do it justice. Finally, I would remove the reference to themes 'emerging' from the data as it seems that data were mostly coded in response to the research questions. 3. Background - You could state what the quantitative research questions were/was, for balance. At the moment you also list the qualitative questions. 4. Was the impact evaluation registered? If so where is this registration number? 5. The quantitative impact evaluation has multiple outcomes, was there an a priori data analysis plan, and was any adjustment made for multiple hypothesis testing? 7. Abstract and Results - Your data do not support that "receiving early antenatal care between baseline and follow-up surveys in the intervention area is attributable to the strategy" because the confidence interval includes 0, i.e. the possibility of no effect. This needs to be removed. 8. Discussion - the main reason for lack of effect on most MNCH indicators aside from skilled care at birth and receipt of PNC for mother and baby was the minimal intervention duration time. Does anything else explain the results? 9. Discussion - A key limitation of the qualitative work is the lack of sampling community members not linked to the project, i.e. non-project-based staff, HEWs or HDAs. Is there a reason why you did not speak with mothers about their views of what changed and what did not? 10. For your consideration - I would avoid the use of the term 'innovations' - community interventions like family conversations and facility or health systems-levels interventions like QI or PDSA cycles are not really 'innovations'. They may be in this context, but there is a long history of their use in multiple contexts. The donor-favoured term 'innovation' is a little tiring; can we just call an intervention an intervention? 11. Conflict of interest: the senior author of this article is from the Gates Foundation, which also funded the writing of this article and, critically, the interventions being evaluated. The role of Foundation-paid staff in writing up/editing results from their own projects needs to be explained or declared more clearly as a conflict of interest. Please see recent demands for transparency in such situations: https://gh.bmj.com/content/4/3/e001746 I wish you good luck for the revisions and commend you on such hard and important work. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-19-15140R1 Effectiveness of Participatory Community Solutions Strategy on Improving Household and Provider Health Care Behaviors and Practices: A Mixed-Method Evaluation PLOS ONE Dear Mr Tiruneh, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. ============================== We apologize for the delay in returning this. I could not identify additional reviewers for this round, but have reviewed your work and provided my own review. Thank you for taking the time to carefully address the comments on the original submission. I do think this version is much improved, but do ask that you attend to the editorial comments below. ============================== We would appreciate receiving your revised manuscript by Jan 11 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Emily A Hurley, M.P.H., Ph.D. Academic Editor PLOS ONE Additional Editor Comments (if provided): Intro Third line- “being” can be deleted, can be simply “care provided” First line of second paragraph: specify what “it” is Last paragraph of the intro could be improved. In the line proceeding, you indicate that the study was mixed-methods, and then only describe the qualitative component in the next paragraph. Be clear as if you are presenting results from the quantitative sections or not. If so, state the overall objective of the mixed-methods study as well as the quantitative and qualitive sections. Methods More detail on the qualitative analysis methods are needed. I once again recommend the COREQ checklist to ensure you report on all the necessary criteria for qualitative studies, particularly the data analysis section. How many coders? How were themes derived? What did the coding tree entail? (etc..) Results The first sentence of this section needs editing, as the results are not longer presented in four sections. It does seem like with so many different statistical tests, adjusting the p-value for multiple comparisons is warranted, particularly when the authors place so much emphasis on the 0.05 value as a cut-off for significance. Please adjust for these multiple comparisons or provide more detail as to why this is not necessary in your current study. For the qualitative quotes please cut the participant identifiers (e.g. HDA33235) or explain their significance. As they stand now they are difficult to interpret. Please edit this section for grammar as well e.g. there is a sentence fragment “participants in Amhara (IDI11413)” after the first quote of the “enhanced the knowledge and skills of health workers” section. There are also many references to “participants” as plural after quotes- were all of these quotes said by more than one person? Discussion There are still a number of typos. Please proofread carefully (e.g. “chanege" should be “change” in 5th paragraph of discussion) Please define “support system” as you refer to it in this section. From the paragraph, it looks like you are referring to a strong network of implementing partners, but please be specific, as “support system” could take many different meanings. [Note: HTML markup is below. Please do not edit.] [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Effectiveness of Participatory Community Solutions Strategy on Improving Household and Provider Health Care Behaviors and Practices: A Mixed-Method Evaluation PONE-D-19-15140R2 Dear Dr. Tiruneh, We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements. Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication. Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. With kind regards, Emily A Hurley, M.P.H., Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-19-15140R2 Effectiveness of Participatory Community Solutions Strategy on Improving Household and Provider Health Care Behaviors and Practices: A Mixed-Method Evaluation Dear Dr. Tiruneh: I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. For any other questions or concerns, please email plosone@plos.org. Thank you for submitting your work to PLOS ONE. With kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Emily A Hurley Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .