Peer Review History
| Original SubmissionJune 10, 2021 |
|---|
|
PONE-D-21-19080 Individual and Contextual Factors affect the Implementation Fidelity of Youth-Friendly Services, northwest Ethiopia: a Multilevel Analysis PLOS ONE Dear Dr. Yohannes Ayanaw Habitu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Sep 26 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Limakatso Lebina, MBChB Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section. 3. Thank you for stating the following financial disclosure: This research was conducted as an academic research contribution. The University of Gondar covered the costs for the data collection procedures. Otherwise, the authors received no specific funding for this work. Please state what role the funders took in the study. If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." If this statement is not correct you must amend it as needed. Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf. Additional Editor Comments: Thank you for submitting this interesting assessment of fidelity on the implementation of youth services. The major comments on this manuscript are on the method section as indicated by the two reviewers. It is great that you utilised a tool that has been recommended by WHO to assessment tool. However, in the analysis and interoperation of the results you did not follow those guidelines (according to ref 36) - WHO: Quality Assessment Guidebook. A guide to assessing health services for adolescent clients. 2009. Please explain in the methods section why you did not follow these guidelines on data analysis and interpretation. For example you utilised 60% as a good level of fidelity based on a different article instead of the quality assessment guidebook recommendations. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: I Don't Know ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This is a very interesting and important piece of work so well done for putting in the effort. There is however room for improvement and clarification needed particularly in the methodology section. My concerns are as follows; Line 87-89: Under your rationale you mention that the undertaking of the study would uncover evidences related to IFidelity of the program. In what way would that happen? what evidences are you talking about? Line 100-101; Reword the section, make it clear that you were assessing determinants on two levels; individual & program level and be consistent throughout the paper. My understanding is that characteristic of program and provider information fall under "Program level" please be clear. You mention the assessment of readiness and competencies as well in your methodology, how do these tie in with your objectives. It seems to me you are dealing with too many constructs. Line 118-120: Please clarify how you got from the 8 Health centres to 11 health centres. This comment is tied in with your sampling procedure. My suggestion is you reword it in a logical sequence so one is clear how you got to the 11 centers. Calrify also what is "lottery method?" is this the same as random sampling? You have too many variables, i suggest you categories into the two levels you are assessing and be consistent. Line 393, this section on determinants of IF sounds like it should go into the analysis section. Check your tenses and grammar under your results. The discussion is clear and well written. All the best with your revisions. Reviewer #2: Review (Manuscript: PONE-D-21-19080) August 05, 2021 This is a good paper for the field of implementation science. Youth-friendly service programs (YFS) are a fantastic way to link and retain youth in care services. Given the broad implementation of the YFS program in parts of Ethiopia (as noted by the authors), this research is necessary to the field. Overall, the approach to assessing fidelity I also think is valuable. However, there were some points in the manuscript that confused me as a reader. To use the Carroll et al. (2007) study you cited, implementation fidelity is focused on the degree to which an intervention is delivered as intended. In my view, an evaluation of implementation will be focused on the health facility and the providers. This is not to say that clients (i.e., youth, adolescents, etc.) cannot evaluate fidelity, but that their role in measuring the success of the intervention is different. And this is where I came off confused. You, the authors, are looking at the fidelity of implementation, and your focus appears to be clients, those youth who seek care services from the facilities in Gondar, Ethiopia. And you don’t do a good job explaining why this became your target population. Typically, the clients (i.e., youth) will be used to assess adherence to the intervention. Then, for example, a high adherence becomes an indicator of the success of implementation. See below for more specific comments about different sections of the manuscript. Introduction Line 78, I think you meant to write fidelity of implementation and not “fidelity f implementation” I may be misunderstanding the manuscript, but why is the question of fidelity being posed to youth? Who is the target population? Fidelity would seem to be an issue for the program implementers and providers. The providers and program implementation team would be the ones to assess whether providers delivered YFS as it was designed. The question for the youth would be one of adherence. The success of YFS for youth would be whether they came for services and continued to come for services for the length of the program can be given a better assessment of w Methods The section on instrument development is a bit long, with considerable repetition. For example, you mention that aspects of the final instrument were adapted from the WHO standard on Line 163 and 216. Consider shortening this section, given that you are interested in one component of the instrument, which is fidelity. It would help if you also considered writing a manuscript on the instrument development or the study protocol. The development of the instrument is itself an interesting process with worthwhile contributions to the literature. What are some examples of questions used in the fidelity component of the instrument? It is not clear why the study (or the part of the study reported in this manuscript) has both youth and providers as the study population. Specifically, was the instrument given to providers the same as the instrument given to the youth participants? Why is that? Providers would have a different perspective on issues around fidelity; I would expect you to look to capture those differences. And again, if it is the fidelity of implementation, why do you need the perspective of the youth. I don’t imagine that the youth, who are clients of these health care facilities, would have a significant say in how a program is implemented. Or at least they would have a lesser say compared to providers. How was fidelity understood and defined by the authors? Reading the manuscript, I feel you assume your readers have the same understanding of fidelity as you do. For example, in the methods the items used to capture fidelity, what domains do they cover. You mention that it is based on an existing instrument used by the WHO. But what aspects/constructs of fidelity does it cover? Results You report youth and health care providers together in Table 01; should that not be separated? The factors that impact providers when it comes to the question of fidelity I imagine, are distinct. Table 02 and Table 03 cover issues that are not discussed in the methods section. That is level of youth engagement and facility-level factors are not evident in the methods. For table 02, in particular, what is meant by the level of engagement? Table 02 could be made more clear if you categorized the engagement levels. When I reference Table 05, it is clear that the levels of engagement form part of the independent variables in your multi-level model. So, for example, if model II was adjusted for individual-level variables, then have Table 02 show this so that your readers can better connect Table 02 and Table 05. Consider shortening the Items/ variable names in Tables 02, 03, and 05; it makes the tables clunky and challenging to read. Discussion Is there a reason you reference implementation in education and not the implementation in health care to support your point here? It is not wrong, but I think your argument would be stronger if you found implementation studies in the health sector and the sexual health field specifically to support notions of fidelity of implementation (Lines 512 - 514). So, what are the practice implications of your study findings? YFS programs are demonstrated in the literature to be effective and successful ( I think several clinical studies bear this out). The question then is the state of fidelity of implementation in Gandor, Ethiopia, and more importantly, what would the iteration and scale-up of YFS programs in Ethiopia look like, given your analysis data? I think this should be a significant focus of your discussion. Ethiopia has already begun implementing YFS programs, so what will need to change to enhance fidelity in light of the results? Limitation You may wish to say a bit more regarding the limitations of the study. What do the survey items on fidelity leave out when it comes to understanding implementation? ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.
|
| Revision 1 |
|
Individual and Contextual Factors affect the Implementation Fidelity of Youth-Friendly Services, northwest Ethiopia: a Multilevel Analysis PONE-D-21-19080R1 Dear Dr. Yohannes Ayanaw Habitu We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Limakatso Lebina, MBChB, Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-21-19080R1 Individual and Contextual Factors affect the Implementation Fidelity of Youth-Friendly Services, northwest Ethiopia: a Multilevel Analysis Dear Dr. Habitu: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Limakatso Lebina Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .