Peer Review History
Original SubmissionNovember 26, 2019 |
---|
PONE-D-19-32194 IMARA: A mother-daughter group randomized controlled trial to reduce sexually transmitted infections in Black/African-American adolescents PLOS ONE Dear Dr. Donenberg, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. You will see that the Referees found your work of some interest. However, they also raised major criticisms. Please respond to all the comments by Reviewers, with special attention to methodological points raised by Reviewer #3. We would appreciate receiving your revised manuscript by April 30 2020. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Giuseppe Vittorio De Socio, MD, PhD Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. We note that you have reported significance probabilities of 0 in places. Since p=0 is not strictly possible, please correct this to a more appropriate limit, eg 'p<0.0001'. 3. Thank you for submitting your clinical trial to PLOS ONE and for providing the name of the registry and the registration number. The information in the registry entry suggests that your trial was registered after patient recruitment began. PLOS ONE strongly encourages authors to register all trials before recruiting the first participant in a study. As per the journal’s editorial policy, please include in the Methods section of your paper: i) your reasons for your delay in registering this study (after enrolment of participants started); ii) confirmation that all related trials are registered by stating: “The authors confirm that all ongoing and related trials for this drug/intervention are registered”. Please also ensure you report the date at which the ethics committee approved the study as well as the complete date range for patient recruitment and follow-up in the Methods section of your manuscript. 4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Partly Reviewer #3: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: Yes Reviewer #3: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The authors conducted a randomized controlled trial to reduce sexually transmitted infections in Black/African –American adolescents. I found the paper to be written well with a clear logical flow and tight focus. However, I have identified minor concerns that the authors should work on. Methods Line 97-99,page 5 Why was the mental health clinic targeted for the initial enrollments? Why this sampling strategy? This may suggest that the study team was more interested in a vulnerable population who definitely may have relational issues with their mothers/caretakers. This could potentially bias the effect of the intervention making it appear positive when it is not. Are you able to describe what mental health problems they had to assure the readers that this would not bias your findings? Line 113, page 6 What do you mean by dyads learned their group assignment after the baseline assessment....? Make this sentence clear to the reader. It is not clear whether the curricular used were hard copies or soft copies on tablets etc. Relatedly, the inclusion criteria ....spoke English.... do the interventions need one to speak English only without reading? Did you do any language proficiency testing for these adolescents? Line 141, noted rationale for not doing HIV testing but given the strong association between HIV transmission and STIs; at the subset of adolescents that had STIs at 12 months should have received HIV screening. Are the authors able to get this data and include it? may be from a related program etc Line 143-144,page 7 consistent with Illinois law, expedited partner therapy was offered. Please provide a citation or describe what procedures are done to ensure partner was offered therapy. Also make clear for how long treatment for the STIs was? Line 164, add a citation in support of this information. Line 165-166, page 8- was this work re acceptability and feasibility published?if yes provide a citation. Line 180 Mothers and daughters separately review..... is this referring to the mother and daughter dyad? please make clear Line 203 - .... and they did not receive condom skills training. I find this quite surprising in this day and age. Line 205 refers to a 10 minute video demonstrating condom use. How different is the content of this video and the condom skills training? Please clarify IMARA Fidelity Noted facilitators rated their adherence to curricular activities. What was fidelity based on the directors report? Results Did the STI risk differ with type of caregiver? Lines 275-279- State the reasons for non attendance as they may be related to the intervention thus affecting feasibility. Describe what STIs were identified at baseline and at 12 months. Do they differ? Were there any negative outcomes from the intervention e.g caretaker violence, depression, daughter withdrawal etc Discussion Line 312 Describe what you mean by advance previous research? may need to reword Line 314, describe the short term effects and non behavioral outcomes. How do they differ from what the IMARA intervention resulted into? Line 339- treatment outcomes - clarify which treatment (IMARA or the STI treatment) Line 360.... in IMARA were more likely to be tested and treated during the 12 months following intervention. This introduces surveillance bias. Can the authors describe how this bias was overcome as it affects the main study outcome. References- Have the citations in brackets as per PLOSONE reference style. Reviewer #2: This paper presents the results of a randomized controlled trial that evaluates an intervention for African-American teenage girls and their mothers/caretakers. The strengths of the research include a clearly described intervention (and control), good number of study participants, with excellent follow-up rates. This much have been a very challenging study to set up, conduct and implement. The limitations of the study include apparently contradictory findings in crude vs. adjusted analysis, and limited information on any outcome other than STI rate itself. Specific comments follow. Overall. The introduction is good. A line or two could be added to describe the potential “mechanisms” by which this intervention might reduce STIs – would it be due to less sex, increased condom use, or lower risk partners? Can the authors include the specific trial number for clinicaltrials.gov? Could be helpful to understand how much participants were paid to attend the workshops, to help understand its feasibility outside of a research study. It would be helpful to know what diagnostic test kit was used to test for chlamydia, gonorrhea and trichomonas (and whether there could be false positives). Results – Can the authors present which specific infections were actually diagnosed – did this intervention reduce chlamydia and gonorrhea and trichomonas? – or was most of the effect related to trichomonas? Were there any questions about self-reported STIs diagnosed outside of the study between baseline and follow-up? Or questions about possible mediators such as self-reported sexual behavior at 12-month followup? Or mother-daughter discussions about sexual behavior? It remains a bit unclear what conclusion to make when the unadjusted RR was 0.59 (lower risk), and the adjusted RR was 3.2 (higher risk when comparing to baseline status). This conflicting finding should be discussed more in the discussion. If there was an “a-priori plan” to adjust for baseline STIs included in the clinicaltrials.gov protocol, then the authors should probably be focusing on that result (which showed an increased risk in the intervention group). Minor issues – Methods – the description of the randomization could be more clear how more people were randomized to the intervention – and could refer to the consort diagram (optional – this is presented in the results but could be in the methods). Minor – line 246 clarify if the “treatment” refers to the participation in the intervention (or some other sort of treatment…) Minor – Table 1 – more clarify the denominators for the percentages for “sexually active last 6 months and condom use” (mentioned in the footnote, but not obvious when first reading through the table). Reviewer #3: This is an important randomised controlled trial testing the efficacy of the IMARA project (a mother-daughter psycho-social STI/HIV prevention program) vs. a control arm of a more generic intervention promoting healthy eating and nutrition, physical activity and exercise, in a group of 199 adolescent Black/African-American girls’ incident STIs at 12 months. This study provides preliminary efficacy data indicating that IMARA did protect against the primary endpoint of incident STIs at one-year follow-up. However, there are aspects of the study design and analysis that could have confounded the results and which need to be clarified before drawing firm conclusions on the efficacy of this intervention. This is key before implementing similar program in other target populations. Main points 1. Randomisation schedule was created in an unusual way. Dyads were asked to select their randomisation treatment from a paper bag. This could have led to systematic bias and Table 1 indeed shows large imbalances for some of the participants’ characteristics at baseline (e.g. % positive for STI, mean number of STI, ethnicity, history of sex and socio-economic status). These are key common causes of both treatment allocation and incidence of STI so could have confounded the results. Authors should re-perform the analysis after controlling for all these additional imbalanced factors not just for the presence of STI at baseline. Residual confounding should be also mentioned in the limitations (lines 356 onward). 2. Similarly, the procedure of alternating between IMARA and the health promotion program would have made the process predictable and broke down the concealment of allocation so that recruiters could have decided not to enrol, say, a problematic dyad if it was known that next allocation would have been for example control and not IMARA. 3. Mothers and daughters in the control arm did not engage in role-plays or joint commune exercises, resulting in lack of blinding. Unclear why efforts were not made to try to implement blinding. This is an additional limitation that should be mentioned in the Discussion. 4. Calculation of statistical power is cryptic. It is said that dyads were randomly assigned to the IMARA (n=118) or the health promotion control program (n=81) following an overall ratio of roughly 1.5:1 favouring IMARA to enhance analytic power to detect the treatment effect. Nevertheless, in the Methods power is given for a total sample size of N=200 participants, assuming an even split of 100 vs. 100 in the 2 groups. Authors should show the difference in power using the 1:1 vs. the 1:1.5 random allocation and explicit reasons for choosing the latter. What was the expected increase in power? In general, from the text in lines 251-258, it appears that the sample size of 199 resulted as a consequence of an inevitable attrition between baseline assessment and initiation of the intervention rather than a pre-planned design. 5. Although similar by treatment arm, the rate of non-adherence/loss to follow-up was not negligible at 16% and 10% in the two arms. Because of that it is possible that the two groups are no longer exchangeable at 12 months. It is not an unreasonable assumption in these settings that daughters who are lost to follow-up are more likely to be have acquired STIs. Authors should perform an intention to treat analysis using the missing-failure approach. Alternatively, it is possible that the effect of the strategy could have been diluted by attrition so authors should also perform an on-treatment analysis after controlling for post-baseline confounding factors using a marginal model. This should control for all possible post-baseline prognostic factors as well as common causes of acquiring STI and risk of drop-out. 6. Lines 264-273. The issue of baseline exchangeability between arms is ruled out in the Methods with a couple of sentences saying that there was no difference at baseline between the two groups. A p-value >0.05 for these comparisons (line 236) is meaningless and should not be reported as this p-value should be equal to 1 as the null hypothesis is true by definition in a trial. On the other hand, there are larger imbalances between baseline factors which should be described in the text and controlled for in the analysis. For example, mothers in the IMARA arm were less likely to earn <$30k per annum that mothers in the control arm and this could have explained the difference in incidence of STI at 12 months. The sentence that overall >75% (which becomes ‘almost 80%’ in line 351 of Discussion section) of mothers earned <$30k annually in both groups is inaccurate and misleading. 7. Line 288. This same model adjusted for baseline STI status was RR=3.24, 95% [CI 1.72-6.11], p=.000. Has the direction of RR being inverted? Is this the difference of control vs. IMARA? 8. The fact that the difference observed could be due to mediators is mentioned and several potential mediators are listed e.g. improvements in mother-daughter communication etc. Was use of condom measured in the study? Change in sexual risk behaviour seems to be the most obvious surrogate endpoint/mediator in this analysis to verify. 9. Line 359. American adolescent girls and their mothers and may not generalise to other groups. Patterns may differ depending on the type of caregiver. For how many dyads the caregiver was not the natural mother? Unclear why a stratified analysis by type of caregiver (mother vs. other) could not be performed. 10. What was the effect of SISTA SiHLE and STYLE compared to this intervention? Results of the various trials should be reported and compared in the Discussion section. Other points 1. Lines 248-250. This stringent approach was not intended to be fully powered, but rather to provide a preliminary check of whether the pattern of results observed within the full sample replicated within the subset known to be sexually active at baseline. Indeed, it is very likely to actually be under-powered. Would have been more sensible to restrict the analysis to those who did not show STI at baseline? 2. Line 306. Suggested rewording: This study provides preliminary efficacy data indicating that IMARA protects against incident…. 3. Line 308. The authors claim that for consistency with existing literature past STI occurrence is strongly associated with future acquisition, and so it is standard to co-vary for STI history when predicting future infection. Nevertheless, the unadjusted RR of 0.43 is mentioned here, why? 4. Line 341. Suggested rewording: It is possible THAT girls did not understand the…. If the data are consistent with the literature, why is paragraph (in lines 341-349) needed at all? Or is it instead the case that 33% is likely to be an under-estimate of the prevalence of STI at baseline? ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
Revision 1 |
PONE-D-19-32194R1 IMARA: A mother-daughter group randomized controlled trial to reduce sexually transmitted infections in Black/African-American adolescents PLOS ONE Dear Dr. Donenberg, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. The comments below are minor, but do merit consideration prior to publication. Please submit your revised manuscript by Oct 11 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Matt A Price Academic Editor PLOS ONE Additional Editor Comments (if provided): I have a few minor suggestions to consider for this revision. ABSTRACT: The order of two sentences was a little confusing to me, I initially read the N as the final sample size (ie, taking into consideration loss to follow up). You may wish to reword "Girls provided urine samples to test for N. gonorrhoeae, C. trachomatis, and T. vaginalis infection at baseline and 12-months. Retention at 12-months was 86% with no difference across arms. Mother-daughter dyads were randomly assigned to IMARA (n=118) or a time-matched health promotion control program (n=81)." to something like "Girls provided urine samples to test for N. gonorrhoeae, C. trachomatis, and T. vaginalis infection at baseline and 12-months. Mother-daughter dyads were randomly assigned to IMARA (n=118) or a time-matched health promotion control program (n=81). Retention at 12-months was 86% with no difference across arms." ABSTRACT: You note that the intent to treat analysis was also significant “albeit with an attenuated magnitude”, yet in your results, the confidence intervals overlap. I suspect your study was not powered to see a difference between a 43% lower chance to contract an STI, and a 37% lower chance. I might change this to read that the ITT was "similar" to your main results, not "attenuated". Those two estimates are statistically very similar (and I would interpret them as essentially the same value). METHODS: please do add the name of the test kits for CT/NG and TV. You don't need to add the sensitivity and specificity. DISCUSSION: In the discussion, "STI and HIV" is often mentioned together, yet your study does not test for HIV. You do note this in your response to one of the reviewers, but I think your discussion would benefit with a short mention of this in your 'limitations' paragraph so at least the reader is aware you're thinking of this, even if you weren't able to test for it. [Note: HTML markup is below. Please do not edit.] [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
Revision 2 |
IMARA: A mother-daughter group randomized controlled trial to reduce sexually transmitted infections in Black/African-American adolescents PONE-D-19-32194R2 Dear Dr. Donenberg, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Matt A Price Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
Formally Accepted |
PONE-D-19-32194R2 IMARA: A mother-daughter group randomized controlled trial to reduce sexually transmitted infections in Black/African-American adolescents Dear Dr. Donenberg: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Matt A Price Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .