Peer Review History

Original SubmissionSeptember 19, 2023
Decision Letter - Renato S. Melo, Editor

PONE-D-23-28173Study protocol for Hear Me Read (HMR): A prospective clinical trial assessing a digital storybook intervention for young children who are deaf or hard of hearingPLOS ONE

Dear Dr. Malhotra,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 21 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Renato S. Melo, PhD

Academic Editor

PLOS ONE

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating in your Funding Statement: 

PSM 

This research was supported, in part, by the National Center for Advancing Translational Sciences of the National Institutes of Health under Grant Number UM1TR004548. Funds from Grant Number UM1TR004548 support the Ohio State University’s Center for Clinical and Translational Science. 

https://ccts.osu.edu/

https://www.nationwidechildrens.org/research/resources-infrastructure/core-facilities/center-for-clinical-and-translational-science-osu#:~:text=The%20Ohio%20State%20University%20Center,disease%20prevention%20strategies%20and%20the

Clinical and Translational Intramural Funding Program from the Abigail Wexner Research Institute, Grant AWD00001881

https://www.nationwidechildrens.org/research/clinical-research/resources-for-investigators

Funders reviewed and approved the proposed study design. Funders did not have any additional roles.

Please provide an amended statement that declares all the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now.  Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement. 

Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf.

3. Thank you for stating the following in the Competing Interests section: 

I have read the journal's policy and the authors of this manuscript have the following competing interests: Dr. Malhotra developed a company, Digital Story Therapies, Inc, based on the technology inherent in the Hear Me Read application. A financial conflict of interest was identified. Immediately upon its identification, Dr. Malhotra created a Conflict Management Plan with his institution, halted role as Principal Investigator, and ceased all study related duties. These duties were transferred to Dr. Prasanth Pattisapu, the current Principal Investigator. Digital Story Therapies, Inc has no relationship or influence with the conduct of this clinical trial.  

We note that one or more of the authors are employed by a commercial company: Digital Story Therapies, Inc

a. Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement. 

“The funder provided support in the form of salaries for authors, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement. 

b. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc.  

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

4. We noted in your submission details that a portion of your manuscript may have been presented or published elsewhere. Figure 2 is taken from "DeForte S, Sezgin E, Huefner J, Lucius S, Luna J, Satyapriya AA, Malhotra P. Usability of a Mobile app for improving literacy in children with hearing impairment: focus group study. JMIR Human Factors. 2020; 7(2), e16310. doi:10.2196/16310". This is not a dual publication since the manuscripts are about two distinct areas of the same study. The current manuscript is a study protocol paper while the other (cited) manuscript is about the development of the Hear Me Read application. Outside of this figure, there are no replications, in this manuscript, of the pervious publication. Please clarify whether this [conference proceeding or publication] was peer-reviewed and formally published. If this work was previously peer-reviewed and published, in the cover letter please provide the reason that this work does not constitute dual publication and should be included in the current manuscript.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In this article, the authors have introduced a novel digital storybook intervention intended to enhance the effectiveness of standard speech-language therapy. To assess the impact of incorporating the digital storybook, known as "Hear Me Read," into the standard therapy, they have proposed a prospective clinical trial. The suggested approach involves enrolling individuals for a 12-month period, where they will receive standard care alone (SLT-only) during the first six months and then standard care combined with the Hear Me Read application (SLT+Digital) during the subsequent six months. Data will be collected at the end of each six-month phase. The authors anticipate that any disparity in outcomes between the two conditions (SLT-only vs. SLT+Digital) will reflect the additional benefit of the digital component.

A Major Concern:

This particular pre-post design is suitable when one assumes that the underlying mechanism, in this case, the improvement in children's speech and language skills, remains relatively consistent or stable over time. It is reasonable to assume that providing standard therapy over the 12-month period alone should lead to some level of improvement in the measured outcomes. If that is indeed the case, the difference between the two conditions (SLT-only during the first six months and SLT+Digital during the last six months) will encompass both the impact of 'natural progress' (i.e., improvement resulting from standard treatment without digital augmentation) and the progress due to the addition of the digital intervention. In essence, these two effects are intertwined and challenging to distinguish from one another.

A potentially better approach could involve a parallel group design, where children are randomly assigned to one of the two interventions, eliminating the confounding of effects, and allowing for a clearer assessment of the digital intervention's true impact.

Reviewer #2: In this study protocol, a prospective clinical trial is being proposed to determine the efficacy of adding Hear Me Read to in-person speech-language therapy for children who are deaf or hard of hearing. The primary goal of the study is to compare measures of vocabulary, speech, and language outcomes between in-person speech-language therapy alone and in-person speech-language therapy with the Hear Me Read intervention.

Major revision:

Identify all the statistical methods that will be used to conduct the specified statistical analysis.

Specific revisions:

1- Statistical Analysis section: State the type of repeated measures analysis that will be used “to evaluate the effect of intervention on these outcomes.” (p. 13).

2- Statistical Analysis section: Explain how the primary and secondary outcome measures will be evaluated. Expand upon the statement: “For primary and secondary outcome measures, changes in raw score, standard score, percentile rank, scaled score, and age equivalent for the ROWPVT-4 and CELFP3 will be evaluated.”

3- Identify the statistical method(s) that will be used to evaluate the patient characteristics associations with changes in outcomes.

4- State how the data will be summarized: means, standard deviations, medians, interquartile range, frequencies, percentages, etc.

5- To assist in the review process, add line numbering to the document.

Reviewer #3: Overall, the article details the study plans and protocol in a way that is well-reasoned, structured, and informative. The authors make a strong case for the need for an intervention such as HMR and describe plans to trial it with a study employing rigorous methodology. The use of a repeated measures design and a within-subjects approach allows for a more accurate assessment of the impact of digital intervention by eliminating potential confounding variables. This approach certainly enhances the validity of your study findings. It will be interesting to see your study population and how you might consider or account for the potential for differences in growth between Time measure 1 (baseline to post-SLT-only) and Time measure 2 (post-SLT-only to post-SLP+digital) that could be due to child-specific or provider-specific variables in Time measure 2 (increased child age, increased child-provider rapport, increased time practicing therapy techniques, etc. You may wish to discuss in this or subsequent articles.

The regular follow-up with caregivers regarding book progress and completion of weekly reading questionnaires demonstrates a proactive approach to ensuring data accuracy and participant compliance. appreciated the included details about the features of the HMR application, such as the dual interface, personalized prompts, multimodal access to books, and encouragement of dialogic reading strategies were commendable. I would like to see more discussion related to the intervention design, such as how and why features and/or strategies were chosen to be part of the HMR intervention, including rationale from existing evidence, literature, other digital storybook interventions, etc. A description or examples of the expectations of use for participants would be helpful as well for readers to gain understanding of the application and the researchers’ intents for use as an effective intervention tool.

While the article mentions that access to interim analyses and the dataset is restricted to authorized entities, it does not provide clear justification for this limitation. As written in the PLOS data policy, authors are required to make all data fully available as part of the manuscript or deposited to a public repository. The lack of public availability of the dataset hinders potential replication and further scrutiny of the study findings.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Amanda Rudge

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Reviewer 1 Comments to the Author:

Comment: This particular pre-post design is suitable when one assumes that the underlying mechanism, in this case, the improvement in children's speech and language skills, remains relatively consistent or stable over time. It is reasonable to assume that providing standard therapy over the 12-month period alone should lead to some level of improvement in the measured outcomes. If that is indeed the case, the difference between the two conditions (SLT-only during the first six months and SLT+Digital during the last six months) will encompass both the impact of 'natural progress' (i.e., improvement resulting from standard treatment without digital augmentation) and the progress due to the addition of the digital intervention. In essence, these two effects are intertwined and challenging to distinguish from one another.

A potentially better approach could involve a parallel group design, where children are randomly assigned to one of the two interventions, eliminating the confounding of effects, and allowing for a clearer assessment of the digital intervention's true impact.

Response: Thank you for your comment. A parallel group design insinuates that children would be randomized into one of two groups (clinical care as usual or clinical care + HMR intervention). While this would be ideal, this design does not account for the differences in therapy frequency. These differences range from weekly in-person speech therapy to evaluation-only speech therapy every six months. Additionally, this is a pilot trial with a small sample size (N=50). Using a within-subjects design allows us to achieve greater statistical power despite our small sample. Lastly, children act as their own control, which decreases variability (e.g., individual differences in therapy frequency and patient characteristics) and allows for greater confidence that changes in outcome measures are due to the addition of the Hear Me Read intervention.

Regarding natural progress: The CELF-P3 and ROWPVT-4 are standardized, norm-referenced, speech-language assessments.

Before enrollment, children complete their Pre-Trial evaluation. About six months later, they complete the SLT-only evaluation. Lastly, they complete the SLT+Digital evaluation around 12 months of participation. Children only receive clinical recommendations (i.e., speech therapy, reading, and literacy recommendations from the speech therapist) from the Pre-Trial to SLT only evaluation. We expect to understand the child’s natural progress within this period. From the SLT only to SLT+Digital evaluation, children receive clinical recommendations and the HMR application. Residual changes in scores are expected to be attributed to the HMR application. Additionally, changes in speech, language, and literacy for children who are D/HH are most sensitive to early reading. As such, we track reading progress (using the weekly reading questionnaires) and employ standardized reading time (20 minutes per day, three times per week) throughout the study duration.

Reviewer 2 Comments to the Author:

Comment 1: Statistical Analysis section: State the type of repeated measures analysis that will be used “to evaluate the effect of intervention on these outcomes.” (p. 13).

Response: A repeated measures approach using a mixed effects model will be used to compare the change across time in group 1 to the change across time in group 2 (SLT-Only to SLT+Digital) [see lines 288-291 in revised manuscript].

Comment 2: Statistical Analysis section: Explain how the primary and secondary outcome measures will be evaluated. Expand upon the statement: “For primary and secondary outcome measures, changes in raw score, standard score, percentile rank, scaled score, and age equivalent for the ROWPVT-4 and CELFP3 will be evaluated.”

Response: Changes in raw score are reported as standard score, percentile rank, scaled score, and age equivalent for the ROWPVT-4 and CELF-P3. These changes will be evaluated given the sensitivity of raw scores [see lines 291-293 in revised manuscript].

Comment 3: Identify the statistical method(s) that will be used to evaluate the patient characteristics associations with changes in outcomes.

Response: We will use t-tests and Wilcoxon-Mann-Whitney tests to identify patient characteristics associated with changes in outcomes [see lines 294-295 in revised manuscript].

Comment 4: 4- State how the data will be summarized: means, standard deviations, medians, interquartile range, frequencies, percentages, etc.

Response: A table in the final manuscript will provide baseline characteristics of participants. This will include means (SD), medians (IQR), and frequencies, as appropriate given the baseline variable of interest. Outcome measures will report the change in means from pre-trial to SLT only, from SLT only to SLT+Digital, and from pre-trial to SLT+Digital.

Comment 5: To assist in the review process, add line numbering to the document.

Response: Line numbers were added to the document.

Reviewer 3 Comments to the Author:

Comment: Overall, the article details the study plans and protocol in a way that is well-reasoned, structured, and informative. The authors make a strong case for the need for an intervention such as HMR and describe plans to trial it with a study employing rigorous methodology. The use of a repeated measures design and a within-subjects approach allows for a more accurate assessment of the impact of digital intervention by eliminating potential confounding variables. This approach certainly enhances the validity of your study findings. It will be interesting to see your study population and how you might consider or account for the potential for differences in growth between Time measure 1 (baseline to post-SLT-only) and Time measure 2 (post-SLT-only to post-SLP+digital) that could be due to child-specific or provider-specific variables in Time measure 2 (increased child age, increased child-provider rapport, increased time practicing therapy techniques, etc. You may wish to discuss in this or subsequent articles.

Response: Thank you for your comment. Child-, caregiver-, and provider-specific variables are important to consider. We will use t-tests and Wilcoxon-Mann-Whitney tests to identify patient characteristics associated with changes in outcomes. If any imbalance in patient characteristics (e.g., age, frequency of therapy) is detected between groups, the imbalanced characteristics will be adjusted for in a repeated measures approach using a mixed effects model [see lines 294-298 in the revised manuscript]. We expect parent/provider-specific variables to impact the child’s progress/outcomes equally during both study periods (Pre-Trial to SLT only and SLT only to SLT+Digital). Standard clinical care should minimize variability in how SLPs conduct speech therapy and administer speech evaluations. Regarding parent-specific variables, parents are instructed to read with their child 20 minutes per day, three times per week. Should differences in child-clinician rapport, parent availability to read with the child, etc., warrant investigating the effects of parent/provider-specific variables, we will discuss this in subsequent articles.

Comment: The regular follow-up with caregivers regarding book progress and completion of weekly reading questionnaires demonstrates a proactive approach to ensuring data accuracy and participant compliance. appreciated the included details about the features of the HMR application, such as the dual interface, personalized prompts, multimodal access to books, and encouragement of dialogic reading strategies were commendable. I would like to see more discussion related to the intervention design, such as how and why features and/or strategies were chosen to be part of the HMR intervention, including rationale from existing evidence, literature, other digital storybook interventions, etc. A description or examples of the expectations of use for participants would be helpful as well for readers to gain understanding of the application and the researchers’ intents for use as an effective intervention tool.

Response: Thank you for your comment. We conducted a preliminary usability assessment and employed qualitative interview techniques to understand the needs of children who are D/HH and their caregivers. This usability assessment found that families had default, specific, and family needs as it relates to the application. We developed the HMR application in line with these needs [see lines 204-215 in revised manuscript for more details].

Comment: While the article mentions that access to interim analyses and the dataset is restricted to authorized entities, it does not provide clear justification for this limitation. As written in the PLOS data policy, authors are required to make all data fully available as part of the manuscript or deposited to a public repository. The lack of public availability of the dataset hinders potential replication and further scrutiny of the study findings.

Response: Thank you for your comment. Given our small sample size (N=50), interim analyses are not planned. This prospective clinical trial will serve as pilot data to help us determine outcome measures for future trials. Anticipated completion of primary analyses is September 2024, at which point, result of outcome measures will be made available on ClinicalTrials.gov in line with their requirements. Additionally, see lines 299-300 in revised manuscript for updated language about data availability.

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Renato S. Melo, Editor

PONE-D-23-28173R1Study protocol for Hear Me Read (HMR): A prospective clinical trial assessing a digital storybook intervention for young children who are deaf or hard of hearingPLOS ONE

Dear Dr. Malhotra,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 29 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Renato S. Melo, PhD

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #2: Yes

Reviewer #3: Yes

********** 

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #2: Yes

Reviewer #3: Yes

********** 

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #2: Yes

Reviewer #3: Yes

********** 

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: No

Reviewer #3: Yes

********** 

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

********** 

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: Minor Revisions:

Overall, the statistical methods require further clarification.

1- Line 220: Alpha levels rather than p-values are used in sample size calculations. Typically alpha levels are in the range of 0.01 to 0.10. Justify an alpha level of 0.001. It seems too small. Perhaps this is a typographical error.

2- Line 289: In the mixed effects model, it seems appropriate to first test the interaction of group by time.

3- Typically continuous baseline characteristics/demographics are compared using t-tests or Wilcoxon rank sum tests and categorical data is compared between two groups using chi-square tests. T-tests and Wilcoxon Mann-Whitney U tests do not test for association, but differences between 2 groups.

4- Line 295: The following statement is vague. Is the analytic approach mixed linear modeling? Clarify. "Characteristics associated with changes in the outcome (e.g., patient characteristics such as age, frequency of therapy) will be adjusted for within the context of the aforementioned analytic approach."

Reviewer #3: I am satisfied with the authors' responses to concerns and recommendations raised in the initial review. Authors have provided needed clarity surrounding the development of the HMR application, planned analyses, and data availability. These revisions have strengthened the manuscript. The work is a valuable contribution to the field.

********** 

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 2

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Response: We have reviewed the reference list and identified no retracted articles. In response to Review 2 comments, we added the following to the reference list: (27) Kohn MA, Senyak J. Sample Size Calculators [website]. UCSF CTSI. 14 March 2024. Available at https://www.sample-size.net/ [Accessed 19 March 2024].

Reviewer 2 Comments to the Author:

Comment 1: Line 220: Alpha levels rather than p-values are used in sample size calculations. Typically alpha levels are in the range of 0.01 to 0.10. Justify an alpha level of 0.001. It seems too small. Perhaps this is a typographical error.

Response 1: Thank you for pointing out this error. It appears that in addition to the typographical error of putting p instead of alpha, there was an error made in calculation by using alpha=0.001%, or 0.00001, instead of alpha=0.001. This caused the sample size estimate to be n=43, when the correct calculation of the given parameters gives n=27. This has been corrected in the submission [see lines 220-226, source cite in reference list (27)]. With regards to the alpha level, alpha=0.001 was chosen to be conservative and ensure that the treatment really was effective before expanding to larger studies, especially as HMR poses very low risk to patients. Using the same parameters but changing alpha level to 0.01 and 0.05 gives us sample sizes of n=19 and n=13, respectively, but for the purposes of our study we believe the feasibility assessment to be more important as we seek to gain as much information as possible.

Comment 2: Line 289: In the mixed effects model, it seems appropriate to first test the interaction of group by time.

Response 2: That is correct. We are comparing the changes between the two intervention periods (the SLT-Only and the SLT+Digital) which is a group by time interaction.

Comment 3: Typically continuous baseline characteristics/demographics are compared using t-tests or Wilcoxon rank sum tests and categorical data is compared between two groups using chi-square tests. T-tests and Wilcoxon Mann-Whitney U tests do not test for association, but differences between 2 groups.

Response 3: Thank you for your comment. We have included updated language as follows: “Baseline assessments are used to identify patient characteristics (e.g., age, frequency of therapy, rapport with SLP) associated with outcome variables using t-tests and correlation analyses.” [lines 293-295].

Comment 4: Line 295: The following statement is vague. Is the analytic approach mixed linear modeling? Clarify. "Characteristics associated with changes in the outcome (e.g., patient characteristics such as age, frequency of therapy) will be adjusted for within the context of the aforementioned analytic approach."

Response 4: We have clarified the statement as follows: “Characteristics associated with changes in the outcome (e.g., patient characteristics such as age, frequency of therapy) will be adjusted for within the context of a repeated measures approach using a mixed effects model” [see lines 296-298].

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Renato S. Melo, Editor

Study protocol for Hear Me Read (HMR): A prospective clinical trial assessing a digital storybook intervention for young children who are deaf or hard of hearing

PONE-D-23-28173R2

Dear Dr. Malhotra,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Renato S. Melo, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions?

The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field.

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses?

The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable?

Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible.

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Have the authors described where all data underlying the findings will be made available when the study is complete?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: No

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics.

You may also provide optional suggestions and comments to authors that they might find helpful in planning their study.

(Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: All comments have been adequately addressed.

Reviewer #3: I am satisfied with the authors' responses to concerns and recommendations raised in the initial and revision 1 reviews. These revisions have strengthened the manuscript. The work is a valuable contribution to the field.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Reviewer #3: No

**********

Formally Accepted
Acceptance Letter - Renato S. Melo, Editor

PONE-D-23-28173R2

PLOS ONE

Dear Dr. Malhotra,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Renato S. Melo

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .