Peer Review History
| Original SubmissionJuly 30, 2020 |
|---|
|
PONE-D-20-23749 Development and Evaluation of a Novel Music-Based Therapeutic Device for Upper Extremity Movement Training PLOS ONE Dear Dr. Schaffert, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. ============================== ACADEMIC EDITOR: As also one of the reviewers stated, I believe your study might be a valuable step towards adding new tools to help people with motor impairment improve their function. In this context, I thank you in advance for your careful revision work in line with the points, comments and suggestions highlighted by our reviewers in order to make your article more clearer and more useful for interested researchers. ============================== Please submit your revised manuscript by Oct 23 2020. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Sukru Torun Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Thank you for including your competing interests statement; "The authors have declared that no competing interests exist." We note that one or more of the authors are employed by a commercial company: BeSB GmbH
Please also include the following statement within your amended Funding Statement. “The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.” If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement. 2. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc. Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf. Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests 3. We note that Figure [4] includes an image of a [patient / participant / in the study]. As per the PLOS ONE policy (http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research) on papers that include identifying, or potentially identifying, information, the individual(s) or parent(s)/guardian(s) must be informed of the terms of the PLOS open-access (CC-BY) license and provide specific permission for publication of these details under the terms of this license. Please download the Consent Form for Publication in a PLOS Journal (http://journals.plos.org/plosone/s/file?id=8ce6/plos-consent-form-english.pdf). The signed consent form should not be submitted with the manuscript, but should be securely filed in the individual's case notes. Please amend the methods section and ethics statement of the manuscript to explicitly state that the patient/participant has provided consent for publication: “The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish these case details”. If you are unable to obtain consent from the subject of the photograph, you will need to remove the figure and any other textual identifying information or case descriptions for this individual. 4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. Additional Editor Comments (if provided): Dear authors, As also one of the reviewers stated, I believe your study might be a valuable step towards adding new tools to help people with motor impairment improve their function. In this context, I thank you in advance for your careful revision work in line with the points, comments and suggestions highlighted by our reviewers in order to make your article more clearer and more useful for everyone interested. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: I Don't Know ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Data Availability: The form states, “Stating ‘data available on request from the author’ is not sufficient. If your data are only available upon request, select ‘No’ for the first question and explain your exceptional situation in the text box.” However, the authors stated, “The datasets generated and/or used during the current study are not publicly available but are available from the corresponding author on reasonable request.” No description of an exceptional situation was provided. Major Comments: - Throughout much of the manuscript, I found myself asking, “How is the SONATA different from existing music therapy devices? What is the key innovation?” The manuscript does a good job of motivating music-based rehabilitation but does not discuss the gaps that the SONATA addresses until the end of the manuscript. An earlier, structured review of relevant devices would be useful to motivate the development of the SONATA and clarify the message of the manuscript. - Is there a reason the grid layout was chosen as opposed to a typical keyboard layout? Were other layouts tested, and, if so, did they have any impacts on the results? I also have similar questions regarding the size and shape of the virtual keys. (e.g., Can smaller keys be used to encourage greater spatial accuracy?) - Introduction, last paragraph: “With that in mind, a novel music-based therapeutic device for upper extremity movement training was developed to improve upper extremity motor function, to increase independent patient engagement, to enhance treatment quality, intensity, and compliance, and to assist therapists during treatment implementation and assessment.” This sentence suggests that the SONATA does these things, but they have not been validated and this study does not attempt to demonstrate them. The literature review suggests that these claims could be true for the SONATA, but the statement in its current form is misleading. - Introduction, last paragraph: “to evaluate the feasibility of the system’s functioning for upper extremity movement training.” Given the subject set, this statement is also misleading. - Methods, Section 2.3: “… thus assisting the therapist in assessing measurable changes in upper limb function throughout training.” This claim may need more justification. The experiment does not show that the data collected by the tasks, as they are implemented by the SONATA, correspond to changes in upper-limb function. How the therapists interact with this data (e.g., visualization, as opposed to raw data) is also important to determining if the data assists therapists. If it is too difficult to draw actionable inferences from the data, then in practice it will just be ignored. - Discussion, second paragraph: Is performance accuracy really an appropriate measure of ease of use? How hard does a device have to be to use to elicit a significant decrease in accuracy for young, healthy subjects? It also does not account for the interface design or therapist interactions with the system. Some sort of usability questionnaire or qualitative assessment may help to better support this claim. The limitations paragraph mentions the need for additional evaluation, but this statement is too strong. - Conclusions: “… indicate the feasibility and reliability of the device as a tool for upper extremity movement training.” This statement is too strong given the subject demographics and experimental design. More cautious language should be used. Minor Comments: - Methods, Section 2.1: Please include a more thorough description of the hardware. For example, is the device battery-powered or plugged in? Is the system wirelessly controlled via Wi-Fi, Bluetooth, or some other standard? If the device was designed to minimize latency between user input and sound output, what was the average latency? - Figure 1: It would be useful to readers to visually convey the scale of the devices. From the text, I see that the SONATA is rather large (approx. 0.7 m by 0.4 m), but it appears much smaller in this figure because of the adjacent tablet. (Though Figure 4 helps with this issue to some extent.) The figure should also more clearly identify which device is the SONATA and which is the tablet to prevent potential confusion. - Figure 2: The authors may want to consider splitting or vertically arranging this figure so that the interfaces are easier to see. In comparison, Figure 3 was much easier to see. - Methods, line 160: “BPM” Please define abbreviations before use for clarity. Readers that are not familiar with music may not know that this means beats per minute. - Methods, Section 2.4.1, line 224: This is admittedly a bit of a nit-pick (i.e., the statement is acceptable as-is), but neurological damage or disorders can also affect upper limb movement. - Methods, Section 2.4.4: For clarity and readability, please avoid using variable names (e.g., “PAT_TIME”) without first defining them in English. At the minimum, a table of variable names and their descriptions could be provided and referenced before use. Avoiding the use of variable names altogether and using English instead is even more preferable. - Results, Task 4, lines 407–410: Is ms an appropriate unit here? Reporting seconds rounded to one significant digit after the decimal would be more easily parsed by the reader and would not change the conclusions. Spelling and Grammar: Below are a few miscellaneous items the authors may wish to address. This list is not necessarily comprehensive; the authors should do another proofreading pass. - Introduction: “Post-stroke” is usually used as an adjective and not as a noun. The authors may want to consider saying “stroke” or “stroke survivors”. - Introduction, line 112: “With that in mind,” The “that” is ambiguous. - Methods, line 130: “built-in” - Methods, line 250: “pitches” - Methods, line 282: “composed of six to nine” - Methods, line 294: “composed of seven” - Methods, line 295: “at a time” - Decimal values should have a leading zero where appropriate. (e.g., “p < 0.05” on line 360.) Reviewer #2: You have described a tablet device designed for upper limb training and presented data collected from participants' hand and finger movements using the device who do not have upper limb impairment (normal controls). Please add to the title 'a pre-clinical, single arm trial' I would also consider revising the title further, to specify hand and finger or fine motor training, since there is no description in the manuscript of elbow or shoulder extension/flexion, aduction/abduction, or other gross motor movements. In the abstract you use the terms neurologic recovery and neurologic conditions, please be more specific. Line 32, correct to 'built-in' Line 46, Abstract, this conclusion cannot be justified. please amend to reflect your findings from pre-clinical phase, i.e. it is not known whether this would work with patients who have UL paresis or apraxia. Line 55, just state 'Stroke' Line 74: References 35, 37, 38, 39 are not TIMP as they do not require facilitating music for movement synchrony. Line 82. It is not clear what you are saying here. It seems that you are referring to other research here (Rojo et al, 2011, Ripolles et al, 2015, Altenmüller et al 2009, etc), where audio-motor coupling is discussed, which you cite later. Please revise the whole literature review to make it shorter and more succint, including only the key literature relevant to UL rehab (hand, finger, fine motor) and the use of rhythm-based interventions and technology such as keyboards and touchscreen instruments. Line 117. It needs to be completely clear what you have done thorughout the manuscript, the this is pre-clinical testing, which can only show that the hardware and software is working with normal controls. Line 130correction 'built-in, and omit the word 'sound', just write 'speakers' 139-142 graphically and acoustically program, please re-write to explain more clearly. Do you mean that the therapist (music therapist?) programs the screen layout, metronome setting and/or drawing exercise while the patient is perfomring the exercises? Please clarify. 161: do you mean synchronise their movements? Please clarify. What if they have cognitive (attention and exec function) impairment, and find the metronome distracting, performing UL movements better without it? This needs some dsicussion later 203 Please define what this (ASCII) file is. Readers really need to know that dat collection and storage is secure and can conform to relevant policies to protect patient identity. Please clarify that your system is secure in this regard. 208 'The output files also contain timing and location information of each patient’s input.' clarify, does this mean time of the session and where it took place? If so, how are these data stored to ensure data protection? 210 'inter-stimulus interval, inter-response interval' please define 219 'Functional tests were conducted with 21 healthy individuals (12 males, 8 females) recruited at...' this amounts to 20. 228 No info here about reducing compensatory movements in people who actually have UL impairment, nor at any point later in the manuscript. This must be discussed to some degree. 268-269 youve cited MST rsearch but under the name of TIMP, this needs correcting, and here you need to reference MST to help identify what it is to the reader 288-290 why such a cognitively taxing task when the focus is on UL rehab? How is this supported as a key component for UL rehab, any literature? 308 hypometria, bradykinesia, breif definition required 309-312 thi should be in the background section 328-329 (PAT_TIME – TICK_TIME) please define 334 SEQ_KEY and PAT_KEY please define 376 'Nonetheless, the analysis indicated that there were significant main effects of 377 sequence length' This is useful data for informing on how to adapt the software/exercises for phase 1 clinical trial. There should be some discussion of this under 'future research' or 'clinical trial planning' 379-381 Anyone working in neurorehab (occupational, physiotherapis for example) would anticipate this response and be able to set up exercises of appropriate complexity for patients, based on their assessment of cognitive function, before the session. Can you explain how this is adding to or enhancing current neurorehab provision, for example in stroke? 382-384 Needs later discussion or some acknowledgement, as patients with cognitive impairment (attention and executive function) may not be able to synch with the pulse, depending on injury or stroke type and time post onset. 387 Needs discussion in the context of how to adapt the equipment.software for clinical trials/use 395 section on finger tapping task: Obviously this needs discussion in context of clinical trials, i.e. you need to test whether the data are accurate for those with apraxia for example 419-421 please amend. feasibility and ease of use of the device are not demonstrated by participants’ performance accuracy. It is the fact that they could access and complete the exercises using this equipment (each clinical setting also needs to be taken into consideration, i.e. acute, subacute, home, carehome, etc) that demonstrates this, but only if you can describe the level of support that was required by the therapist/facilitator. Was lots of assistance required so that participants could follow the exercises? How has your trial informed on the next stage, clinical trial. 422 'we replicated the results of previous research' what research? You state this previously, in the abstract. It is not clear. 440 is cognition consistently part of the focus throughout? Please ensure you maintain focus, what is primary, secondary, i.e.you need to state from the ofset that attention, executive function (memory you mention) are important to potential patient populations being able to access these exercises, that the clnician operating and delivering must consideer these functions and that there may be benefits in these domains from patients doing these exercises, as has been found in some MST research (Grau-sanchez for example). 447-450 ' Studies have consistently demonstrated that active music playing is effective to train upper extremity movement [35-44] due to crucial elements, such as the display of real-time multisensory information [54-56] and the use of metronome or beat-enhanced music to support movement training [49,62,63], which promote neuroplasticity [39,57-61]...' The way this is written suggests that these citations (39, 57-61) involved metronome or beat synchronisation, which they didn’t so I suggest re-writing this. 454-455 ...'including the availability of features that allow for better control and documentation of the training exercises implemented in each session.' No literature is cited here that indicates this is needed and this was not a clearly stated key aim at the ofset. What data supports a claim that this equipment achieves this? Have you clearly descibed how SONATA does this? Has it been reliability checked? 458 but no correlation has been made between your data and standard assessment tools for UL function such as Fugl Meyer and ARAT? SO how do you know that this helps to achieve functional goals? PLease more clearly correlate, if possible, your data with that of MST studies where there is some correlation between tapping tasks and motor assessment outcomes. 458-459 this hasn’t been feasibiity tested though. You don't know how SONATA will perform in any setting. Please amend and state that this is a limitation of your study and/or that you need to conduct a clinical trial, most likely a feasibility study. 465 ...'transform the therapeutic process.' In the interest of not making exaggerated claims, in what context? One paper is cited hear, published in a music therapy journal. You have completed a pre-clinical testing study with normal controls, not patients. Please write in a way that does not imply that SONATA can achieve this transformation. So far, you can only use published data, primarily from MST studies. 472 Can you be clear, are you saying that studies are under way (recruiting) with clinical populations? 475 need to be specific here and say what the limitations definitely were: our study was limited to testing the software and data collection. No data were correlated with standard UL measures, which needs to be done in a formal trial. Exercises have not been tested for feasibility of delivery with stroke or other patient populations requiring neurorehabilitation in any clinical setting. Feasibility needs to be quantified in terms of acceptability of the exercises, tolerance and adherence. Following this, if data are favourable, a pilot or definitive trial would be required with a sufficiently powered sample. Prior to that, since the device is intended for biomedical treatment, it would need to be registered as a medical device. The latter, must be acknowledged/discussed and is not mentioned at all throughout the manuscript, can you justify why it is not mentioned? If not, plese amend. 481 '9 sequences' if you are presenting this as a potential tool to aid UL rehab, then you must discuss more about the implications. Since tolerance and adherence to treatment are central in enabling patients to achieve the required high dosage of treatment (MST = 3-4 weeks at 5 X per week) to show any clinical or statistical significance, wouldn’t 9 sequences per task fall rather short of achieving this? 487 'Upper extremity movement training' Please consider revising the manuscript to consistently state hand and finger and/or fine motor function. THink about where you want to take this research, what the next stage is. This study must support the next stage, if enough has been done here to pave the way, together with all pre-existing evidence. 488 'well known' be precise, clinically relevant. Are they well known? Where are the citations? 488 'test the feasibility, ease of use.' To a degree, but the data need to be collected alongside standard UL measures from people with UL impairment and reliability checked 492 implementation and independent patient engagement ( I assume you mean self-delivery) these are two diferent things. Please clarify and define. The conclusion could be better written. To say that results indicate feasibility and reliability is too general, too many areas are not covered in your study. What about positioning to mitigate compensatory movements, data protection (storage and transfer of data), checking of SONATA data alongside standard UL assessment tool data, infection control of equipment in clinical settings, who would deliver the exercises, a music therapist, any clinician, what can you conclude needs to be done next based on your findings, what dosage of SONATA exercises could be delivered in a clinical setting and are there currently enough exercises, how long does it take a clinician to program each exercises for each patient and what is the impact on managing a clincal case oad, what about medical device registration for SONATA? The study might be a useful step in the right direction (adding clinical tools to help people with UL impairment to recover function), but as the manuscript stands it is not clearly framed and needs to be amended to consistenly adhere to the main areas of focus, purpose, findings, so that it is completely clear what the implcations are for future, related research, giving some indication of if and when SONATA might become a clinical tool. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: Alexander Street [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Development and Evaluation of a Novel Music-Based Therapeutic Device for Upper Extremity Movement Training: A Pre-Clinical, Single-Arm Trial PONE-D-20-23749R1 Dear Dr. Schaffert, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Sukru Torun Academic Editor PLOS ONE Additional Editor Comments (optional): Thank you for correcting and editing many important issues highlighted in our major revision suggestion and making the necessary adjustments to improve the scientific quality of your article. Sincerely. Reviewers' comments: |
| Formally Accepted |
|
PONE-D-20-23749R1 Development and evaluation of a novel music-based therapeutic device for upper extremity movement training: a pre-clinical, single-arm trial Dear Dr. Schaffert: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Prof. Dr. Sukru Torun Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .