Peer Review History
| Original SubmissionFebruary 9, 2020 |
|---|
|
PONE-D-20-03780 How does a partner’s motor variability affect joint action? PLOS ONE Dear Ms Sabu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. We would appreciate receiving your revised manuscript by Jun 05 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Gavin Buckingham Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. Please change "female” or "male" to "woman” or "man" as appropriate, when used as a noun. 3. We note that Figure 1 includes an image of a participant. As per the PLOS ONE policy (http://journals.plos.org/plosone/s/submission-guidelines#loc-human-subjects-research) on papers that include identifying, or potentially identifying, information, the individual(s) or parent(s)/guardian(s) must be informed of the terms of the PLOS open-access (CC-BY) license and provide specific permission for publication of these details under the terms of this license. Please download the Consent Form for Publication in a PLOS Journal (http://journals.plos.org/plosone/s/file?id=8ce6/plos-consent-form-english.pdf). The signed consent form should not be submitted with the manuscript, but should be securely filed in the individual's case notes. Please amend the methods section and ethics statement of the manuscript to explicitly state that the patient/participant has provided consent for publication: “The individual in this manuscript has given written informed consent (as outlined in PLOS consent form) to publish these case details”. If you are unable to obtain consent from the subject of the photograph, you will need to remove the figure and any other textual identifying information or case descriptions for this individual. 4. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The paper addresses an interesting issue regarding which factors modulate the efficiency of learning to perform a joint-task. Specifically, in three experiments the authors tested whether the partner’s motor variability and the predictability of her movement perturbations influence the participants’ performance. The paper is interesting, technically sound and well written, although some methodological improvements could be implemented and some clarifications are needed. Please see my comments below. EXPERIMENT 1. 1)Figure 4. Does it show the performance of a participant during the individual or the joint phase? 2)Why the participants’ performance in the individual phase was not used to normalize the dependent variables in the joint phase? This would rule out the possibility that the main effect of group was due to a random group-difference in the participant’s ability to perform the task, which is still a possible alternative explanation, given the between-group nature of the design. 3)Line 316: “trials in which participants moved to positions 5 cm or more away outside the target grid were considered as outliers and removed from the analysis”. How many trials were removed? Were they equally distributed between the groups? 4)Line 319-320: “The spatial error for all 10 repetitions of the sequences was calculated and averaged across all 8 training blocks”. First, I would remove the term “training” here as it is confusing. Second, do the authors mean that they averaged the dependent variables between the 8 configurations of each repetition of each sequence within each block, and then averaged the values between the blocks? 5)With regard to the correlation analysis (correlation between force perturbation and spatial error), I do not understand how it was performed. I would have expected the authors to use the information of each single trial, and to examine whether within each participant the trials in which there is higher perturbation they also show higher errors. This should be done by transforming (Z-transformation) the dependent variable within each repetition (to control for the main effect of repetition) and running a linear mixed model to take into account inter-individual variability. Please note that these five comments stand for Experiment 2 and 3 as well. 6)Line 320-321: “Mean Spatial Error of Groups were also subjected to a Bayesian Independent Samples T-Test for comparisons.” I do not see the results of the Bayesian test in Experiment1, this might be a typo. 7)With regard to the results on Spatial error and Individual Variability on horizontal dimension, the ANOVA showed an interaction effect: the authors should then report the post-hoc tests and specify which repetitions showed a significant between-group difference. For instance, it seems that R2 showed no group difference, how do the authors interpret this result? Please comment. 8)Minor: line 272, delete the “s”. EXPERIMENT 2. 1)I do not understand why the participants performed 10 repetitions in Experiment 1 and only 5 repetitions in Experiment 2. Could you please clarify this point? 2)The authors may want to compare the three dependent variables between the HV groups in Experiment1 and Experiment2, to show that indeed the predictability of the partner’s movements allows a faster learning in the HV group in Experiment 2. Please note that the expected result here is that the two groups do not differ in the first repetition, and then improve faster. EXPERIMENT 3. 1)As for Experiment 2, the authors may want to compare the three dependent variables between the HV groups in Experiment 1, 2 and 3, to show that indeed the predictability of the partner’s movements allows a faster learning in the HV group in Experiment 2 and 3. Please note that the expected result here is that the three groups do not differ in the first repetition, and then improve faster (and equally) in Experiment 2 and 3. 2)Similarly, the authors may want to run the same Bayesian test that they did in Experiment 2 and 3 to compare the average spatial error between HV groups in Experiment 2 and 3. Reviewer #2: I have reviewed the paper “How does a partner’s motor variability affect joint action” by Sabu et al. The paper examines the issue of “joint learning” between two individuals, looking at the role of variability and predictability. Using a sequence learning paradigm in 3 experiments, the authors report that higher levels of unpredictable forces result in decreased performance (Exp 1), the same levels of forces when forces are predictable eliminate this decrement (Exp2), and that making the forces ‘partially predictable’ (magnitude but not direction) also eliminates the decrement found in Exp 1. I think the strengths of the paper are its novel experimental setup and relatedly elegant experimental manipulations. The methods were also well done for the most part. However, I do have some major concerns with the analyses and the underlying theoretical motivation Major concerns: 1.The argument about ‘predictability’ in Exp 2 and Exp 3 requires some work in my opinion. Since the participant did not have “apriori” knowledge of the confederate’s sequence and could only discover the fact that it was predictable over practice, it seems surprising that the differences found in Experiment 1 disappear in even in the very first block (R1). How could participants predict the confederate’s sequence so quickly? In my view it is essential to show this first block in more ‘fine-grained’ resolution. So I would suggest not averaging all 10 sequences within the first block and instead show this individually (presumably for the first 1-3 sequences, the results should look exactly the same as Exp 1). 2.The analysis of ‘horizontal’ and ‘vertical’ variability separately does not make sense in the task given that there was no primary direction of motion. These could be lumped in as a bivariate variable error computed along both dimensions simultaneously. 3.Ln 248 says that the task required “synchronous” matching with the partner– yet no information is provided about the temporal accuracy with learning. Relatedly the movement times also need to be provided to make sure that interpretation of changes in accuracy are not confounded by speed-accuracy tradeoffs. 4.Some measure of performance on the ‘confederate’s side would also be critical to understand the performance reported here – since this is a person and not a robot, were there adjustments that the confederate made over time, or in different conditions that potentially affected the participant’s learning? 5.Finally, I felt that the authors’ underlying theoretical motivation needs to be explained better in terms of the task used here. The authors refer to Wu et al and exploration, but the tasks in Wu et al (shape matching and force field adaptation) *require* exploration to move from one movement pattern to another. Here in the sequence learning paradigm, it is not clear *why* exploration is required to perform this task (and therefore why variability should be useful). Instead, the changes reported in accuracy/precision are simply refinements of an existing movement pattern. The authors need to address this more carefully both in the Intro and the Discussion and mention why exploration is required for learning this sequence task. Minor: 1.Ln 28 – “individual motor learning studies demonstrate individual’s ability//”. The term “individual studies” is confusing 2.Ln 58 “in such joint actions and in joint actions” – rephrase 3.Ln 65 – “making one’s own movement less variable and more consistent”. Is less variable the same as more consistent or does it refer to some other feature here? 4.Ln 76 – the paragraph on interpersonal coordination seems a little out of place here. Either develop this more fully or move it to the Discussion if it is not central to the introduction 5.Ln 95-98: The study referred here actually showed that the magnitude of variability was not important – rather it was the structure of the variability (as measured by the autocorrelation) that determined learning rate. 6.Ln 103-104: The two statements here referring to [19,20] need to be explained in a bit more detail to help understand why variability may play multiple roles. 7.Ln 118-130 seems to be talking about generalization – yet this is not a major focus of the paper. 8.Ln 139-142. The two options spelled out here are interesting, but do not seem to be tested in the paper at all 9.Ln 230 – remove the “/sec” - just 120 Hz 10.In all Experiments, was any feedback provided to the participants (in terms of errors or times etc.)? 11.Were data from the “individual action phase” analyzed at all – it seems like this would be important to understand how the learner changed strategies in the joint learning task 12.Ln 345 – please report exact p-values unless they are very small (Say <.001). Same comment holds for other part of the manuscript as well. 13.Ln 358-365: The number of data points on Fig 5B seem larger than the total number of participants in the HV group. 14.Ln 365 – Not sure what this means. The author say that the LV group experienced variation (just lower in magnitude) in Ln 257– so why is the LV not plotted here? 15.Ln 363 – not clear what the authors mean by “correlation is significant even without removing the outliers”. If they are truly outliers, they need to be removed because they will affect the magnitude of the correlation (even if the significance is not affected) 16.Ln 455 – please use full sentences to describe this. 17.At several places, the authors seem to go back and forth between the terms ‘Variability’ and “Group’ to describe the between subject factor – in my view ‘Group’ is much clearer since there are only two groups. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Lucia Maria Sacheli Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-20-03780R1 How does a partner’s motor variability affect joint action? PLOS ONE Dear Dr. Sabu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Reviewer 2 still has some concerns regarding interpretation - I'm not going to reject a manuscript on impact, but do seek assurances that the data represent what they are purported to represent, with all suitable caveats made where appropriate for more ambiguous findings. Please submit your revised manuscript by Oct 10 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Gavin Buckingham Academic Editor PLOS ONE [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: (No Response) Reviewer #2: Partly ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: (No Response) Reviewer #2: No ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: (No Response) Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: (No Response) Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) Reviewer #2: I have reviewed the revised manuscript submitted by Sabu et al. I thank the authors for the clarifications and the extensive changes but I feel that there are still 2 main concerns: 1. My concern about the predictability argument does not seem to be resolved. The authors show analysis of the 'first block' (the forces in the first block *has* to be 'unpredictable' by definition because there is no other prior experience from which the participant can predict anything). Yet the differences exist between Exp1 and 2/3 even in this block. I think this *severely* undermines the argument about predictability of forces being the main driving factor. In their response, the authors argue "We would like to argue that this could be because the pre-exposure to the target locations in the individual phase was enough for the participants to offset the group effect while learning the task together with a partner producing atleast partially predictable movements". I'm not entirely sure what this means. How could the exposure to the target locations in the individual phase (when there were no forces involved) help the learner 'predict' the forces produced by the confederate in Exp 2/3 the first time they experienced these forces? To me, this indicates that some other confound is present in the data Relatedly, the finding that the confederate also showed 'improvements in performance' and differences between conditions is worrying because it creates a confound in interpretation of the learner's performance. Because the confederate is haptically coupled to the learner the confederate's errors and the related forces they exert also influence the learner's spatial error. (i.e. imagine if the learner had the intent to make the exact same motion each time - the movement of the confederate would influence how the spatial error of the learner). This is also why I disagree with the characterization that spatial error is an 'individual' performance metric in Ln 172 - when the forces are coupled spatial error is no longer an individual measure of performance. 2. Moreover, related to my concern about theoretical rationale, after reading the response from the authors which provided clarification, I am still unsure how this paper has anything to say about 'learning' in the traditional sense of the word (see performance-learning distinction - see for e.g. Salmoni, Schmidt & Walter, 1984). What the paper measures is 'performance' and its change over time. However, since there is no 'common condition' under which the groups are tested (e.g., a test where all groups switched to the same haptic condition), I believe no inferences about learning (which reflects the underlying change in motor skill) can be made from the data. So it is still not clear to me that the the framing of the intro and discussion in terms of Wu et al. and learning/exploration is appropriate here (I think the framing in terms of joint action and how someone regulates their variability in response to a partner's variability is OK) Minor: 1. It is not specified what the movement times are for these movements (only the cueing time of 1000ms is mentioned). Also I was referring to the speed-accuracy tradeoff for movement time (i.e. Fitts' Law). Movement times here are controlled by the participant and not by the script. 2. Ln 332-333: I think the outlier stats need to go under Ln 345 where the outlier criteria is mentioned 3. Ln 801 - if the authors wish to compare the magnitude of the horizontal to the vertical variability, then it should be normalized to the amplitude of the motion (i.e. a higher amplitude motion along the horizontal will give rise to higher variability along that dimension because of signal dep noise) 4. Ln 536 - I'm not sure if this is what the authors intended but the spatial error (what I Had referred to as bivariate error) is not the average of the x- and y- components (since it also has take into account the correlation between them in diagonal movements for example).See for example (Hancock, Butler, and Fischman (1995)) 5. For the Bayesian test, please indicate what prior was used. Also in Table 1, the N column needs to be made wider so that 20 is in the same row 6. For the correlations, there are both within- and between-subject data pooled to make a correlation- this inference can be errorneous (see for eg. Simpson's paradox). Either this correlation needs to be done at an individual level and then averaged or the nested nature of this data needs to be accounted for. Also this is a correlation between two continuous variables - so I don't fully understand why the LV group cannot be plotted (yes, their range will be smaller and this can be acknoweldged in the Discussion, but it would be helpful to see the correlation plots anyway) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
How does a partner’s motor variability affect joint action? PONE-D-20-03780R2 Dear Dr. Sabu, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Gavin Buckingham Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-20-03780R2 How does a partner’s motor variability affect joint action? Dear Dr. Sabu: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr Gavin Buckingham Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .