Peer Review History

Original SubmissionJanuary 17, 2020
Decision Letter - Adrian M Haith, Editor, Samuel J. Gershman, Editor

Dear Mrs. Forano,

Thank you very much for submitting your manuscript "Timescales of motor memory formation in dual-adaptation" for consideration at PLOS Computational Biology.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. The reviewers were in general positive about the paper, but highlighted a number of concerns, mostly relating to the computational modeling and interpretation. In particular, the reviewers highlighted that the model fits are not presented in a transparent manner (only plotting BIC scores), despite it being seemingly straightforward to visualize predictions of this type of model. In addition, in order to improve the rigor of the modeling component of the paper, it would be worthwhile to include a model-recovery analysis using simulated data to determine how reliably the different models you consider can be discriminated based on the type of data collected in the experiments (see e.g. Wilson and Collins, eLife, 2019). In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account all the reviewers' comments.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Adrian M Haith

Associate Editor

PLOS Computational Biology

Samuel Gershman

Deputy Editor

PLOS Computational Biology

***********************

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: My comments are attached separately.

Reviewer #2: This manuscript from Forano and Franklin tackles the question of timescales of motor memory formation during dual motor adaptation. Previous groups have shown that interference can be minimized and separate memories can be formed during simultaneous adaptation to opposing perturbations when participants are provided with appropriate contextual cues (Lee and Schweighofer 2009, Howard et al 2012, 2013, and 2015). This phenomenon was modeled by Lee and Schweighofer through expansion of a two-state multi-rate model of adaptation (Smith et al 2006), such that separate slow-learning processes were each assigned to one of the two perturbations, but only a single fast process adapted to opposing perturbations. Using simulation, two behavioral experiments, and model selection, the authors of the present manuscript propose a different computational architecture to that of Lee and Schweighofer. Specifically, they propose separate fast and slow processes for each perturbation, as well as a perturbation-specific “ultra-slow” process.

Overall, I thought many parts of this manuscript were clearly written and the analyses were rigorous. However, I have major concerns regarding the narrow scope of the research question and thus the authors’ attempt to frame their findings within the broader context of skill learning, as opposed to the more constrained realm of adaptation (re-calibration). At the end of the Introduction, the primary aim of the study was articulated as a question about whether or not the Lee and Schweighofer model could explain spontaneous recovery (the return to an adapted state during error clamp trials following washout of adaptation) during dual adaptation. While this question of interest, the link to skill learning (e.g., learning to ride a bicycle or ski) appears tenuous, especially in light of research showing that skill learning and recalibration are qualitatively different learning phenomena (Telgen et al 2014, Yang et al 2020 bioRxiv).

Other related Major Concerns follow:

- The addition of the error clamp trials to the AB experimental design was well-justified and had a clear link to the primary research question. However, I did not understand the justification for the subtle differences in experimental design between E1 and E2 and the main text did not provide a clear rationale. This hampered the overall impact of the manuscript as two similar sets of results and analyses were reported sequentially, but without any clear context for why both versions of the experiment were performed. For clarity, could the authors either provide a better justification for the two experimental designs and/or provide the rationale for combining the experimental results earlier so that readers only need to deal with one set of results? I believe this would help with clarity, as there were not independent pieces of information gained from both experiments.

-I was surprised by the lack of explicit discussion of how the current results relate to the series of papers from Howard and Wolpert on forming separate internal models. I’m curious as to what the authors think regarding the generalizability of their findings and models to other methods of blocking interference, specifically dynamic contextual cues. This is in my mind of interest because the methods used in the current manuscript seem radically different than theirs, yet the phenomenon of interest is the same.

In addition, if we are to accept the findings of the Howard et al and Sheahan et al papers, don’t their behavioral results already speak to the formation of two separate internal models? My point being that if we assume that each internal model has a slow and fast process, then the current proposition of two fast processes for two separate contexts is a natural corollary of what has already been shown in the literature. This is not to take away from the current findings and the more formalized approach, and of course, the introduction of a third ultra-slow process, but it does seem worth discussion in the text. This concern also points to the narrow scope of the manuscript.

-Since the bulk of the interpretation rests on the model-fitting procedures, could the authors provide figures showing model fits, at least for the models with characteristically different architectures, e.g., one-fast vs two-fast and two-slow vs two-fast and three-slow? I think such a figure would help contextualize the magnitude of the differences between the models, as I suspect the differences between two-fast two-slow vs two-fast three-slow would be fairly subtle as compared to one-fast vs two-fast. But without such a figure, the reader is only left to work with the BIC scores, which are informative, but not nearly as impactful as a figure with model fits could be.

-While the figures showing the individual and group-averaged BIC results were both attractive and informative, I am concerned that too much emphasis is placed on group averaged scores, as there was no measure of across individual variance shown in Figs. 4 or 6. The mean improvements without the standard deviation or error tells only part of the story. Also, wouldn’t it be justified to treat the BIC scores as any other dependent variable and subject them to inferential statistics, too? My point is that the BIC scores may benefit a great deal from contextualizing with figures of model fits and statistical tests. Since you are not testing different classes of models or radically different architectures, but rather different versions of multi-rate models that share a common algorithm, these suggestions would help the reader form a more informed opinion regarding the robustness of the results.

On a related note, why does it appear that there are no normalized BIC scores for the orange and red models for participants 8 and 9 in Fig. 4B?

-In terms of the writing, the Introduction and Results would benefit from more concrete details regarding some of the key concepts being introduced. For example, in the third paragraph, there is much discussion of contextual cues, but no delineation of specific cues that have been used in the literature and why some may be more effective than others (e.g., lead-ins or follow-throughs versus static color cues). Even as a member of the motor learning community, I was left wondering what you were specifically referring to. The overall effect is that the writing comes off as dry and likely impenetrable to someone outside of our small discipline. Also, as mentioned earlier, there does not appear to be a justification for E2, which also presents a barrier to the reader fully engaging with the study as currently presented.

-If you are proposing an ultra-slow process, shouldn’t the parameter for A_us be constrained such that A_us > A_slow? I see in Table 1 that A_us is actually lower than A_slow. This doesn’t seem to follow the logic of having separate processes acting on different timescales, i.e., learning slower and retaining more or vice versa. I’m not sure how much this would affect the results, but some explanation seems appropriate.

-Why was the mean force compensation across the two cues subtracted from the raw force compensation? And why process only forces this way, as it appears kinematic errors were left alone?

-Although the “stages” and “cues” used in the ANOVAs were clearly explained, there was no mention of what specific movement cycles were used in the analyses in the main text. This seems important to report as the effect sizes for spontaneous recovery do not appear very large.

-The paragraph beginning on line 499 is a clear example of conflating adaptation with skill learning. Perhaps either flesh out the connection you would like to make in order to make the analogy to real world activities more convincing, or consider supplying appropriate caveats to your current interpretation.

Minor concerns:

-The A and B panels are flipped in Figure 2.

-Caption for Figure 1 mentions contextual cues 1 and 2, but there has still been no mention of what these cues are.

-There’s a word or two missing in lines 545-548. This sentence overall is difficult to understand.

Reviewer #3: This study investigated the memory structure when adapting to the opposing dynamics during reaching movements. A previous study (Lee & Schweighofer, J Neurosci 2009) has proposed that the motor memory for the opposing visual rotation has a single fast and double slow motor memory. The authors tested the validity of this model by employing A-B-Error clamp experimental paradigm within dual-task adaptation. Contrary to the prediction by the previously proposed model, the authors observed the spontaneous recovery, clearly indicating the presence of two-fast memory states. They also fit various types of multi-rate models to the data and found the model with two fast, slow, and ultra-slow time constants best explained the data. This is an interesting study demonstrating a new aspect of motor memory structure, and the experiment and analysis were well designed. As described below, however, I would like to raise several issues, especially for the interpretation of the motor memory structure.

Major points

1) I was confused about the idea that motor memory has a discrete number of processes (e.g., two fast and slow processes). What does it mean? In the current experiment, the distance between the starting positions (i.e., visual workspace) was 20 cm. However, if the distance was 0 cm, different motor memories cannot be created. These facts indicate that different motor memories are likely to be created depending on the visual workspace. If it is the case, an infinite number of discrete processes seems necessary. The presence of two processes shown in this study is an epiphenomenon caused by the experimental design using just two contextual cues? How reasonable is assuming the memory has just two processes?

2) The more natural idea would be to assume that the motor memories are composed of fast and slow (and ultra-slow) motor primitives (Thoroughman & Shadmehr, Nature 2000), and these motor primitives are recruited depending on visual workspaces. Then, the problem to be questioned here should be how the primitives are recruited rather than the number of processes. I think that the model proposed in the present study is the approximation of such a motor primitive based model (i.e., the parameter ‘c’ is likely to reflect the way of encoding of visual workspace in the primitives). It seems a little bit odd to me that the motor memory has just two processes, and the contribution of each process is modulated with the visual cue. I do not think the authors need to change the whole story, but I would suggest that the authors mention the discussion on this issue.

Minor points

1) Line 216: The comma should be removed?

2) Line 551: The “)” seems necessary after “[38]”.

3) Line 787: “In” should be removed?

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: None

Reviewer #2: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, PLOS recommends that you deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions, please see http://journals.plos.org/compbiol/s/submission-guidelines#loc-materials-and-methods

Attachments
Attachment
Submitted filename: comments.docx
Revision 1

Attachments
Attachment
Submitted filename: MForano_Answer_to_Reviewers.pdf
Decision Letter - Adrian M Haith, Editor, Samuel J. Gershman, Editor

Dear Mrs. Forano,

Thank you very much for submitting your manuscript "Timescales of motor memory formation in dual-adaptation" for consideration at PLOS Computational Biology.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. The revisions have substantially improved the paper, and the reviewers were mostly satisfied that their concerns have been resolved. However, Reviewer 1 raised some valid concerns regarding parameter bounds used in fitting the model and whether these might influence the conclusions of the paper. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Adrian M Haith

Associate Editor

PLOS Computational Biology

Samuel Gershman

Deputy Editor

PLOS Computational Biology

***********************

Reviewer's Responses to Questions

Comments to the Authors:

Reviewer #1: review uploaded as attachment

Reviewer #2: I found the revised manuscript to be much clearer and easier to read than the original submission, and I appreciate the changes the authors made based on our suggestions. The additional discussion of previous literature related to contextual interference and ideas surrounding multiple paired models helped me better contextualize the current findings. In addition, the parameter recovery analysis and new figures strengthened the authors’ overall interpretation of their findings.

Below are additional suggestions and minor comments for the authors to consider:

- I suggest redoing Fig. S5 and including a revised version in the main text. Due to the compression of the x-axes, the simulations are not nearly as clear or informative as they could be. Have the authors considered selecting a subset of their models and showing them in a more expanded form in the main text? The remaining models (or all of them) could remain a supplementary figure, with fewer columns and more rows.

Minor:

- The font in the tables is too small and difficult to read without zooming in.

- The language used to describe best-fit models was not always clear. For example, lines 285-286: “…out of ten participant, nine participants equally chose the…” The italicized portion is what I’m referring to. Also, here and throughout, the authors describe participants “choosing” their models. Wouldn’t it be more accurate, and less idiosyncratic, to write in these cases something like “…the X model provided the best fit to a out of b participants.”

- L381: I would replace “deeper” with “greater” or “more”. I wasn’t clear about what “deeper” meant until looking at the figure.

- L551: This sentence was difficult to parse, especially the reference to “in the concept of single adaptation”.

Reviewer #3: I am satisfied with the authors’ explanation regarding the interpretation of multiple motor memories. I have no further concerns.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: Yes

Reviewer #2: None

Reviewer #3: None

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, PLOS recommends that you deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions, please see http://journals.plos.org/compbiol/s/submission-guidelines#loc-materials-and-methods

Revision 2

Attachments
Attachment
Submitted filename: MForano_Manuscript_Response_to_Reviewers.pdf
Decision Letter - Adrian M Haith, Editor, Samuel J. Gershman, Editor

Dear Mrs. Forano,

We are pleased to inform you that your manuscript 'Timescales of motor memory formation in dual-adaptation' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Note that Reviewer 1 had one remaining request for clarification which you may wish to address in your final version.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Adrian M Haith

Associate Editor

PLOS Computational Biology

Samuel Gershman

Deputy Editor

PLOS Computational Biology

***********************************************************

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: My comments are uploaded as an attachment.

Reviewer #2: I am satisfied with all of the changes made to the manuscript and have no further suggestions.

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: None

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Attachments
Attachment
Submitted filename: comments.docx
Formally Accepted
Acceptance Letter - Adrian M Haith, Editor, Samuel J. Gershman, Editor

PCOMPBIOL-D-20-00086R2

Timescales of motor memory formation in dual-adaptation

Dear Dr Forano,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Laura Mallard

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .