Peer Review History
| Original SubmissionFebruary 11, 2020 |
|---|
|
Dear Dr Yu, Thank you for submitting your manuscript entitled "Delay-period activity in frontal, parietal, and occipital cortex tracks different attractor dynamics in visual working memory" for consideration as a Short Report by PLOS Biology. Your manuscript has now been evaluated by the PLOS Biology editorial staff, as well as by an Academic Editor with relevant expertise, and I am writing to let you know that we would like to send your submission out for external peer review. However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire. Please re-submit your manuscript within two working days, i.e. by Feb 18 2020 11:59PM. Login to Editorial Manager here: https://www.editorialmanager.com/pbiology During resubmission, you will be invited to opt-in to posting your pre-review manuscript as a bioRxiv preprint. Visit http://journals.plos.org/plosbiology/s/preprints for full details. If you consent to posting your current manuscript as a preprint, please upload a single Preprint PDF when you re-submit. Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. Once your manuscript has passed all checks it will be sent out for review. Feel free to email us at plosbiology@plos.org if you have any queries relating to your submission. Kind regards, Gabriel Gasque, Ph.D., Senior Editor PLOS Biology |
| Revision 1 |
|
Dear Dr Yu, Thank you very much for submitting your manuscript "Delay-period activity in frontal, parietal, and occipital cortex tracks different attractor dynamics in visual working memory" for consideration as a Short Report at PLOS Biology. Your manuscript has been evaluated by the PLOS Biology editors, by an Academic Editor with relevant expertise, and by three independent reviewers. You will note that reviewers 1 and 2, Edward Ester and Edward Vogel, have signed their comments. The reviews of your manuscript are appended below. As you will see, the referees raise significant technical concerns that could impact the interpretation of results. In addition, they see a need for additional controls or control analyses to rule out potential confounds of design (such as sampling from nine orientations with minor jitter), as studies have shown that participants can acquire long-term memories representations of memoranda. Also, reviewer 3 thinks the study has major limitations as the drift diffusion model is applied to fit data from a single time point and refers to other studies that show drift or bias that don't involve working memory. While we are open to consider a revision that addresses these points, we would only be able to pursue eventual publication if these are addressed exhaustively and you manage to persuade our reviewers about the robustness of the study. We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript would be sent for further evaluation by the reviewers. We appreciate that these requests represent a great deal of extra work, and we are willing to relax our standard revision time to allow you six months to revise your manuscript.We expect to receive your revised manuscript within 6 months. Please email us (plosbiology@plos.org) if you have any questions or concerns, or would like to request an extension. At this stage, your manuscript remains formally under active consideration at our journal; please notify us by email if you do not intend to submit a revision so that we may end consideration of the manuscript at PLOS Biology. **IMPORTANT - SUBMITTING YOUR REVISION** Your revisions should address the specific points made by each reviewer. Because this is a Short Report, please keep the number of main figures to a maximum of four. Please submit the following files along with your revised manuscript: 1. A 'Response to Reviewers' file - this should detail your responses to the editorial requests, present a point-by-point response to all of the reviewers' comments, and indicate the changes made to the manuscript. *NOTE: In your point by point response to the reviewers, please provide the full context of each review. Do not selectively quote paragraphs or sentences to reply to. The entire set of reviewer comments should be present in full and each specific point should be responded to individually, point by point. You should also cite any additional relevant literature that has been published since the original submission and mention any additional citations in your response. 2. In addition to a clean copy of the manuscript, please also upload a 'track-changes' version of your manuscript that specifies the edits made. This should be uploaded as a "Related" file type. *Resubmission Checklist* When you are ready to resubmit your revised manuscript, please refer to this resubmission checklist: https://plos.io/Biology_Checklist To submit a revised version of your manuscript, please go to https://www.editorialmanager.com/pbiology/ and log in as an Author. Click the link labelled 'Submissions Needing Revision' where you will find your submission record. Please make sure to read the following important policies and guidelines while preparing your revision: *Published Peer Review* Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. Please see here for more details: https://blogs.plos.org/plos/2019/05/plos-journals-now-open-for-published-peer-review/ *PLOS Data Policy* Please note that as a condition of publication PLOS' data policy (http://journals.plos.org/plosbiology/s/data-availability) requires that you make available all data used to draw the conclusions arrived at in your manuscript. If you have not already done so, you must include any data used in your manuscript either in appropriate repositories, within the body of the manuscript, or as supporting information (N.B. this includes any numerical values that were used to generate graphs, histograms etc.). For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5 *Blot and Gel Data Policy* We require the original, uncropped and minimally adjusted images supporting all blot and gel results reported in an article's figures or Supporting Information files. We will require these files before a manuscript can be accepted so please prepare them now, if you have not already uploaded them. Please carefully read our guidelines for how to prepare and upload this data: https://journals.plos.org/plosbiology/s/figures#loc-blot-and-gel-reporting-requirements *Protocols deposition* To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosbiology/s/submission-guidelines#loc-materials-and-methods Thank you again for your submission to our journal. We hope that our editorial process has been constructive thus far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments. Sincerely, Gabriel Gasque, Ph.D., Senior Editor PLOS Biology ***************************************************** REVIEWS: Reviewer #1: Synopsis: Yu et al. use a novel modeling approach to estimate parameters for bias and variance in an orientation recall task, then examine how these parameters co-vary with memory-load-dependent changes in frontoparietal BOLD activity during the delay period of the task. They find that load-dependent changes in frontoparietal activity are correlated with both variance and bias, with the former explaining a larger proportion of variance than the latter. Moreover, they report that overall activation in lateral occipital cortex is best predicted by bias. Evaluation: This paper makes novel use of a new model that provides a good description of working memory performance in humans and monkeys. Determining the why and how of load-dependent changes in delay period activity is an important goal - dozens if not hundreds of studies have documented load-dependent changes in activation during WM task, yet a detailed explanation for these changes is lacking. I have two major concerns about this paper. The first is technical and focuses on whether it's fair for the authors to apply their DDM model to the current data set. The second is conceptual and focuses on what these data tell us about the structure of working memory or models thereof. I'm happy to clarify my comments and/or have a dialogue with the authors if it'd be helpful. Best wishes, Edward Ester, Florida Atlantic University Majors: 1. Is it fair to apply the DDM to these data? As I understand it, the DDM used by the authors is constructed to explain bias and variance in subjects' responses under the assumption that to-be-reported items are uniformly sampled from a fixed parameter space - in this case, orientations on the interval [0,pi). Yet the orientations sampled here were preferentially drawn from subdistributions centered on 9 orientations (aside: was the jitter added to each orientation on each trial uniformly or normally distributed? I couldn't find this information in the manuscript). This creates two potential problems: the first and largest concern is that nonuniform sampling it could encourage bias in participants' orientation reports towards the nine "pedestal" orientations - e.g., participants are more likely to report a 23° stimulus as 20° because they've repeatedly seen exemplars drawn from a distribution centered on 20° - and this would result in biased parameter estimates. The second concern is that even if one assumes that participants' reports track the actual target values on each trial, it's not clear whether or how well the Panichello et al. model works in a nonuniform stimulus space. For example, does the model require uniform sampling? Does nonuniform sampling introduce additional bias or variance into parameter estimates? This absolutely needs to be worked out (and could presumably be done via simulation); otherwise it's very difficult to accurately interpret correlations between model parameters and BOLD data. 2. Setting aside #1, I'm having a hard time understanding the implications of the study. The key points are that model estimates of variance correlate with load-dependent changes in the BOLD signal in frontoparietal cortex, and that model estimates of bias correlate with load-dependent changes in lateral occipital cortex. What are the implications of these findings? For example, some of the authors on this paper have previously advocated for a model where frontoparietal cortical areas coordinate memory storage in posterior sensory areas. On that account, I would've predicted frontoparietal areas to correlate more strongly with bias and visual areas to correlate with variance (e.g., frontoparietal areas implement bias to account for more variability in sensory areas during higher memory loads). As-is, I'm not sure what the current findings tell us about the architecture of working memory, other than that different brain areas correlate more strongly with different latent parameters. Some additional context and explanation is necessary. Minors: 1. If space allows, it'd be helpful to include a brief introduction to the drift-diffusion model (DDM) in the main text and a mathematical derivation in the methods. I hadn't read the Panichello et al. paper prior to reviewing this study (though it's been on my "reading list" for a while), and the term "drift-diffusion model" has a storied history in the perceptual decision making literature (e.g., Ratcliff and others). Initially I thought the authors were going to be modeling forced-choice reaction time data and mapping those parameters on to BOLD activation, which led to some considerable head-scratching during my first read of the introduction and results. 2. As Panichello et al. show, the DDM approach does a nice job of capturing biases in color report data. I'm less certain it generalizes to orientation, especially given that orientations weren't uniformly sampled in this experiment. For example, can the DDM capture well-known cardinal biases in delayed orientation reports (e.g., reported in multiple studies by Rademaker, Pratte, Landy, et al?). This strikes at the question of whether it's fair to model the current data with the DDM. Reviewer #2: Signed review by Ed Vogel This article examines how a drift and diffusion model of within subject variation in working memory precision for orientation corresponds to delay period BOLD increases across cortex driven by item load (1 vs 3). The key finding is that while evidence for drift and diffusion were observed in frontal and parietal areas, diffusion explained most of the variance. By contrast, drift explained most of the variance in LO. Overall, I think this is a very interesting and important study because it connects variation in WM behavioral precision to neural activity in a rigorous and model driven approach. The application of the DDM'd error performance to BOLD load activations is clever and novel. I found that the study narrative is clear and easy to follow and that the frontal and parietal results are very compelling. My chief concern is the interpretation of the LO results, most of which are "trending" in significance. I guess I'm not all that comfortable embracing the .08 as trending for drift while at the same time rejecting the .18 for diffusion. Of course, I think it is still important to report these results. However, I think some softening of the general conclusion that the results support a dichotomy is warranted. Perhaps related to the above point, I have some uncertainty about whether the smaller and shorted lived BOLD delay period signal in LO is impacting the fits to the behavioral models as compared to the larger longer lasting activation in PFC/PPC. More broadly, do increases in SNR (e.g., BOLD increase with load) equivalently impact the how the two models fare in predicting variance? Reviewer #3: This study examines behavioral and fMRI data from an experiment testing working memory for orientation. The behavioral responses are fit with a recently-proposed dynamical model of working memory based on drift-diffusion to stable attractors (Panichello et al., 2019) and correlations are identified between these parameters and BOLD actiivity in different brain regions. This is a novel and (in principle) promising approach, but unfortunately the study has a major flaw: although the model is dynamical the data is not, i.e. experimental delay time is fixed and the BOLD correlation analysis is based on averaging over a fixed time window. Because the drift-diffusion model is fit to a single timepoint, the diffusion component presumably is simply measuring mean variability of recall errors and the drift component measuring the strength of stimulus-specific biases. Although only target-averaged response distributions are plotted (in Fig 1B) the pattern is consistent with a repulsive bias away from the cardinal orientations. This is a well-documented phenomenon for orientation judgments, not just in short-term memory (e.g. Taylor & Bays, J Neurosci, 2018) but also in immediate perceptual judgments (e.g. Tommasini et al, Vis Res, 2010) with no memory component and no delay interval - implying that temporal drift is unlikely to be responsible. It is also questionable whether difusion makes much of a contribution to error variability in this data, with some studies claiming the effects of delay are weak to non-existent (e.g. Shin, Zou & Ma, J Vis, 2017). Perhaps the authors could consider a complete reframing of the paper in terms of brain regions that correlate with (direct measures of) error variability vs biases. |
| Revision 2 |
|
Dear Dr Yu, Thank you for submitting your revised Short Report entitled "Delay-period activity in frontal, parietal, and occipital cortex track different aspects of attractor dynamics in visual working memory" for publication in PLOS Biology. I have now obtained advice from the original reviewers and have discussed their comments with the Academic Editor. You will note that all reviewers --Edward Ester, Ed Vogel, and Paul Bays-- have signed their comments. Based on the reviews, we are positive about your manuscript. However, before committing to publication, we think you should modify the manuscript to address the remaining points raised by reviewer 3. In addition, the editors request changes to your title and abstract to make them more accessible to a general biology audience. See below for details. Please also make sure to address the data and other policy-related requests noted at the end of this email. We expect to receive your revised manuscript within two weeks. ***IMPORTANT INFORMATION FOR YOUR REVISION Your revisions should address the specific points made by reviewer 3 by modifying your discussion. In addition, we would like to you consider changing your title and modifying your abstract. I have written one suggestion here, but we'd be happy to discuss alternatives: Title suggestion: "Imprecision in working memory can be explained by a combination of noise in frontoparietal cortex and stimulus-related biases in occipital cortex." Regarding the Abstract, I generated this proposal. Please excuse any imprecision and feel free to improve it. The main idea is to make it more accesible by focusing on the high-level biological problem and then delving into the specifics. Abstract suggestion: "Working memory is imprecise, and these imprecisions can be explained by diffusion from noise in the neural representation of memorized items and mitigated if memories are stored using a finite set of stable states known as discrete attractors. However, the neural activity that represents random diffusion and drift towards stable attractor states remains unknown. One important neural hallmark of working memory is persistent elevated delay-period activity in frontal and parietal cortex, and previous work has found that frontal and parietal delay-period activity correlates with the decline in behavioral memory precision observed with increasing memory load. Therefore, we set to investigate if frontoparietal and occipital delayed activity can explain different aspects of error sources in working memory. We analyzed data from an existing experiment in which subjects performed delayed recall for line orientation, at different loads, during fMRI scanning. We modeled subjects’ behavior using a discrete attractor model and calculated within-subject correlation between frontal and parietal delay-period activity and the drift and diffusion sources of memory error. We found that although increases in frontal and parietal activity were associated with increases in both diffusion and drift, diffusion explained the most variance in frontal and parietal delay-period activity. In comparison, a subsequent whole-brain regression analysis showed that drift rather than diffusion explained the most variance in delay-period activity in lateral occipital cortex. These results thus show that imprecision in working memory can be caused by a combination of effects of noise in frontoparietal cortex and of stimulus-related biases in occipital cortex." Please submit the following files along with your revised manuscript: 1. A 'Response to Reviewers' file - this should detail your responses to the editorial requests, present a point-by-point response to all of the reviewers' comments, and indicate the changes made to the manuscript. *NOTE: In your point by point response to the reviewers, please provide the full context of each review. Do not selectively quote paragraphs or sentences to reply to. The entire set of reviewer comments should be present in full and each specific point should be responded to individually, point by point. 2. In addition to a clean copy of the manuscript, please also upload a 'track-changes' version of your manuscript that specifies the edits made. This should be uploaded as a "Related" file type. In addition to the remaining revisions and before we will be able to formally accept your manuscript and consider it "in press", we also need to ensure that your article conforms to our guidelines. A member of our team will be in touch shortly with a set of requests. As we can't proceed until these requirements are met, your swift response will help prevent delays to publication. *Copyediting* Upon acceptance of your article, your final files will be copyedited and typeset into the final PDF. While you will have an opportunity to review these files as proofs, PLOS will only permit corrections to spelling or significant scientific errors. Therefore, please take this final revision time to assess and make any remaining major changes to your manuscript. NOTE: If Supporting Information files are included with your article, note that these are not copyedited and will be published as they are submitted. Please ensure that these files are legible and of high quality (at least 300 dpi) in an easily accessible file format. For this reason, please be aware that any references listed in an SI file will not be indexed. For more information, see our Supporting Information guidelines: https://journals.plos.org/plosbiology/s/supporting-information *Published Peer Review History* Please note that you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. Please see here for more details: https://blogs.plos.org/plos/2019/05/plos-journals-now-open-for-published-peer-review/ *Early Version* Please note that an uncorrected proof of your manuscript will be published online ahead of the final version, unless you opted out when submitting your manuscript. If, for any reason, you do not want an earlier version of your manuscript published online, uncheck the box. Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us as soon as possible if you or your institution is planning to press release the article. *Protocols deposition* To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosbiology/s/submission-guidelines#loc-materials-and-methods *Submitting Your Revision* To submit your revision, please go to https://www.editorialmanager.com/pbiology/ and log in as an Author. Click the link labelled 'Submissions Needing Revision' to find your submission record. Your revised submission must include a cover letter, a Response to Reviewers file that provides a detailed response to the reviewers' comments (if applicable), and a track-changes file indicating any changes that you have made to the manuscript. Please do not hesitate to contact me should you have any questions. Sincerely, Gabriel Gasque, Ph.D., Senior Editor PLOS Biology ------------------------------------------------------------------------ ETHICS STATEMENT: -- Please indicate within your manuscript the ID number of the protocols approved by the University of Wisconsin–Madison Health Sciences Institutional Review Board. -- Please indicate within your manuscript if your protocols approved by the University of Wisconsin–Madison Health Sciences Institutional Review Board adhered to the Declaration of Helsinki or any other national or international ethical guidelines. ------------------------------------------------------------------------ DATA POLICY: You may be aware of the PLOS Data Policy, which requires that all data be made available without restriction: http://journals.plos.org/plosbiology/s/data-availability. For more information, please also see this editorial: http://dx.doi.org/10.1371/journal.pbio.1001797 Note that we do not require all raw data. Rather, we ask for all individual quantitative observations that underlie the data summarized in the figures and results of your paper. For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5 These data can be made available in one of the following forms: 1) Supplementary files (e.g., excel). Please ensure that all data files are uploaded as 'Supporting Information' and are invariably referred to (in the manuscript, figure legends, and the Description field when uploading your files) using the following format verbatim: S1 Data, S2 Data, etc. Multiple panels of a single or even several figures can be included as multiple sheets in one excel file that is saved using exactly the following convention: S1_Data.xlsx (using an underscore). 2) Deposition in a publicly available repository. Please also provide the accession code or a reviewer link so that we may view your data before publication. Regardless of the method selected, please ensure that you provide the individual numerical values that underlie the summary data displayed in the following figure panels: Figures 1B-C, 2A-D, 3A-E, S1, S2, S3, S4, S5, S6A-D, S7A-D, and S8A-D. NOTE: the numerical data provided should include all replicates AND the way in which the plotted mean and errors were derived (it should not present only the mean/average values). Please also ensure that each figure legend in your manuscript include information on where the underlying data can be found and ensure your supplemental data file/s has a legend. Please ensure that your Data Statement in the submission system accurately describes where your data can be found. ------------------------------------------------------------------------ Reviewer remarks: Reviewer #1, Edward Ester: The authors have addressed my earlier comments re: the modeling approach to my satisfaction, and have done an admirable job responding to other reviewers' comments (including several new analyses and an analysis of third-party data to support their arguments). I have no further concerns and congratulate the authors on a nice study! Reviewer #2: I am happy with this version of the manuscript. The authors did a nice job of responding to the prior round of reviews. I have no remaining concerns. I feel that this work will have a substantial impact on the field. Ed Vogel Reviewer #3, Paul Bays: See attachment. |
| Revision 3 |
|
Dear Dr Yu, On behalf of my colleagues and the Academic Editor, Frank Tong, I am pleased to inform you that we will be delighted to publish your Short Reports in PLOS Biology. The files will now enter our production system. You will receive a copyedited version of the manuscript, along with your figures for a final review. You will be given two business days to review and approve the copyedit. Then, within a week, you will receive a PDF proof of your typeset article. You will have two days to review the PDF and make any final corrections. If there is a chance that you'll be unavailable during the copy editing/proof review period, please provide us with contact details of one of the other authors whom you nominate to handle these stages on your behalf. This will ensure that any requested corrections reach the production department in time for publication. Early Version The version of your manuscript submitted at the copyedit stage will be posted online ahead of the final proof version, unless you have already opted out of the process. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. PRESS We frequently collaborate with press offices. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximise its impact. If the press office is planning to promote your findings, we would be grateful if they could coordinate with biologypress@plos.org. If you have not yet opted out of the early version process, we ask that you notify us immediately of any press plans so that we may do so on your behalf. We also ask that you take this opportunity to read our Embargo Policy regarding the discussion, promotion and media coverage of work that is yet to be published by PLOS. As your manuscript is not yet published, it is bound by the conditions of our Embargo Policy. Please be aware that this policy is in place both to ensure that any press coverage of your article is fully substantiated and to provide a direct link between such coverage and the published work. For full details of our Embargo Policy, please visit http://www.plos.org/about/media-inquiries/embargo-policy/. Thank you again for submitting your manuscript to PLOS Biology and for your support of Open Access publishing. Please do not hesitate to contact me if I can provide any assistance during the production process. Kind regards, Alice Musson Publishing Editor, PLOS Biology on behalf of Gabriel Gasque, Senior Editor PLOS Biology |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .