Peer Review History
| Original SubmissionSeptember 5, 2019 |
|---|
|
Dear Dr Loossens, Thank you very much for submitting your manuscript 'The Affective Ising Model: a Computational Account of Human Affect Dynamics' for review by PLOS Computational Biology. Your manuscript has been fully evaluated by the PLOS Computational Biology editorial team and in this case also by independent peer reviewers. The reviewers appreciated the attention to an important problem, but raised some substantial concerns about the manuscript as it currently stands. While your manuscript cannot be accepted in its present form, we are willing to consider a revised version in which the issues raised by the reviewers have been adequately addressed. We cannot, of course, promise publication at that time. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. Your revisions should address the specific points made by each reviewer. Please return the revised version within the next 60 days. If you anticipate any delay in its return, we ask that you let us know the expected resubmission date by email at ploscompbiol@plos.org. Revised manuscripts received beyond 60 days may require evaluation and peer review similar to that applied to newly submitted manuscripts. In addition, when you are ready to resubmit, please be prepared to provide the following: (1) A detailed list of your responses to the review comments and the changes you have made in the manuscript. We require a file of this nature before your manuscript is passed back to the editors. (2) A copy of your manuscript with the changes highlighted (encouraged). We encourage authors, if possible to show clearly where changes have been made to their manuscript e.g. by highlighting text. (3) A striking still image to accompany your article (optional). If the image is judged to be suitable by the editors, it may be featured on our website and might be chosen as the issue image for that month. These square, high-quality images should be accompanied by a short caption. Please note as well that there should be no copyright restrictions on the use of the image, so that it can be published under the Open-Access license and be subject only to appropriate attribution. Before you resubmit your manuscript, please consult our Submission Checklist to ensure your manuscript is formatted correctly for PLOS Computational Biology: http://www.ploscompbiol.org/static/checklist.action. Some key points to remember are: - Figures uploaded separately as TIFF or EPS files (if you wish, your figures may remain in your main manuscript file in addition). - Supporting Information uploaded as separate files, titled Dataset, Figure, Table, Text, Protocol, Audio, or Video. - Funding information in the 'Financial Disclosure' box in the online system. While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see here. We are sorry that we cannot be more positive about your manuscript at this stage, but if you have any concerns or questions, please do not hesitate to contact us. Sincerely, Jacopo Grilli Associate Editor PLOS Computational Biology Stefano Allesina Deputy Editor PLOS Computational Biology A link appears below if there are any accompanying review attachments. If you believe any reviews to be missing, please contact ploscompbiol@plos.org immediately: [LINK] Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: The Affective Ising Model: a Computational Account of Human Affect Dynamics (PCOMPBIOL-D-19-01513 – Review) This article proposes a nonlinear stochastic model for studying the dynamics of affect in humans, labeled by the authors the Affective Ising Model (AIM). The model is based on neurophysiological and behavioral fundamentals underlying positive and negative affect, and is a model that can account for various types of manifestations of affect such as skewness, multimodality, and non-linear relations of positive and negative affect. As part of their illustration, the authors implement the model to two empirical data sets of affect from experience sampling studies, and examine the extent to which it can reproduce the various manifestations of affect, comparing it with two vector AR models fitted in continuous time. The findings indicate that the AIM model is better at mapping onto manifestations of affect data (especially non-Gaussian manifestations) than the AR models, and it has a higher predictive value for the time series of affect. I liked this paper very much. I think it can make a very important contribution to our theoretical understanding of affect dynamics. My main concern has to do with the format. In its current form, the paper is a bit overwhelming. It is excessively long, with a very large number of figures (19 currently). Some sections read more like a technical report, whereas other sections (i.e., implementation of the model) are more manuscript-type, and very engaging. A full description of the model and its underpinnings needs space, and at times it feels like part of the supplementary material should be included in the main paper as well. On the other hand, combining this explanation and the technical details with the implementation of the model to the two data sets, makes the paper a bit unwieldly. I wonder if it would make sense to split the manuscript into two papers. One could be a more technical paper with all the necessary details, including those from the appendix about fitting the model. The other paper could focus on the implementation of the model to the empirical data sets, comparing the results with those from the two AR models, and fleshing out the implications in terms of affect dynamics. Reviewer #2: In “The Affective Ising Model: A computational account of human affect dynamics”, the authors present a novel computational model for describing and predicting dynamics in self-reported affect. In the process of introducing their model, they analyze two sets of experience sampling data in order to demonstrate the ability of the Affective Ising Model (AIM) to accurately capture observed self-reported affect dynamics and compare the AIM’s performance to other widely used methods of modeling such data. Overall, the manuscript is well-written and makes an interesting and important contribution to the affective sciences. However, there are a number of issues that I believe deserve greater consideration and clarification. The authors should provide additional explanation/resources to aid other researchers in the practical implementation of their model. Additionally, the current manuscript does not adequately address how the model and its parameters should be understood and interpreted in relation to other work or what findings might suggest either future revision or falsification. Last, there remain questions of the model’s predictive abilities, stemming from the fact that the model is likely most properly understood as a model of dynamics in self-reported affect. I elaborate each of these points below. Overall, I am enthusiastic about the work that the authors have done and believe that efforts to incorporate computational modeling to dynamics in experience sampling such as this will be critical for moving work in this area forward. The authors do a noteworthy and commendable job of describing their model is a way that facilitates an intuitive understanding for readers. In fact, it’s so intuitively described that it’s almost easy to overlook the challenges of practical implementation. To enable other researchers (especially those who are newer to these sorts of models) to use and critique novel computational models, it is important for authors to provide access to materials such as code. This is especially useful because many researchers find actual code as the clearest means for learning the ins and outs of a model, aside from the more formal mathematical description. Therefore, I request that the authors provide access to code for their model. While the full code would likely be the most helpful, a stripped-down version and/or pseudocode, if possible, (e.g., as in Turner et al., 2013, Psychological Methods) could also be helpful. Additionally, a supplement detailing practical challenges, requirements, and limitations for implementing the model would be beneficial. Presenting a model such as the AIM without discussing any of the practical aspects will limit its usage among other research groups. On the topic of clear explication of their model, it was not entirely clear to me how inputs to the model are handled. The authors explicitly state that they avoid discussing inputs in this manuscript, but I believe a discussion of how this might be done warrants greater discussion. Could the authors elaborate on how external events might be fed into the model? Can they provide some proposals for how researchers might code external events? The discussion of this (lines 817-822) could be developed a bit further. The authors spend a significant portion of the Model Description section justifying the AIM as a computational model that seeks to describe macroscopic phenomena and not the “microscopic” component processes. To help clarify the objectives of their model to readers, it would likely be useful for the authors to draw on already established frameworks such as Marr’s (1982) levels of analysis, as has been done elsewhere in the emotions literature (e.g., Adolphs & Andler, 2018; Bach & Dayan, 2017). Using Marr’s labels, it seems then that the AIM is meant for an algorithmic level of analysis as it does not appear to make claims about either the purpose of the algorithm or its neural implementation. Related to the question of levels of analysis is the question of how the authors believe their model might be informed by research at other levels of analysis. Given the emphasis on the fact that the AIM is intended to capture macroscopic phenomena and not their microscopic components, it would be useful to know whether or not the authors expect research at other levels of analysis to inform, modify, or constrain their model in the future. This question ties into a broader question about falsifiability. For example, are there “affective landscapes” which the AIM cannot produce? (e.g., tri-modal?) As the authors show, constraining the values of the “inhibition” parameter rules out landscapes where PA and NA are positively correlated. However, the participants in their own dataset who showed a positive correlation and other research (e.g., arousal-focused individuals; Barrett & Bliss-Moreau, 2009) would seem to suggest that this parameter constraint should eventually be relaxed. The authors do not provide much in the way of discussion of possible psychological interpretations of the model parameters. Perhaps this is because the authors expect that there are no direct concept to parameter mappings, only indirect (e.g., Roberts & Hutcherson, 2019). If this is the case, the authors should be explicit about the reasons for their reticence to speculate about how their model’s parameters connect to psychological concepts so that readers can be directed to use the same caution. Do the authors believe that no psychological interpretations should be given to the model parameters and that only features of the resulting “affective landscape” should be given psychological meaning (e.g., the possibility of multiple homebases in patients with borderline personality disorder mentioned in lines 842-847)? The manuscript should offer greater clarity about how the model might be used and interpreted as any readers will certainly want to assign psychological meaning to the parameters. The authors compare their model to two other models that are Gaussian, with or without bounds. One of the highlighted strengths of the AIM is its ability to deal with the boundedness of the data and produce the observed skewness. However, this demonstration raises the unanswered question of to what degree these aspects of the data are due to affective dynamics versus due to how people use the sorts of self-report scales they are provided. To be clear, I do not doubt that affective experience is non-normally distributed. However, it seems highly likely that some of the distributional features of the data are also contributed to by the self-report measures themselves. For example, though participants may use the most extreme response for negative affect on an occasion, is this capturing their most extreme possible level of negative affect? Similarly, though participants appear to frequently report no negative or positive affect at all, is this truly their “flattest” affective experience? All of this suggests the subtle, yet important, distinction between a model of affective dynamics versus a model of dynamics in self-reported affect. I do not see this point as an invalidation of the AIM, but realizing this distinction raises important additional questions. For example, if the AIM is a model of dynamics in self-reported affect, how might a person’s “affective landscape” be influenced by changes to the self-report measure (e.g., scale anchors, items, etc.)? Will fitting the AIM to an individual’s data collected using one self-report measure allow for accurate predictions of data collected using a different measure? If there are discrepancies in how the model fits to data derived from different measures, how should these be dealt with? It would seem important for the authors to acknowledge these questions and how they might be addressed. A couple other minor points are presented below: On lines 103-106, the authors state “Most likely the biological structures dealing with positive and negative affect information consist of a large number of smaller elements (neurons, neurotransmitters, hormones, etc.) that in interaction with psychological processes produce positive and negative feelings.” I acknowledge that my objection here is possibly a bit idiosyncratic, but I always have trouble understanding what is meant by a sentence such as this. Presumably the authors agree that biological structures such as neurons, neurotransmitters, and hormones are part of the material substrates for psychological processes. So what is meant by neurons interacting with psychological processes? To me this sounds like a subset of elements interacting with their superset, which does not make sense to me. Do the authors mean to say something about how psychological processes are constrained by aspects of their biological underpinnings? Or how features of the biological structures interact with an organism’s broader ecology and history? The sentence on lines 189-191 appears to be missing a “the”: “As a result, absorbing such an input process into THE model does not affect the model’s 190 properties (e.g., structure, dynamics, distributions, etc.).” ********** Have all data underlying the figures and results presented in the manuscript been provided? Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information. Reviewer #1: Yes Reviewer #2: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No |
| Revision 1 |
|
Dear Mr Loossens, We are pleased to inform you that your manuscript 'The Affective Ising Model: a Computational Account of Human Affect Dynamics' has been provisionally accepted for publication in PLOS Computational Biology. Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests. Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated. IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript. Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS. Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. Best regards, Jacopo Grilli Associate Editor PLOS Computational Biology Stefano Allesina Deputy Editor PLOS Computational Biology *********************************************************** Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #2: The authors’ revisions have greatly enhanced the overall clarity of the manuscript and helped to highlight key questions that will need to be addressed in future work. I have no further questions or concerns to raise at this point. I recommend acceptance of this manuscript for publication. ********** Have all data underlying the figures and results presented in the manuscript been provided? Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information. Reviewer #2: None ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No |
| Formally Accepted |
|
PCOMPBIOL-D-19-01513R1 The Affective Ising Model: a Computational Account of Human Affect Dynamics Dear Dr Loossens, I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course. The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work! With kind regards, Laura Mallard PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .