Peer Review History
Original SubmissionJuly 1, 2021 |
---|
PONE-D-21-21470 How Minimizing Conflicts Could Lead to Polarization on Social Media: an Agent-Based Model Investigation PLOS ONE Dear Dr. Coscia, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Oct 03 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Kazutoshi Sasahara Academic Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability. Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized. Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access. We will update your Data Availability statement to reflect the information you provide in your cover letter. Additional Editor Comments (if provided): Although they find the proposed model interesting, both reviewers think the current manuscript needs more work. Reviewer1 suggested the validation of the model with the real-world data. Reviewer 2 suggested more investigations about relevant models. Please read their comments carefully and properly incorporate. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: No Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: N/A Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: In this work, the authors propose an agent-based model for studying polarization on social media. It considers two types of agents, namely users and news sources, as well different parameters to change several characteristics of the agents, such as users' volatility and news outlet integrity. The paper is well written and easy to understand. Although I appreciate the authors' effort, I am sorry to say not convinced about the validity and soundness of this work. First of all, as the authors wrote, their data are just the outcome of a simulation, except for some data taken by Crowdtangle to model the audience network. I suggest the authors compare their results with data from the real world to show that the model can mimic reality for some values of the parameters. Another issue I found is the differences between their results and other works working with real-world data. For example, results on users' polarization look different from the one obtained in some works, e.g Cinelli, Matteo, et al. "The echo chamber effect on social media." Proceedings of the National Academy of Sciences 118.9 (2021). This difference is quite high in all scenarios making unreliable all the speculation made by the authors. Moreover, the authors made some assumptions on the starting condition of the system without providing any explanation. One I do not agree with is the initial distribution of the polarity of users and news sources. Why they should be uniformly distributed? I have never seen such a case. Again, without any comparison with real-world data, this model seems to be purely theoretic, and thus the conclusion the authors made could be not valid for the real world. Some minor remarks: -authors wrote that the audience network is bipartite, but it is not represented as bipartite in figure 2a. I suggest the authors change this representation to underline the different nature of this network with respect to the social network. -authors provided results for a few values, and said that the model does not have significant changes outside the parameters reported. I would like to have an explanation of this behavior, especially because for some parameters (e.g. Reshareability) the range of values is very narrow. Reviewer #2: The authors present an agent-based model to study the complex interplay between users and news sources and how these interactions lead to polarization of both users and sources. This topic, social polarization, has received substantial attention in recent years and is of vital importance in many different fields. Overall, the paper is well-written with solid motivations and clearly exposed methods. The model hypothesis, based on the previous experimental studies, is reasonable. Depending on the values of the parameters, the model presents some interesting behaviors that might be important in real-world application, for example, higher shareability of policing content may produce higher levels of polarization. Therefore, I think it should be published. However, I have some criticisms and suggestions on the current manuscript which should be addressed first: 1. I have the feeling that the authors have an intimate knowledge of experimental and empirical studies while are not familiar with the relevant modeling literature. I suggest the authors add some reviews of the previous works on agent-based models of social polarization in Introduction to better highlight their innovations and original contributions, for instance: The following work also considered the coupling evolutions and the polarization of both users and news outlets: [1] AL Schmidt et al. "Anatomy of news consumption on Facebook." Proceedings of the National Academy of Sciences 114.12 (2017): 3035-3039. Some recent advances on social/political polarization using agent-based models: [2] X Wang et al. "Public discourse and social network echo chambers driven by socio-cognitive biases." Physical Review X 10.4 (2020): 041042. [3] K Sasahara et al. "Social influence and unfollowing accelerate the emergence of echo chambers." Journal of Computational Social Science 4.1 (2021): 381-402. Some notable physical models: [4] F Baumann et al. "Modeling echo chambers and polarization dynamics in social networks." Physical Review Letters 124.4 (2020): 048301. [5] M Del Vicario et al. "Modeling confirmation bias and polarization." Scientific reports 7.1 (2017): 1-9. 2. One of the main innovations of this paper is the incorporation of homophily on initial conditions (i.e., more realistic starting conditions of user opinions). However, the authors didn’t provide their detailed algorithm for allocating initial polarity values on both audience networks and social networks. Note that this directly affects the current conclusions and should be indispensable. 3. Some technical problems: (1) The updating rules for polarity seems like cannot always guarantee p_{u,t} in the range of [-1, 1]. Consider an extreme circumstance: \\sigma=1, tolerance \\phi=0.8, p_{u,t-1}=-0.8 and this user is affected by two users with polarity -0.4 (pull) and 0.6 (push), respectively. Then d_{u,t-1}=-0.5, which means p_{u,t}=-1.3. (2) The termination condition of the dynamical system that guarantees convergence should be provided. (3) Following (2), I think the authors should add some snapshots of time evolutions of the system, both polarity distribution evolution and social network evolution, to illustrate the emerging process of polarization. 4. I’m curious that if the integrity of news sources depends on both the number of resharing and the number of flags (for instance, the difference between these two numbers), would results in Section 4.3 be qualitatively different? 5. The combined effects of tolerance and shareability (both are users’ properties) should be studied in Section 5. Some minor comments: 1. Some basic network information used in the simulations should be given. For example, the number of sources and users, the number of edges or the average degree in audience networks and social networks. 2. Line 336: Figure 6(d) show --- Figure 7(d) shows 3. Line 338: Figure 7(h) --- Figure 7(g) ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: Xin Wang [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
Revision 1 |
PONE-D-21-21470R1How Minimizing Conflicts Could Lead to Polarization on Social Media: an Agent-Based Model InvestigationPLOS ONE Dear Dr. Coscia, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Jan 10 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Kazutoshi Sasahara Academic Editor PLOS ONE Additional Editor Comments: Although both reviewers think the manuscript was improved, the reviewer 1 is expressing concerns (see comments). In addition, the reviewer 2 suggested two papers. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: (No Response) Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Although I found the paper improved in many aspects, and I recognize the effort spent by the authors to answer my requests, I still have some concerns about this work. I appreciate that the authors added Twitter data in their analysis, but I have some concerns about the conclusions they drew from them. The authors claim they can reasonably reproduce the results for a dataset from the reference I suggested and used Wasserstein distance to confirm this result. However, I have still hold doubts regarding the users' distributions. Figure S7 shows the distribution obtained by the model for the parameters that best fit Twitter data. However, the distribution is quite different from the marginal one shown in figure 1a of the reference I mentioned. Indeed figure S7 of this paper show a high peak at the center that is not present in the top marginal distribution figure 1a of the suggested reference. Nevertheless, the authors did not show the distribution of users polarization obtained by the Twitter data they retrieved, and thus I cannot say whether or not their model can effectively reproduce it in case it has significant differences from the one shown in the reference. I agree with the authors that the results on the spreading dynamics are not directly comparable, but I think that the user polarization distributions are comparable, and figure S7 did not convince me the model can reproduce real data. More examples of polarization distribution from social data can be found in Cota, Wesley, et al. "Quantifying echo chamber effects in information spreading over political communication networks." EPJ Data Science 8.1 (2019): 1-13, in Zollo, Fabiana, et al. "Debunking in a world of tribes." PloS one 12.7 (2017): e0181821 and in Flamino, James, et al. "Shifting Polarization and Twitter News Influencers between two US Presidential Elections." arXiv preprint arXiv:2111.02505 (2021). Hence, I suggest the authors show the real data distribution. Moreover, I think the paper is missing a brief discussion on the parameters that best fit real data to help the reader understand which characteristics we need to fit Twitter data (e.g. high/low sharing, tolerance, etc.) Reviewer #2: The authors have taken significant care of the details brought to attention by the reviewer comments, and I’m satisfied with all of their responses. In particular, the revised manuscript has added some important technical details, which significantly improve the readability and scientific rigor. As I mentioned in the previous report, the dynamical mechanism that raises the emergence of social polarization has received substantial attention in recent years, and the current work is a timely contribution to this opening problem. Therefore, I recommend accepting it for publication in PLOS ONE. P.S: I’ve noticed that the authors still missed two important references (which were also mentioned in my previous report) that addressed the coupling evolutions and the polarization of both users and news outlets using agent-based models, and I suggest the authors include them in the introductory discussion: [1] AL Schmidt et al. "Anatomy of news consumption on Facebook." Proceedings of the National Academy of Sciences 114.12 (2017): 3035-3039. [2] X Wang et al. "Public discourse and social network echo chambers driven by socio-cognitive biases." Physical Review X 10.4 (2020): 041042. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
Revision 2 |
How Minimizing Conflicts Could Lead to Polarization on Social Media: an Agent-Based Model Investigation PONE-D-21-21470R2 Dear Dr. Coscia, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Kazutoshi Sasahara Academic Editor PLOS ONE Additional Editor Comments (optional): Thank you for revising carefully. Now both reviewers think that all the comments were properly addressed. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) Reviewer #2: The authors have addressed all my concerns and I haven no additional suggestions. I recommend accepting it for publication in PLOS ONE. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No |
Formally Accepted |
PONE-D-21-21470R2 How Minimizing Conflicts Could Lead to Polarization on Social Media: an Agent-Based Model Investigation Dear Dr. Coscia: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Kazutoshi Sasahara Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .