https://orcid.org/0000-0001-5603-0100
Figures
Abstract
Social media platforms heavily changed how users consume and digest information and, thus, how the popularity of topics evolves. In this paper, we explore the interplay between the virality of controversial topics and how they may trigger heated discussions and eventually increase users’ polarization. We perform a quantitative analysis on Facebook by collecting ∼57M posts from ∼2M pages and groups between 2018 and 2022, focusing on engaging topics involving scandals, tragedies, and social and political issues. Using logistic functions, we quantitatively assess the evolution of these topics finding similar patterns in their engagement dynamics. Finally, we show that initial burstiness may predict the rise of users’ future adverse reactions regardless of the discussed topic.
Citation: Etta G, Sangiorgio E, Di Marco N, Avalle M, Scala A, Cinelli M, et al. (2023) Characterizing engagement dynamics across topics on Facebook. PLoS ONE 18(6): e0286150. https://doi.org/10.1371/journal.pone.0286150
Editor: Vincent Antonio Traag, Leiden University: Universiteit Leiden, NETHERLANDS
Received: November 29, 2022; Accepted: May 10, 2023; Published: June 28, 2023
Copyright: © 2023 Etta et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be shared publicily because the study mainly relies on facebook posts obtained from Crowdtangle which, as it states in https://help.crowdtangle.com/en/articles/4558716-understanding-and-citing-crowdtangle-data, cannot be shared in CSV format. However, any researcher can require access to CrowdTangle upon request. Our Supporting information files contain all the contents to guide the interested reader in replicating our study with information about CrowdTangle access and data collection methodology.
Funding: This study was supported by the 100683 EPID Project “Global Health Security Academic Research Coalition” provided by UK/G7 in the form of funds to WQ, GE, MA, MC [SCH-00001-3391], the SERICS under the NRRP MUR program funded by the European Union - NextGenerationEU in the form of funds to WQ [PE00000014], the project CRESP from the Italian Ministry of Health under the program CCM 2022 granted to WQ, and by the PON project “Ricerca e Innovazione,” funded by Ministero dell’Istruzione, dell’Università e della Ricerca, granted to MC. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The advent of social media platforms changed how users consume information online [1–4]. The micro-blogging features on Twitter and Facebook, combined with a direct interaction between news producers and consumers, have remarkably affected how people get informed, shape their own opinions, and debate with other peers online [5–7]. Over the years, following the business model of social media platforms, news outlets and producers attempted to maximize the time spent by users on their contents [8, 9], giving birth to the concept of attention economy [10]. The term refers to the users’ limited capability and time to process all information they interact with [11–13]. The transition toward a news ecosystem shaped on social media platforms unveiled patterns in information consumption at multiple scales [14, 15], which contributed to the emergence of the polarisation phenomenon and the formation of like-minded groups called echo chambers [16–18]. Within echo chambers, characterized by homophily in the interaction network and bias in information diffusion towards like-minded peers, selective exposure [19] is a significant driver for news consumption [16]. The combination of echo chambers and selective exposure makes users more likely to ignore dissenting information [20], choosing to interact with narratives adhering to their point of view [15, 21].
Several studies explored the existence of these mechanisms in many topics concerning political elections, public health, climate change, and trustworthiness of the news sources [15, 21–29]. Findings indicate neither the topic nor the quality of information explains the users’ opinion-formation process. Instead, several studies observed how the virality of discussions can increase the likelihood of inducing polarization, hate speech, and toxic behaviors [30–32], highlighting how recommendation algorithms may have a role in shaping the news diet of users.
Therefore, it is necessary to provide a better understanding of how user interest evolves in online debates. To achieve this goal, we provide a quantitative assessment of the dynamics underlying user interest in news articles about different topics. In this paper, we analyze the engagement patterns produced by ∼57M posts on Facebook related to ∼300 topics, involving a total of ∼2M posting pages and groups over a period that ranges from 2018 to 2022. We first provide a quantitative assessment of topics’ attention through time, extracting insightful parameters from their engagement evolution. Then, we construct a metric called the Love-Hate Score to estimate the level of controversy associated with a topic using the sentiment of users’ engagement, as expressed by the normalized difference between their positive and negative reactions. Our results show that topics are generally characterized by an interest that constantly increases since the appearance of the first post. We find that topics’ interactions grow with permanent intensity, even for prolonged periods, indicating how interest is a cumulative process that takes time. We statistically validate this result by comparing parameters across topic categories, discovering no differences in the evolution of the engagement. Indeed, regardless of their category, topics keep users engaged steadily over time, and their lifetime progression seems thus unrelated to its thematic field. Finally, we find that topics with sudden virality tend to occur with more controversial and heterogeneous interactions. In turn, topics with a steady evolution exhibit more positive and homogeneous reaction types. This difference in the sentiment of reactions, and the protracted duration of topics’ lifetime, are both upshots consistent with the emergence of selective exposure as a driver of news consumption.
Materials and methods
This section describes the data collection process, the topic extraction process, the models and the metrics employed in assessing collective attention.
Overview of the data collection process
The data collection process comprises several parts, as described in Fig 1. We start by creating a sample of news articles from the GDELT event database [33]. Then, we process the articles’ text to obtain a set of representing terms. Consequently, we apply the Louvain community detection algorithm [34] on the bipartite projection of the co-occurrence term network to identify the topics of interest. The terms representing these topics will serve as input for collecting posts from Facebook.
The data collection and analysis process are compliant with the terms and conditions [35] imposed by Crowdtangle [36]. Therefore, the results described in this paper cannot be exploited to infer the identity of the accounts involved.
News articles are collected from the GDELT Database, and their corpus is extracted, cleaned and analyzed to retrieve the most representing terms. The bipartite projection of the co-occurrence network built upon these terms serves as an input for the Louvain community detection algorithm to identify keyword clusters. Independent labellers then analyze these clusters to identify the subset of words that represent the topic under consideration, which are then used on Crowdtangle to retrieve the Facebook posts relating to those events.
News extraction from GDELT.
The GDELT (Global Database of Events, Language, and Tone) Project [37], powered by Google Jigsaw, is a database of global human society which monitors the world’s broadcast, print, and web news from nearly every corner of every country in more than 100 languages. It identifies the people, locations, organisations, themes, sources, emotions, counts, quotes, images and events driving our global society every second of every day [38]. We gathered news articles from the GDELT 2.0 Event Database [33], which can store new world’s breaking events every 15 minutes and translates the corresponding news articles in 65 languages, representing 98.4% of its daily non-English monitoring volume [33]. The analysis covers a period between 1/1/2018 and 13/5/2022, collecting 50 news articles each week for a total of ∼79K.
Extracting representative keywords from news articles.
To clean and extract the most representative keywords of each news article, we employed the newspaper3k Python package [39]. We initially extracted words from the body of the article, excluding stopwords and numbers. Then, we computed the word frequency f(w, i) for each word w in article i. Finally, we sorted words in descending order according to their frequency, keeping the top 10 most frequent words.
Topic extraction from news article’s keywords.
The list of terms with the corresponding news articles can be formalised as a bipartite graph G = (T, A, E) whose partitions T and A represent the set of terms t ∈ T and the articles a ∈ A respectively, for which an edge (t, a)∈E exists if a term t is present in an article a. By projecting graph G on its terms T we obtain an undirected graph P made up of nodes t ∈ T, which are connected if they share at least one news article.
We perform community detection on the nodes of P by employing the Louvain algorithm [34]. As a result, we obtain a set of clusters C, where each cluster c ∈ C contains a list of keywords that are assumed to be semantically related to a topic. We then asked a pool of three human labellers to select, for each community, from two to three terms they considered the most representative to identify a topic unambiguously.
Data collection of Facebook posts.
The news articles obtained from the GDELT Event Database do not contain information helpful in estimating the attention they generate online. To include the dimension of user engagement, we employ each topic’s set of representative terms to collect Facebook data over a period that goes from 01/01/2018 to 05/05/2022. The data was obtained using CrowdTangle [36], a Facebook-owned tool that tracks interactions on public content from Facebook pages, groups, and verified profiles. CrowdTangle does not include paid ads unless those ads began as organic, non-paid posts that were subsequently “boosted” using Facebook’s advertising tools. CrowdTangle also does not store data regarding the activity of private accounts or posts made visible only to specific groups of followers.
The collection process produced a total of ∼57M posts from ∼2M unique pages and groups, generating ∼8B interactions. The result of the data collection process is described in Table 1.
Topic categorization.
To provide a correspondence between topics and their area of interest, we performed a categorization activity under the following labels: Art-Culture-Sport (ACS), Economy, Environment, Health, Human Rights, Labor, Politics, Religion, Social and Tech-Science. Three human labellers carried out the activity to connect topics and categories, choosing as the representative only those categories selected by at least two of the three labellers.
Metrics
We begin by describing a measure for fitting the cumulative engagement evolution. Then, based on the previous step, we outline an index to evaluate the sharpness of the topic’s diffusion. Finally, using Facebook’s reactions, we introduce a sentiment score to assess the topic’s controversy. A topic-aggregated version of the dataset containing all the metrics defined in this section can be found in the Data Breakdown Section of S1 File.
Fitting cumulative engagement evolution.
The study of the diffusion of new ideas has been carried on through the years, starting from the Bass diffusion model [40] and then extended to a multitude of topics [41–47], indicating the relevance of s-curves in the analysis of innovation spreading. Therefore, to model the evolution of the engagement received by posts, we fit the cumulative distribution of the overall engagement (i.e., the number of likes, shares and comments) over time employing a function fα,β(t), with , defined as
(1)
From a mathematical point of view, Eq 1 defines a general sigmoid function that depends on the parameters α and β. The α parameter represents the slope of the function, describing the steepness of the engagement evolution. On the other hand, β is the point at which the function reaches the value 0.5 and quantifies the time required for a topic to reach half its total interactions.
To provide a representation of the impact that α and β can have in topic engagement evolution, Fig 2 displays four topics with peculiar configurations. Fig 2a shows a sigmoid in which the high values of α and β produce a sharp increment relatively far from t0. Such behaviour corresponds to those topics that require some time before gaining maximum diffusion with the public. Fig 2b instead provides a fit where the sigmoid produces low values for α and β, resulting in a smoother increment in the proximity of t0 than the one described in Fig 2a. Finally, Fig 2c and 2d provide an example of how two curves that share similar values of β parameters can have a different evolution of their increase by slightly modifying the values for α parameter.
The incidence of the α parameter can be observed in the sharpness of the fitting curves. The β parameter instead regulates the shift of the function through the x axis: the higher its value, the higher the delay from t0 where the sigmoid produces its increment.
Speed Index.
To provide a measure of how quickly the attention towards a topic reaches its saturation, we define a measure called the Speed Index SI(fα,β) as
(2)
The SI considers the joint contribution of α and β parameters, where T represents the time of the last observed value for fα,β(t). Note that the SI is the mean integral value of fα,β, i.e. the normalised area under the curve of fα,β (therefore SI(fα,β) ∈ [0, 1]). The assumption in the definition of this function relies on the fact that high-speed values are obtained by sigmoids that reach the plateau in a short time, as the behaviour represented in Fig 2b.
Love-Hate Score.
To quantify the level of controversy that a Facebook post may produce, we define a measure called the Love-Hate (LH) Score. In line with previous works that quantified controversy from post reactions [48, 49], we define the LH Score LH(i)∈[−1, 1] as
(3)
where hi and li are respectively the total number of Angry and Love reactions collected by a post i. A value of LH equal to −1 indicates that the post received only Angry reactions from the users, while a value equal to 1 indicates that the post received only Love reactions. Therefore, a value close to 0 reflects the presence of controversy on a post due to a balance of positive and negative reactions.
Results and discussion
Quantifying topic engagement evolution
We first provide a quantitative assessment of the the evolution of engagement with topics on social media. To do so, we perform a Non-linear Least Squares (NLS) regression by fitting the sigmoid function fα,β(t) to the cumulative engagement gained by each topic.
The distribution of the α parameter provided in Fig 3 describes how the majority of topics have a value of α belonging to the [0, 0.0047] interval. This result demonstrates how user interest in a topic does not suddenly increase but results from a long-term process. Instead, the distribution of the β parameter describes a prevalence of topics in the [600, 1000] interval, identifying the tendency of topics to become a matter of interest with some delay w.r.t the first post covering them.
We observe that topics are generally characterized by values of α and β, which explains how user interest in a topic does not increase all of a sudden but is the result of a process that evolves over time.
Evaluating the relationship between topic engagement and controversy
To quantify the interplay between users’ interest in a topic and the associated level of controversy, we compute the Spearman correlation between the Speed Index and the LH Score for each topic. Results from the upper panel of Fig 4 show a general negative tendency of users to react with a negative sentiment when a topic gains engagement faster (ρ = −0.26), leaving positive reactions to those topics that require time to obtain maximum diffusion. Results described in the lower panel of Fig 4 provide further characterisation of the interplay between the Speed Index and the LH Score after classifying the topics according to the four most frequent categories analyzed, i.e., Politics, Labor, Human Rights and Health. We observe how the Politics and Health categories have the lowest correlation scores (ρ = −0.36 and ρ = −0.45), providing an indication of their intrinsic polarizing attitude (see S1 Fig for further details about correlation coefficients). Furthermore, the correlation between α and LH Score produces similar results as with the Speed Index (see S2 Fig for more details).
Upper panel: correlation between SI and LH score for each identified topic. Lower panel: correlation between SI and LH score for the top 4 most frequent topics. Overall, we observe how users react negatively as topics become sharply viral.
Assessing the differences of engagement behaviors across topic categories
To conclude our analysis, we investigate the differences in the evolution of engagement across topic categories. In particular, for each parameter distribution (α, β and SI), we apply a two-tailed Mann–Whitney U test [50] to each pair of parameters. Table 2 provides the percentages of the significant p-values for the four parameters. Due to the necessity to perform multiple tests, we apply a Bonferroni correction to our standard significance level of 0.05, leading to reject the null hypothesis if the p-value p < 0.001. Our results show that the resulting p-values from the tests do not lead to rejecting the null hypothesis. Such a result corroborates the hypothesis that, on average, users are characterized by homogeneous engagement patterns that are not influenced by the consumed topic. We further extend the statistical assessment by performing the same test between LH Score distributions of the different categories.
Conversely to engagement evolution results, the topic’s category explains differences in the sentiment of reactions in 20% of cases. Such findings reveal that some categories are composed of significantly more negative and controversial topics, indicating how elicited reactions vary according to specific subjects. Understanding that some of them are more prone to induce negative feedback from users could be a proxy to introduce their related topics in the online debate.
Conclusions
In this work, we perform a quantitative analysis of user interest on a total of ∼57M Facebook posts referring to ∼300 different topics ranging from 2018 to 2022. We initially quantify the distribution of topics’ engagement evolution throughout the analysis. Then, we evaluate the relationship between engagement and controversy. Ultimately, we assess the differences in engagement across different categories of topics. Our findings show that, on average, users’ interest in topics does not increase exponentially right after their appearance but, instead, it grows steadily until it reaches a saturation point. From a sentiment perspective, topics that reached a plateau in their engagement evolution right after their initial appearance are more likely to collect negative/controversial reactions, whilst topics which are more steady in their growth tend to attract positive users’ interactions. This result provides evidence about how recommendation algorithms should introduce topics adequately since sudden rises in topic diffusion could be related to the reinforcement of polarization mechanisms. Finally, we find no statistical difference between user interest across different categories of topics, providing evidence that, on a relatively large time window, the evolution of engagement with posts is primarily unrelated to their subject. On the contrary, we observe differences in the sentiment generated by topics with different diffusion speed, providing evidence of how people perceive the piece of content they consume online in different ways, according to how suddenly they get exposed to it.
Users’ interest and engagement evolution in the online debate are both aspects of human behaviour on social media whose underlying dynamics still need to be discovered from an individual point of view. Our findings provide an aggregate perspective of the interplay between major emerging behavioral dynamics and topics’ lifetime progression, deepening the relationship between diffusion patterns and users’ reactions. Understanding that topics with an early burst in virality are associated with primarily adverse reactions from users may enable the identification of highly polarizing topics since their initial stage of diffusion.
The following study presents some limitations. In data collection, CrowdTangle provides only posts from public Facebook pages with more than 25K Page Likes or Followers, public Facebook groups with at least 95K members, all US-based public groups with at least 2K members, and all verified profiles. These restrictions affected our datasets’ sample and our findings’ generality. Moreover, we could not access removed posts, groups, and pages, which could have been a meaningful proxy to characterize the attention dynamics of retracted content. Finally, since Crowdtangle does not provide information about users interacting with posts, we cannot assess their engagement from an individual perspective and model the possible relationship between users and topics employing a network approach.
The results obtained in this work may help to better understand how users consume information, improving social media moderation tools by considering both the “life-cycle” of topics and their potential controversy. Indeed, the introduction of the Speed Index and the Love-Hate Score can be exploited to identify in advance topics with the potential to collect considerable interest and generate heated debates quickly. From a news outlet and content creator perspective, understanding that specific topics may reach broader audiences and produce controversial opinions can improve the quality of the communication produced by these two types of authors.
Supporting information
S1 Data. This CSV file contains, for each identified topic, the statistics of α and β value, the Love Hate Score, the first and last post dates, the topic lifetime (in days), the Speed Index value, the number of posts, total interactions and users posting.
https://doi.org/10.1371/journal.pone.0286150.s001
(CSV)
S1 File. This file provides the topic aggregated statistics employed in the study.
Moreover, here are provided the figures reporting the correlations between α and LH Score for each topic and the goodness of the fitting procedures.
https://doi.org/10.1371/journal.pone.0286150.s002
(PDF)
S1 Fig. Correlation between α and LH score for each identified topic.
https://doi.org/10.1371/journal.pone.0286150.s003
(TIF)
S2 Fig. Joint distribution of the errors 
and 
for each topic i, whose cumulative curve was estimated by means of fα,β.
The colour of each point represents the number of posts produced by topic i.
https://doi.org/10.1371/journal.pone.0286150.s004
(TIF)
References
- 1.
Taha Yasseri, Patrick Gildersleve, and Lea David. Collective memory in the digital age. arXiv preprint arXiv:2207.01042, 2022.
- 2. Lazaroiu George. The role of social media as a news provider. Review of Contemporary Philosophy, 13:78–84, 2014.
- 3. Ahmad Ali Nobil. Is twitter a useful tool for journalists? Journal of media practice, 11(2):145–155, 2010.
- 4. Notarmuzi Daniele, Castellano Claudio, Flammini Alessandro, Mazzilli Dario, and Radicchi Filippo. Universality, criticality and complexity of information propagation in social media. Nature communications, 13(1):1–8, 2022.
- 5. Brown Jo, Broderick Amanda J, and Lee Nick. Word of mouth communication within online communities: Conceptualizing the online social network. Journal of interactive marketing, 21(3):2–20, 2007.
- 6. Kellner Richard Kahn and Douglas. New media and internet activism: from the ‘battle of seattle’to blogging. New media & society, 6(1):87–95, 2004.
- 7. McGregor Shannon C. Social media as public opinion: How journalists use social media to represent public opinion. Journalism, 20(8):1070–1086, 2019.
- 8.
Roope Jaakonmäki, Oliver Müller, and Jan Vom Brocke. The impact of content, context, and creator on user engagement in social media marketing. Proceedings of the 50th Hawaii International Conference on System Sciences, 2017.
- 9. Di Gangi Paul M and Wasko Molly M. Social media engagement theory: Exploring the influence of user engagement on social media usage. Journal of Organizational and End User Computing (JOEUC), 28(2):53–73, 2016.
- 10. Simon Herbert A et al. Designing organizations for an information-rich world. Computers, communications, and the public interest, 72:37, 1971.
- 11. Kies Stephen C et al. Social media impact on attention span. Journal of Management & Engineering Integration, 11(1):20–27, 2018.
- 12. Holt Kristoffer, Shehata Adam, Strömbäck Jesper, and Ljungberg Elisabet. Age and the effects of news media attention and social media use on political interest and participation: Do social media function as leveller? European journal of communication, 28(1):19–34, 2013.
- 13. Brooks Stoney. Does personal social media usage affect efficiency and well-being? Computers in Human Behavior, 46:26–37, 2015.
- 14. Cinelli Matteo, Brugnoli Emanuele, Schmidt Ana Lucia, Zollo Fabiana, Quattrociocchi Walter, and Scala Antonio. Selective exposure shapes the facebook news diet. PloS one, 15(3):e0229129, 2020.
- 15. Vicario Michela Del, Bessi Alessandro, Zollo Fabiana, Petroni Fabio, Scala Antonio, Caldarelli Guido, et al. The spreading of misinformation online. Proceedings of the National Academy of Sciences, 113(3):554–559, 2016.
- 16. Cinelli Matteo, Morales Gianmarco De Francisci, Galeazzi Alessandro, Quattrociocchi Walter, and Starnini Michele. The echo chamber effect on social media. Proceedings of the National Academy of Sciences, 118(9):e2023301118, 2021.
- 17. Flaxman Seth, Goel Sharad, and Rao Justin M. Filter bubbles, echo chambers, and online news consumption. Public opinion quarterly, 80(S1):298–320, 2016.
- 18. Cookson J Anthony, Engelberg Joseph, and Mullins William. Echo chambers. The Review of Financial Studies, 36.2 (2023): 450–500.
- 19.
Joseph T Klapper. The effects of mass communication. 1960.
- 20. Zollo Fabiana, Bessi Alessandro, Vicario Michela Del, Scala Antonio, Caldarelli Guido, Shekhtman Louis, et al. Debunking in a world of tribes. PloS one, 12(7):e0181821, 2017.
- 21. Bessi Alessandro, Scala Antonio, Rossi Luca, Zhang Qian, and Quattrociocchi Walter. The economy of attention in the age of (mis) information. Journal of Trust Management, 1(1):1–13, 2014.
- 22. Mocanu Delia, Rossi Luca, Zhang Qian, Karsai Marton, and Quattrociocchi Walter. Collective attention in the age of (mis) information. Computers in Human Behavior, 51:1198–1204, 2015.
- 23. Cinelli Matteo, Quattrociocchi Walter, Galeazzi Alessandro, Valensise Carlo Michele, Brugnoli Emanuele, Schmidt Ana Lucia, et al. The covid-19 social media infodemic. Scientific reports, 10(1):1–10, 2020.
- 24. Etta Gabriele, Galeazzi Alessandro, Hutchings Jamie Ray, Smith Connor Stirling James, Conti Mauro, Quattrociocchi Walter, et al. Covid-19 infodemic on facebook and containment measures in italy, united kingdom and new zealand. PloS one, 17(5):e0267022, 2022.
- 25.
Max Falkenberg, Alessandro Galeazzi, Maddalena Torricelli, Niccolò Di Marco, Francesca Larosa, Madalina Sas, et al. Growing polarization around climate change on social media, Nature Climate Change, pages 50–60, 2022.
- 26. Candia Cristian, Jara-Figueroa C, Rodriguez-Sickert Carlos, Barabási Albert-László, and Hidalgo César A. The universal decay of collective memory and attention. Nature human behaviour, 3(1):82–91, 2019.
- 27. Briand Sylvie C, Cinelli Matteo, Nguyen Tim, Lewis Rosamund, Prybylski Dimitri, Valensise Carlo M, et al. Infodemics: A new challenge for public health. Cell, 184(25):6010–6014, 2021. pmid:34890548
- 28. Bovet Alexandre and Makse Hernán A. Influence of fake news in twitter during the 2016 us presidential election. Nature communications, 10(1):1–14, 2019. pmid:30602729
- 29.
Carlo M Valensise, Matteo Cinelli, Matthieu Nadini, Alessandro Galeazzi, Antonio Peruzzi, Gabriele Etta, et al. Lack of evidence for correlation between covid-19 infodemic and vaccine acceptance. arXiv preprint arXiv:2107.07946, 2021.
- 30.
Fatemeh Tahmasbi, Leonard Schild, Chen Ling, Jeremy Blackburn, Gianluca Stringhini, Yang Zhang, et al. “go eat a bat, chang!”: On the emergence of sinophobic behavior on web communities in the face of covid-19. In Proceedings of the Web Conference 2021, WWW’21, page 1122–1133, New York, NY, USA, 2021. Association for Computing Machinery.
- 31. Cinelli Matteo, Pelicon Andraž, Mozetič Igor, Quattrociocchi Walter, Novak Petra Kralj, and Zollo Fabiana. Dynamics of online hate and misinformation. Scientific reports, 11(1):1–12, 2021.
- 32.
Social Media and Democracy: The State of the Field, Prospects for Reform. SSRC Anxieties of Democracy. Cambridge University Press, 2020.
- 33.
GDELT. Gdelt 2.0: Our global world in realtime.
- 34. Blondel Vincent D, Guillaume Jean-Loup, Lambiotte Renaud, and Lefebvre Etienne. Fast unfolding of communities in large networks. Journal of statistical mechanics: theory and experiment, 2008(10):P10008, 2008.
- 35.
Understanding and Citing CrowdTangle Data, Crowdtangle, Crowdtangle Team.
- 36.
CrowdTangle Team. Crowdtangle. Facebook, Menlo Park, California, United States, 2020.
- 37.
GDELT. The GDELT project.
- 38.
Kalev Leetaru and Philip A Schrodt. Gdelt: Global data on events, location, and tone, 1979–2012. In ISA annual convention, volume 2, pages 1–49. Citeseer, 2013.
- 39.
Lucas Ou-Yang. Newspaper3k, 2013.
- 40.
Bass Frank M., A new product growth for model consumer durables, Management science, 15(5):215–227, 1969.
- 41.
Gabriel De Tarde. The laws of imitation. H. Holt, 1903.
- 42. Everett M. Rogers. New Product Adoption and Diffusion. Journal of Consumer Research, 2(4):290–301, 3 1976.
- 43.
Arnulf Grubler. The rise and fall of infrastructures: dynamics of evolution and technological change in transport. Physica-Verlag, 1990.
- 44.
Carlota Perez. Technological revolutions and financial capital. Edward Elgar Publishing, 2003.
- 45.
Les Robinson. Changeology. How to enable groups, communities and societies to do things they’ve never done before. 272p, 2012.
- 46. Kanjanatarakul Orakanya, Suriya Komsan, et al. Comparison of sales forecasting models for an innovative agro-industrial product: Bass model versus logistic function. The Empirical Econometrics and Quantitative Economics Letters, 1(4):89–106, 2012.
- 47. Billy Spann and Esther Mead and Maryam Maleki and Nitin Agarwal and Williams , Therese, Applying diffusion of innovations theory to social networks to understand the stages of adoption in connective action campaigns, Online Social Networks and Media, Elsevier, 2022(28):P100201, 2022.
- 48.
Beel, Jacob and Xiang, Tong and Soni, Sandeep and Yang, Diyi. Linguistic Characterization of Divisive Topics Online: Case Studies on Contentiousness in Abortion, Climate Change, and Gun ControlProceedings of the International AAAI Conference on Web and Social Media, pages 32–42, 2022.
- 49.
Hessel, Jack and Lee, Lillian, Something’s brewing! Early prediction of controversy-causing posts from discussion features, arXiv:1904.07372, 2019
- 50.
Henry B Mann and Donald R Whitney. On a Test of Whether One of Two Random Variables Is Stochastically Larger than the Other. The annals of mathematical statistics, pages 50–60, 1947.