Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Who tweets climate change papers? investigating publics of research through users’ descriptions

  • Rémi Toupin ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

    toupin.remi@courrier.uqam.ca

    Affiliation Laboratory for Communication and the Digital (LabCMO), Centre Interuniversitaire de Recherche sur la Science et la Technologie (CIRST), Université du Québec à Montréal, Montréal, Québec, Canada

  • Florence Millerand,

    Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Validation, Writing – review & editing

    Affiliation Laboratory for Communication and the Digital (LabCMO), Département de Communication Sociale et Publique (DCSP), Centre Interuniversitaire de Recherche sur la Science et la Technologie (CIRST), Université du Québec à Montréal, Montréal, Québec, Canada

  • Vincent Larivière

    Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Validation, Writing – review & editing

    Affiliations École de Bibliothéconomie et des Sciences de l’Information (EBSI), Université de Montréal, Montréal, Quebec, Canada, Observatoire des Sciences et des Technologies (OST), Centre Interuniversitaire de Recherche sur la Science et la Technologie (CIRST), Université du Québec à Montréal, Montréal, Québec, Canada

Abstract

As social issues like climate change become increasingly salient, digital traces left by scholarly documents can be used to assess their reach outside of academia. Our research examine who shared climate change research papers on Twitter by looking at the expressions used in profile descriptions. We categorized users in eight categories (academia, communication, political, professional, personal, organization, bots and publishers) associated to specific expressions. Results indicate how diverse publics may be represented in the communication of scholarly documents on Twitter. Supplementing our word detection analysis with qualitative assessments of the results, we highlight how the presence of unique or multiple categorizations in textual Twitter descriptions provides evidence of the publics of research in specific contexts. Our results show a more substantial communication by academics and organizations for papers published in 2016, whereas the general public comparatively participated more in 2015. Overall, there is significant participation of publics outside of academia in the communication of climate change research articles on Twitter, although the extent to which these publics participate varies between individual papers. This means that papers circulate in specific communities which need to be assessed to understand the reach of research on social media. Furthermore, the flexibility of our method provide means for research assessment that consider the contextuality and plurality of publics involved on Twitter.

Introduction

In recent years, Twitter became a key platform for the dissemination research [1]. As traces left by scholarly documents in tweets may reflect communication beyond traditional citations and in the public sphere, they were heralded as potential indicators of the so-called « societal impact of research » along with other social media metrics [2, 3]. However, the strict focus on event count (i.e. number of tweets, number of retweets) was confronted to a lack of theoretical grounding as to what these traces really measure. Scholars thus looked to investigate the contexts in which research circulate on Twitter, understood as the dimensions that give meaning to indicators [4]. Challenges remain in capturing these contextual elements as digital scholarly communication studies need to move between the scales of individual documents and aggregated corpora where contexts may shift [5]. Methodological framework also need to account that information provided on Twitter is generated by users as well as not directly organized for research purposes [68].

Meanwhile, discussions about issues like climate change, public health, and artificial intelligence moved to social media, highlighting the political ramifications of research [912]. As such, studies about science communication, policy and evaluation increasingly aim to understand the reach of scholarly outputs in the public sphere. Our study focuses on the case of climate change as representative of environmental challenges. Specifically, climate change communication aims to foster environmental action by influencing decision making and translating new knowledge in everyday practices to limit our ecological footprint [13]. Climate change issues reflect other increasingly urgent matters, such as biodiversity loss, extreme weather events, massive migrations, and scarcer access to basic resources [11, 14]. As discussions about climate change are increasingly salient on Twitter, scholars and other actors of the public diffusion of research moves to the platform to share relevant knowledge and engage with stakeholders more broadly [11, 1517]. As some social media platforms like Twitter make their data accessible to the scholarly community, it makes it possible to directly examine the resonance of climate change research in the public sphere.

Public conversations of climate change research on Twitter

Reflecting a large scope of topics and issues, a diversity of publics are concerned with climate change [16, 17]. On the one hand, a tracking of the release of the IPCC 5th assessment report found that the majority of Twitter engagement came from individual bloggers and concerned citizens who provided alternative framing than that of decision-makers, journalists, and scientists [17]. On the other hand, scientists discussing climate change on Twitter engage mostly with other scientists but have been seen to communicate their research to decision-makers, journalists and the general public as well [16]. Typically, scientific knowledge production and communication begins with scholars and research institutions from all disciplines, and synthesis are produced for policymakers [14]. Journalists, medias, scientists and other communication professionals then play a role communicating and framing issues in the public sphere [18, 19]. Civil society, concerned citizens, health or environment professionals, as well as political organizations and advocates also engage with climate change for personal, political or professional motivations [20, 21]. As all these actors contribute differently to discussions about climate change, the visibility of research documents on social media made the communication of related issues no longer the prerogative of scientists and journalists only [17]. The reach of climate change research may thus be modulated by the influence, background and motivationf of those who share it on Twitter.

Twitter play a significant role in informational communication as well as political discussion and action, especially for issues like climate change [16, 17, 2224]. Within these conversations, scholars discuss relevant research with colleagues, foster new collaborations, engage in political actions, share their work more broadly, or keep in touch with the latest news [25]. This increased participation by researchers is linked with a significant volume of scholarly documents being shared, with variations across disciplines, publication channels and cultural contexts [1, 26]. While patterns of scholarly communication on Twitter remain to be documented in detail, one key promise is that it has democratized access to research by allowing it to circulate more broadly and outside of academia. The digital traces left by scholarly documents have been heralded as potential indicators of the « societal impact of research », or altmetrics [27]. Previous research focused on the analysis of traces on Twitter as 1) data collection is easier than for most other platforms; 2) scholarly output is readily shareable through the inclusion of links in tweets; and 3) tweets are available to non-academic publics [28, 29]. However, it remains unclear what these traces reflect. On the one hand, there are multiple understandings of what is called the « societal impact of research » [3, 2931]. On the other hand, as the communication of research on Twitter involves mediation processes and is not intended toward a clear objective, Twitter scholarly metrics do not reflect a clear phenomenon [1]. The initial focus on counts has now shifted to more comprehensive studies of the contexts in which documents are shared and what they mean for the communication of research outside of academia [4, 32]. Our study aims to further describe these contexts by focusing on the publics of climate change research as understood by their Twitter profile descriptions.

Climate change research topics range from the physical processes of climate change to its direct and indirect repercussions on communities and the environment, as well as means of mitigation, adaptation and communication to counter the ongoing process [33, 34]. Two events have been at the core of climate change research and policy discussions in recent years: the publication of the IPCC 5th Assessment Report (IPCC 5AR) in 2013 and the COP 21 leading to the Paris Agreement in 2015 [17, 3537]. In one instance, non-elite actors–individual users who are not affiliated to a specific media, nonprofit, or scientific organization, such as bloggers, activists, or the general public–were able to draw attention, as indicated by their presence (35%) in the hundred most mentioned users, in discussing and framing the IPCC 5AR Working Group 1 contribution [17]. Scholars and research professionals contributed to both discussions–the IPCC 5AR and COP 21 events -, highlighting their interest for different topics than the general public, and indicating a shift in their public communication patterns. As such, scholars were seen to have a hybrid role of communicator and advocate, while mostly communicating with journalists and other scholars rather than directly to policymakers and the general public [16].

Conversations on Twitter build on a series of affordances, such as hashtags (#), mentions (@) or links to external documents, as well as metadata that allows for the characterization of every tweets (ex. time of publication, number of likes) and users (profile description, picture, number of followers, etc.) [16, 38, 39]. Users usually engage with accounts they are familiar with or which post content relevant to them [40, 41]. Scholarly communication on Twitter relies on the possibility of adding links to external documents to make research outputs visible [39]. Authors and publishers may tweet links to their papers to promote them, and eventually foster engagement that will benefit them–such as an higher number of citations–whereas scholars may tweet or retweet documents they find relevant [3]. Altogether, users who actively engage with a paper may do so by being prompted by other accounts, whether because a publication was relevant, funny or controversial [42, 43]. Influential users, such as communicators or celebrities, may engage their network more easily, while communities may be created around specific documents to topics [4, 44].

Investigating and representing users in public communication of research on Twitter

On Twitter, the abundance of informational content fostered an engagement by political users, communication professionals and organizations, as well as a representation of actors of the knowledge economy [16, 45]. An account may represent an individual, a project, an organization, or a feed of content [46, 47]. The demographics of Twitter reflect those of the high-middle class of the population, mostly white young professionals, although these demographics changes as we scale down to specific communities [48]. As for scholars, doctoral students and young researchers tend to be at the forefront, while some disciplines, mostly those dealing with social issues such as health sciences, economics or social sciences, are more visible [3, 49]. Our study focuses on the analysis of words and expressions in Twitter user bios as a proxy of who tweet climate change research papers since assessing who share scholarly documents at a larger scale entails reducing identity to specific markers [28, 46]. We hypothesize that the expressions employed by users to describe themselves act as identity markers through which they engage with other users [50]. Building on previous work on the identification of users sharing scholarly documents on Twitter, we identified 8 relevant categories of markers–academia, communication, political, professionnal, personal, organizations, publishers, and bots–to classify who tweet climate change research papers [5, 16, 28, 51].

Methods that capture who engage with scholarly documents on Twitter usually rely on automatic textual analysis of Twitter bios [16, 28, 5153] or manual coding [41, 54]. Altmetric also provides an identification of users in its database in four categories distinguishing between researchers, science communicators, practitioners and general public [55]. However, their approach has limitations as it encompasses the “general public” as all the users who do not match to the first three categories. Other approaches relied on the characterization of the social network by which documents flow [16, 32, 54, 56]. Usually employed in conjuncture with textual analysis of Twitter profile description, these methods aim to understand how discussions or communities build up around scholarly documents. More direct approaches rely on the matching of bibliometric information with Twitter data to capture the scholars involved on Twitter [57], as well as the use of Twitter lists [51, 58]. Our method build on these by investigating the categories of users sharing climate change research papers on Twitter through specific expressions in Twitter profiles descriptions. As such, we account for the multiple identity markers used in a description to further assess the complexity through which someone may engage with research documents. We did not take into account the order in which these markers appear as we wanted to have a general overview of how users present themselves without apposing any judgement on which identities are more important.

Purpose of the study

Profile description is often the primary information through which we assess someone else identity on Twitter [28]. As such, it is useful to assess someone else inclination toward specific topics on Twitter. Twitter bios also are a widely used proxy in informetrics studies to determine who are the users engaging in scholarly communication on Twitter [16, 28, 5153]. As such, our study examines a categorization of users by analyzing specific keywords in Twitter descriptions.

Our main objective is to look how much research papers about climate change issues permeate outside of academia by examining the specific categories of users sharing said papers. As such, we focus our analysis on general categories of “markers” about users who may have an interest toward such research. We classify the descriptions of accounts who shared at least one link to a climate change research paper by linking them to the expressions collated for each category. Thus, we aim to assess the reach of scholarly documents in specific categories of users involved in the public communication of climate change research on Twitter:

  • RQ: Who share climate change research papers outside of academia?

Methodologically, word detection highlights which expressions users provide in their Twitter descriptions. It contributes to our understanding of scholarly communication on social media by assessing how different identity markers may be used within single bios and the communities linked to these expressions. However, it elicits methodological discussions as our approach does not aim to attach unique identity markers to accounts, but rather highlights the multiple ways through which users may express themselves on Twitter. Our paper addresses these considerations by investigating who share climate change research articles through a word detection method of Twitter bios. Thus, we aim to provide insights on how users present themselves to others in climate change research discussions, especially outside of academia.

Material and methods

Data collection and Twitter metrics

For this study, we built a dataset of 2015 and 2016 research articles (n = 4 730) indexed in the Web of Science (WoS) of Clarivate Analytics through the internal database of the Observatoire des sciences et des technologies (OST). We then collected tweets containing a link to these papers as well as information about the users who published these tweets by cross-referencing the information gathered from WoS with the Altmetric–a division of Digital Science (Springer) tracking scholarly documents on social media–database via the Digital Object Identifier (DOI). We accessed the database through an October 2017 copy provided to the Observatoire des sciences et des technologies (OST). We used data from the WoS database as it indexes a large number of research documents from several fields as well as extensive bibliometric information about said research documents [59]. However, attention is directed to a specific set of scientific literature published in English [60]. To select relevant papers about climate change research, we focused on those published in 2015 in 2016 that included the keywords “climate change”, “global warming” or “IPCC” in the title and for which a DOI (Digital Object Identifier), a unique identifier referencing online documents was provided. We chose the years as the Paris Agreement, approved on 12 December 2015, marks a critical juncture for science communication and climate change engagement [35, 37]. Since Altmetric information was provided through a data dump in October 2017, they also were the latest years for which we had coverage of all the research articles through both years at the time of data collection in September 2018. We focused on the title as it is a direct metadata to assess a paper relevance [39]. It is also the information that appears the most in tweets sharing a link to a paper. This query does not retrieve all publications in climate change research; rather, we wanted to collect a set of papers directly related to climate change. As such, our aim is not to provide an extensive analysis of the field, as is done elsewhere [33, 61]. Data collected includes the paper DOI, title, abstract, name of first author, journal of publication, NSF discipline and specialty, number of pages, number of references, number of authors, number of citations, number of tweets, number of accounts, time of first and last tweet, and tweetspan. Collected tweets metadata include paper DOI, tweet author ID, tweet ID, tweet content, time of publication and retweet order. User information include, at the time of tweet, the author ID, author name, account description, account URL, geographic stamp, number of followers, number of papers tweeted, number of tweets, time of first and last tweet, and tweetspan. Queries to the WoS and Altmetric database were made in SQL and we exported the results for further access. Data collection complied with the terms and conditions of WoS, Altmetric and Twitter through data providing agreements with the Observatoire des sciences et des technologies (OST).

Following recommendations from previous studies, we computed several Twitter metrics to further describe our dataset for tweet activity [1, 4]. Computed metrics include the number of papers tweeted, number of tweets, Twitter coverage (i.e., % of tweeted papers), Twitter density (i.e., number of tweets per paper) and intensity (i.e., number of tweets per tweeted paper), number of users, user density (number of users per paper) and intensity (i.e., number of users per tweeted paper), number of papers retweeted, retweet coverage (i.e.,% of retweeted papers), share of retweets (i.e., % of tweets that are retweets), retweet density (i.e., number of retweets per paper), and retweet intensity (i.e. number of retweets per tweeted document). These metrics further characterize our dataset by providing an assessment of Twitter engagement across scholarly and social media objects. We computed all metrics by uploading our dataset in an R dataframe and handling it using the tidyverse package as well as basic calculation functions [62]. Plots were created using the ggplot2 package [63].

Our dataset includes 2 376 papers published in 2015 and 2 354 in 2016. The papers were published in 1 062 journals, from which 46 have published more than 20. The journals Climatic Change (n = 178), PLOS ONE (n = 139), Global Change Biology (n = 97), Regional Environmental Change (n = 70), Scientific Reports (n = 63), Environmental Research Letters (n = 55), Journal of Climate (n = 54) and Nature Climate Change (n = 51) each have published more than 50 articles. This illustrates how climate change research is a broad field encompassing various disciplines, as well as showing the diverse possibilities of publication whether in specialized or more general journals. We collected information from 41 108 tweets–among which 23 831 were retweets–sent by 21 844 unique accounts linking to 2 628 papers. The 56% Twitter coverage of our dataset is comparable to that of medical and health research and average of more than eight users sharing tweeted papers indicate significant engagement toward the papers gathered in our study (1). Among tweeted papers, 1 961 were shared by at least two users, 667 by more than ten, 338 by more than twenty, 129 by more than fifty, and 47 by over than a hundred user. Also, 1 319 and 1 308 papers published respectively in 2015 and 2016 were shared at least once, for 21 985 and 19 349 tweets by 12 815 and 11 461 unique users. Tweeted papers were published in 646 journals, 16 of which published more than 20 papers. Climatic Change, PLOS ONE and Global Change Biology published most tweeted papers, whereas Nature Climate Change, Science and PNAS account for the three journals publishing the most papers tweeted by more than a hundred users (Fig 1).

thumbnail
Fig 1. Distribution of climate change research tweeted papers in scientific journals.

Depicted in the above histogram are the ten journals that published the most tweeted papers in our dataset, and below are the ten journals that published the most papers tweeted by more than 100 users.

https://doi.org/10.1371/journal.pone.0268999.g001

Textual analysis of Twitter profile descriptions

To understand how climate change research permeate outside of academia, we focused on the textual analysis of these descriptions. Specifically, we looked at specific expressions that indicate how users present themselves on Twitter [28]. As such, our analysis does not aim to provide an exact mapping of the scientists or journalists on Twitter [57, 64]. Rather, we understand expressions in Twitter descriptions as a proxy to investigate the potential reach of scholarly documents outside of academia. We looked at Twitter descriptions using a dictionary of expressions for eight relevant categories of identity markers built on previous research [5, 16, 28, 51] (Table 1). We built a first version of the codebook by manually coding a sample of a thousand descriptions, and we then improved it through several iterations of the analysis, running the code, comparing with our manual coding, and then modifying the codebook accordingly. We removed all accounts with no descriptions (NULL), lowered all cases, and removed numbers, URLS, emojis, stopwords and punctuation signs except for the hash (#) and at signs (@) from all remaining descriptions. Our inputted data frame featured one user per paper per row, and we removed duplicates as we filtered down our analysis. We assigned expressions to categories using the tidyverse packages and then matching them with corresponding words in the descriptions [62]. Our method may assign more than one category to a description, and thus considers the possibility for someone to provide multiple identity markers. We completed our analysis by looking at the table of descriptions sorted in different categories to assess the potential representations of users mobilizing specific words. We organized our specific observations by looking at the coverage of these categories in 10 highly tweeted papers. Thus, we describe how well these categories may be investigated in studies about the communication of research on Twitter, specifically climate change research. We provided a category to 70% of Twitter bios for this study. Unidentified descriptions include those not written in English or French–language for which we were sufficiently fluent–and those not specific enough to be matched to one of our categories.

thumbnail
Table 1. Categories and matching expressions used for textual analysis of Twitter descriptions.

https://doi.org/10.1371/journal.pone.0268999.t001

Results

General results

Our final dataset included 19 783 unique Twitter accounts. We assigned at least one category to 69.9% of the accounts (n = 13 821) by using our code to detect expressions in Twitter bios, and 36.2% (n = 7 155) matched to only one category, and 33.7% (n = 6 666) to multiple categories (Table 2). Academia is the largest category across all papers at 5 545 users, representing 28% of our dataset. Personal assignations represent a quarter of the dataset. Publishers and bots are the less visible categories, both under 2%. However, accounts posting automated content do not usually identify as such. Therefore, a low representation of automated accounts is mostly an artefact of the method used in our study, as it is probably much higher (24). The number of unique users was slightly higher in 2015 (n = 11 745) than 2016 (n = 10 467). We also notice a higher uptake by Personal, Professional, Political and Communication public in 2015, potentially indicating higher engagement outside of academia. Academia, Organizations, Publishers and Robots are proportionally more represented in 2016. Academia and Organizations engaged with the most papers in our dataset, whereas Political, Publishers and Bots assigned users engaged with the least. Bots and Academia have the lowest median in number of followers, Communication and Publishers the highest. This may indicate that communicators and publishers tend to fulfill a role of sharing research with a larger network of persons than other group of users. These trends are similar for 2015 and 2016, although number of followers of users tweeting the papers of our dataset were higher in 2015.

Looking at overlaps between categories, Academia/Personal and Academia/Organizations are the most present in users’ descriptions (Table 3). The large number of overlaps across all categories indicate that the assignations of based on unique identity markers significantly reduces the complex ways in which users present themselves to others on Twitter. As such, the complexity of identifying who share research papers on Twitter may be best documented by looking at multiple categories and in the context of individual papers.

thumbnail
Table 3. Number of Twitter bios with unique of multiple categories.

https://doi.org/10.1371/journal.pone.0268999.t003

Publics in highly tweeted papers

We looked at the five most tweeted papers per year to categorize who are users sharing popular scholarly documents about climate change research on Twitter (Table 4). Most papers have between 65 and 75% of the users sharing them assigned to at least one category, except the article Oxygen isotope in archaeological bioapatites from India: Implications to climate change and decline of Bronze Age Harappan civilization at 46.6%. The representation of users assigned to Academia is lower than the mean of 28% of our dataset for nine out of the ten. Overall, variations between how categories are represented between articles highlight the different contexts in which individual papers are shared, thus providing a basis to assess how and why they get attention.

The Ecological networks are more sensitive to plant than to animal extinction under climate change was shared by 47.8% of the accounts assigned to Academia, indicating a significant engagement by the research community. For some papers, the Twitter profiles of users assigned to Academia have important overlap with other categories (S1 Table in S1 File). For example, the paper Health and climate change: policy responses to protect public health was tweeted by 27.8% of the Academia assignations overlapping with Professional category. A manual validation of the results indicates that most assignations to Academia indeed represent scholars and researchers, with very few discrepancies. This highlights the potential of word detection to assess the representation of scholars in a dataset of papers shared on Twitter, at least in terms of precision. However, there is a possibility that scholars were not categorized as such depending on the words used in their Twitter bios. Other methods are better suited to assess overall participation by scholars [3, 57, 58], whereas our method focuses on their participation according to other groups of users.

The proportion of users assigned to the Communication category is higher when more users shared a specific paper. Some papers show important overlaps between Communication and Academia such as Ecological networks are more sensitive to plant than to animal extinction under climate change (56%) and Assessing the Performance of EU Nature Legislation in Protecting Target Bird Species in an Era of Climate Change (44.4%) (S2 Table in S1 File). There is also large variations for the Communication and Political overlaps, ranging from 2.6% (Climate change impacts on bumblebees converge across continents) to 23.9% (Accelerating extinction risk from climate change), and the Communication and Professional overlaps, ranging from 12.5% (Global and regional health effects of future food production under climate change: a modelling study) to 34.2% (Climate change impacts on bumblebees converge across continents). The Personal category has the most overlap with Communication in the most tweeted papers, with no paper having a proportion lower than 32% and the highest at 52.5% (Accelerating extinction risk from climate change). This indicate that communicators may use a large share of personal keywords and expressions to build their perceived identity on Twitter.

Assignations to the Political category range from 8.2% (Oxygen isotope in archaeological bioapatites from India: Implications to climate change and decline of Bronze Age Harappan civilization) to 23.9%. (The geographical distribution of fossil fuels unused when limiting global warming to 2 degrees C). Papers focusing on sensitive topics (such as The geographical distribution of fossil fuels unused when limiting global warming to 2 degrees C and Health and climate change: policy responses to protect public health) may engage more users with significant political motivations. Two papers have an elevated overlap between Academia and Political (Ecological networks are more sensitive to plant than to animal extinction under climate change; 36% and Assessing the Performance of EU Nature Legislation in Protecting Target Bird Species in an Era of Climate Change; 32.3%) (S3 Table in S1 File). This may indicate that a significant share of users from the research community also embrace political action when it comes to climate change.

Users assigned to the Professional category range from 10.9% (Ecological networks are more sensitive to plant than to animal extinction under climate change) to 23.1%. (Health and climate change: policy responses to protect public health). The paper Oxygen isotope in archaeological bioapatites from India: Implications to climate change and decline of Bronze Age Harappan civilization has close to half (45.2%) of its Professional assignations not overlapping with any other categories (S4 Table in S1 File). Two papers, Global and regional health effects of future food production under climate change: a modelling study and Assessing the Performance of EU Nature Legislation in Protecting Target Bird Species in an Era of Climate Change, have a low share of overlap with Communication at respectively 6.3% and 8.9%. However, this paper has a large share of overlap with the Personal category at 57.8%. Overall, Professional and Personal overlapping is high across all the most tweeted papers, with the lowest at 29.8%.

The largest share of Personal assignations is with the most tweeted paper, Climate change in the Fertile Crescent and implications in the recent Syrian drought, at 34.7%, whereas two papers (Oxygen isotope in archaeological bioapatites from India: Implications to climate change and decline of Bronze Age Harappan civilization at 21.2% and Ecological networks are more sensitive to plant than to animal extinction under climate change at 21.4%) have the lowest share. These two papers represent both extremes of the range of unique assignations, at respectively 47.4% and 18.6% of accounts assigned to the Personal category (S5 Table in S1 File). The second most important share of unique assignations is with the paper Climate change in the Fertile Crescent and implications in the recent Syrian drought at 42.9%. The paper Ecological networks are more sensitive to plant than to animal extinction under climate change show here again a high overlap of Personal assignations with the Academia category, at 59.3%. Finally, the paper Assessing the Performance of EU Nature Legislation in Protecting Target Bird Species in an Era of Climate Change has a low overlap of Personal assignations with the Communication category (7.8%) while high with the Professional category (33.8%). These results highlight the significant use of personal identity markers across all publics. In this regard, users assigned only to the Personal category may represent what is coined as the lay public.

Discussion

A key challenge in assessing who tweets scholarly documents through Twitter profile descriptions is defining the use and meaning of identity markers in expressions employed by users. Analysis relying only on Twitter data is a complex endeavor as we seldom know who is exactly behind an account. To circumvent some of these issues, our analysis categorized profile according to eight types of users sharing climate change research papers on Twitter. Specifically, we categorized expressions and keywords used in Twitter profile descriptions to assess how they represent identity markers, and so type of users sharing climate change research papers. As with other studies, the detection of words related to the academic world is precise in that it reflects potential individual users involved in research, although it does not distinguish how close their research interests are to the topic at hand [57, 76]. The overlap with other categories also shows how actors of research are not restricted to this role, whether through communicational (science communication), professional (administrative functions), political (policy making) or simply personal (being a parent, having pets, hobbies) activities [77]. Profiles categorized in Communication mostly encompasses journalists and communication professionals, authors, artists, and overlaps with political and professional expressions represents users who may engage in political campaigning, policymaking. Political assignations highlight users who present themselves through social issues and activism, some through related professional work. Professional assignations highlight those whose work relate closely to climate change mitigation efforts, for example risk management, or other specific professional activities, such as veterinarians or lawyers. Finally, personal assignations indicate how users identify themselves through their hobbies or personal interests and relationships. When it is the only categorization, it may indicate users who engage with research through pure curiosity, thus incarnate what we commonly refer to as the “general public” [46, 78].

Assignations to organizations represent both organizational accounts (universities, departments, centers, governmental institutions, private companies, etc.) and individuals who employ expressions relating to these institutions [53]. Thus, the proportion of assignations to Organizations represent both these organizations through their specific accounts as well as individuals who use these organizations as identity markers. However, the Organizations category relies on words that have meanings beyond clear groups or institutions, such as “society”. A word like society may express a delineated entity, such as the “Society for X Research”, or an abstract entity, such as society as the realm of social interactions. Future research needs to take this into account, whether by adding to the dictionary, excluding problematic expressions, or refining interpretations, depending on the goals at hand.

The relative frequencies of assignations within articles provide an overall assessment of the potential groups who shared research documents on Twitter. Focusing on a selection of highly tweeted papers in climate change research in 2015 and 2016, our results indicate that expressions relating to Academia and Personal identity markers are used to a large extent, whether through unique assignations or overlap other categories. The academic community is usually the largest group sharing research on Twitter, with a diversity of different publics across individual papers. Meanwhile, political assignations look to be more present in papers discussing sensitive topics, such as fossil fuel consumption or the contribution of climate change to geopolitical conflicts. Knowing how various publics engage with individual papers may help detect trends in public communication of research, both in general datasets or specific subsets. It may also help to document how papers circulate within specific communities. For example, we see quite different patterns between the papers Ecological networks are more sensitive to plant than to animal extinction under climate change and Oxygen isotope in archaeological bioapatites from India: Implications to climate change and decline of Bronze Age Harappan civilization. The first one has a significant share of users assigned to Academia, hereby indicating a significant participation by the research community. The other paper has the lowest share of academic participation of the papers showcased in this study. These examples illustrate how estimates of the variety of users sharing individual papers provide a basis to further contextualize the repercussions of research dissemination on Twitter, especially for topics like climate change that resonate differently across distinct groups such as conservation specialists or concerned citizens. A qualitative survey of the results then provides meaning to these estimates and helps validate and refine each category.

Our study has some limits due to the mediated characteristics of Twitter data, and the epistemological and technical choices made prior and through the design of the study. Word detection works as a proxy for the categorization of users but does not provide a direct assessment of “who” really participates to discussions about climate change research on Twitter [1, 28]. It is hardly possible to access the user behind an account through automated data analysis. We also rely on information chosen explicitly by the user and do not have access to all the choices made for the preparation of their Twitter profile description. While, this allows users to identify themselves to others in their own words and make their identities visible in ways they chose, our interpretations are based solely the identify markers we have access to.

We also chose to categorize users Twitter profile by assigning categories to them and by going back and forth between an automatic method of expressions detection and a manual coding. These categories were chosen according the litterature to make sense of public research communication activities on Twitter [1, 3, 16, 28, 51]. We hypothesized that examining the words and expressions employed by users would allow to investigate the extent to which various communities share climate change research on Twitter. Our analysis relies mainly on the presence or absence of specific expressions. This allows for flexibility to assess who tweets different sets of documents as context is dynamic. However, choices need to be made clear to provide interpretation about how specific expressions are used in various contexts. Moreover, some categories may need to be revisited for further development or be assessed in conjunction with other methods, such as distinguishing between individuals or organizations or detecting accounts posting automated content [46].

Despite these caveats, this study present elements to assess the potential publics of climate change research on Twitter by taking context into account. We see how individual documents are shared beyond strict scholarly communities and in specific groups. Our results, while focusing on highly tweeted papers about climate change, indicate that academia is the main group involved, but that specific papers also reach a variety of publics, whether professional, political and personal, depending on the context in which they are shared. The method we deployed is readily usable across large sets of documents, flexible in that words and categories may be modulated and refined according to research objectives, and provide key insights about ‘who’ tweets research on Twitter. It may also be used in conjunction with other methods to further describe these assessments as well as provide statistical or qualitative observations to what is observed. By focusing on the Twitter descriptions of users, we can work directly with identity markers chosen by users on Twitter. Future research may refine the choices made building this tool. Overall, it serves as a step for future work about who tweets research document in conjonction with other methods, such as social network analysis [32]. It also provides new elements to contextualize the reach of scholarly documents on Twitter.

Conclusion

This study focused on the categorization of users sharing climate change research papers on Twitter by using a word detection method based on profile descriptions. While our results do not provide a direct assessment of who tweet research due to the characteristics of identity markers in Twitter profile descriptions, it provides insights about how documents may permeate outside of academia and in various communities. Focusing on a subset of highly tweeted papers about climate change, we see how different group of users share research papers on Twitter. As such, we provide information about who tweets individual documents to further describe the specific contexts in which this research circulates. We proposed a framework that is flexible as we presented one set of categories and expression. These may be easily changed, based on qualitative assessment, to assess different group of users in other Twitter scholarly communication research. Moreover, moving between automated word analysis and qualitative assessment helps inform the interpretations of who is represented through these groups. As such, it highlights how contextual observations will help to better inform the reach of research documents on social media.

Acknowledgments

We would like to thank Stefanie Haustein and Juan Pablo Alperin from the ScholCommLab for their help and feedback regarding the analysis. We would also like to thank Matisse Dagenais and Sandrine Dagenais in helping build the codebook.

References

  1. 1. Haustein S. Scholarly Twitter Metrics. In Glänzel W, Moed HF, Schmoch U, Thelwall M, editors. Springer Handbook of Science and Technology Indicators. Springer; 2019. pp. 729–760.
  2. 2. Priem J, Taraborelli D, Groth P, Neylon C. Altmetrics: a manifesto. 2010. http://altmetrics.org/manifesto/
  3. 3. Sugimoto CR, Work S, Larivière V, Haustein S. Scholarly use of social media and altmetrics: A review of the literature. Journal of the Association for Information Science and Technology. 2017;68: 2037–2062.
  4. 4. Díaz-Faes AA, Bowman TD, Costas R. Towards a second generation of ‘social media metrics’: Characterizing Twitter communities of attention around science. PLOS ONE. 2019;14: e0216408. pmid:31116783
  5. 5. Araujo RF. Communities of attention networks: introducing qualitative and conversational perspectives for altmetrics. Scientometrics. 2020;124: 1793–1809.
  6. 6. Bruns A. After the ‘APIcalypse’: social media platforms and their fight against critical scholarly research. Information, Communication & Society. 2019;22: 1544–1566.
  7. 7. Puschmann C. An end to the wild west of social media research: a response to Axel Bruns. Information, Communication & Society. 2019;22: 1582–1589.
  8. 8. Bruns A, Weller K. Twitter data analytics–or: the pleasures and perils of studying Twitter. Aslib Journal of Information Management. 2014;66.
  9. 9. Crawford K. Atlas of Ai: power, politics, and the planetary costs of artificial intelligence. New Haven: Yale University Press; 2021.
  10. 10. D’Ignazio C, Klein LF. Data Feminism. MIT Press; 2020. https://data-feminism.mitpress.mit.edu/
  11. 11. Ripple WJ, Wolf C, Newsome TM, Barnard P, Moomaw WR. World Scientists’ Warning of a Climate Emergency. BioScience. 2020;70: 8–12.
  12. 12. Watts N, Amann M, Ayeb-Karlsson S, Belesova K, Bouley T, Boykoff M, et al. The Lancet Countdown on health and climate change: from 25 years of inaction to a global transformation for public health. The Lancet. 2018;391: 581–630. pmid:29096948
  13. 13. Besley J, Dudo A. Scientists’ Views about Public Engagement and Science Communication in the Context of Climate Change. 2017.
  14. 14. IPCC. Summary for Policymakers. In Stocker TF, Qin D, Plattner G-K, Tignor M, Allen SK, Boschung J, et al., editors. Climate Change 2013: The Physical Science Basis Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. Cambridge University Press; 2013. http://www.climatechange2013.org/images/report/WG1AR5_SPM_FINAL.pdf
  15. 15. Tandoc EC Jr, Eng N. Climate Change Communication on Facebook, Twitter, Sina Weibo, and Other Social Media Platforms. Oxford Research Encyclopedia: Climate Science. 2017. https://doi.org/10.1093/acrefore/9780190228620.013.361
  16. 16. Walter S, Lörcher I, Brüggemann M. Scientific networks on Twitter: Analyzing scientists’ interactions in the climate change debate. Public Understanding of Science. 2019;28: 696–712. pmid:31027461
  17. 17. Newman TP. Tracking the release of IPCC AR5 on Twitter: Users, comments, and sources following the release of the Working Group I Summary for Policymakers. Public Understanding of Science. 2017;26: 815–825. pmid:26868025
  18. 18. Bolsen T, Shapiro MA. Strategic Framing and Persuasive Messaging to Influence Climate Change Perceptions and Decisions. Oxford Research Encyclopedia: Climate Science. 2017. https://doi.org/10.1093/acrefore/9780190228620.013.385
  19. 19. van Eck CW, Mulder BC, Dewulf A. Online Climate Change Polarization: Interactional Framing Analysis of Climate Change Blog Comments. Science Communication. 2020;42: 454–480.
  20. 20. Hestres LE, Hopke JE. Internet-Enabled Activism and Climate Change. Oxford Research Encyclopedia: Climate Science. 2017. https://doi.org/10.1093/acrefore/9780190228620.013.404
  21. 21. Holmberg DK, Hellsten DI. Organizational Communication on Twitter: Differences Between Non-Profit and For-Profit Organizations in the Context of Climate Change. In Schmidt CM, editor. Crossmedia-Kommunikation in kulturbedingten Handlungsräumen. Springer Fachmedien Wiesbaden; 2016. pp. 305–313. https://doi.org/10.1007/978-3-658-11076-5_16
  22. 22. Segerberg A, Bennett WL. Social Media and the Organization of Collective Action: Using Twitter to Explore the Ecologies of Two Climate Change Protests. The Communication Review. 2011;14: 197–215.
  23. 23. Segerberg A. Online and Social Media Campaigns for Climate Change Engagement. Oxford Research Encyclopedia: Climate Science. 2017. https://doi.org/10.1093/acrefore/9780190228620.013.398
  24. 24. Jahng MR, Lee N. When Scientists Tweet for Social Changes: Dialogic Communication and Collective Mobilization Strategies by Flint Water Study Scientists on Twitter. Science Communication. 2018;40: 89–108.
  25. 25. Bowman TD. Investigating the use of affordances and framing techniques by scholars to manage personal and professional impressions on Twitter. Dissertation, Indiana University. 2015.
  26. 26. Holmberg K, Thelwall M. Disciplinary differences in Twitter scholarly communication. Scientometrics. 2014;101: 1027–1042.
  27. 27. Priem J. Altmetrics. In Cronin B, Sugimoto CR, editors. Beyond bibliometrics: harnessing multidimensional indicators of performance. MIT Press; 2014. pp. 263–287.
  28. 28. Vainio J, Holmberg K. Highly tweeted science articles: who tweets them? An analysis of Twitter user profile descriptions. Scientometrics. 2017;112: 345–366.
  29. 29. Bornmann L, Haunschild R, Marx W. Policy documents as sources for measuring societal impact: how often is climate change research mentioned in policy-related documents? Scientometrics. 2016;109: 1477–1495. pmid:27942080
  30. 30. Haustein S, Bowman TD, Costas R. Interpreting “altmetrics”: Viewing acts on social media through the lens of citation and social theories. In Sugimoto CR, editor. Theories of Informetrics and Scholarly Communication. De Gruyter Mouton; 2016. pp. 372–405.
  31. 31. Kassab O, Bornmann L, Haunschild R. Can altmetrics reflect societal impact considerations: Exploring the potential of altmetrics in the context of a sustainability science research center. Quantitative Science Studies. 2020; 1–18.
  32. 32. Alperin JP, Gomez CJ, Haustein S. Identifying diffusion patterns of research articles on Twitter: A case study of online engagement with open access articles. Public Understanding of Science. 2018;28: 2–18. pmid:29607775
  33. 33. Haunschild R, Bornmann L, Marx W. Climate Change Research in View of Bibliometrics. PLOS ONE. 2016;11: e0160393. pmid:27472663
  34. 34. IPCC. Climate Change 2014 Synthesis Report Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change [Core Writing Team, R.K. Pachauri and L.A. Meyer (eds.)]. IPPC—Intergovernmental Panel on Climate Change; 2014, p. 151.
  35. 35. Hopke JE, Hestres LE. Visualizing the Paris Climate Talks on Twitter: Media and Climate Stakeholder Visual Social Media During COP21. Social Media + Society. 2018;4: 2056305118782687.
  36. 36. Pearce W, Holmberg K, Hellsten I, Nerlich B. Climate change on twitter: Topics, communities and conversations about the 2013 IPCC Working Group 1 report. PLoS ONE. 2014;9: e94785. pmid:24718388
  37. 37. Walter S, Silva-Schmidt FD, Brüggemann M. Digital Traces in Context| From “Knowledge Brokers” to Opinion Makers: How Physical Presence Affected Scientists’ Twitter Use During the COP21 Climate Change Conference. International Journal of Communication. 2017;11: 570–591.
  38. 38. Bruns A, Burgess J. Twitter hashtags from ad hoc to calculated publics. In Rambukkana N, editor. Hashtag Publics: The Power and Politics of Discursive Networks. Peter Lang; 2015. pp. 13–28.
  39. 39. Thelwall M, Tsou A, Weingart S, Holmberg K, Haustein S. Tweeting Links to Academic Articles. Cybermetrics: International Journal of Scientometrics, Informetrics and Bibliometrics. 2013;17: 1–8.
  40. 40. Holmberg K, Hellsten I. Twitter Campaigns Around the Fifth IPCC Report: Campaign Spreading, Shared Hashtags, and Separate Communities. SAGE Open. 2016;6: 2158244016659117. https://doi.org/10.1177/2158244016659117
  41. 41. Moukarzel S, Rehm M, del Fresno M, Daly AJ. Diffusing science through social networks: The case of breastfeeding communication on Twitter. PLoS ONE. 2020;15: e0237471. pmid:32790712
  42. 42. Moscrop D, Wong L, Alperin JP. Have You Seen This? Why Political Pundits Share Scholarly Research on Social Media. Scholarly and Research Communication. 2020;11: 21.
  43. 43. Yeo SK, Su LY-F, Cacciatore MA, McKasy M, Qian S. Predicting Intentions to Engage With Scientific Messages on Twitter: The Roles of Mirth and Need for Humor. Science Communication. 2020;42: 481–507.
  44. 44. Leas EC, Althouse BM, Dredze M, Obradovich N, Fowler JH, Noar SM, et al. Big Data Sensors of Organic Advocacy: The Case of Leonardo DiCaprio and Climate Change. PLOS ONE. 2016;11: e0159885. pmid:27482907
  45. 45. Kwak H, Lee C, Park H, Moon S. What is Twitter, a social network or a news media? Proceedings of the 19th international conference on World wide web—WWW ‘10. ACM Press; 2010. p. 591. https://doi.org/10.1145/1772690.1772751
  46. 46. Haustein S, Toupin R, Alperin JP. “Not sure if scientist or just Twitter bot” Or: Who tweets about scholarly papers. Altmetric. 12 Jul 2018. https://www.altmetric.com/blog/not-sure-if-scientist-or-just-twitter-bot-or-who-tweets-about-scholarly-papers/
  47. 47. Mislove A, Lehmann S, Ahn Y-Y, Onnela J-P, Rosenquist JN. Understanding the Demographics of Twitter Users. ICWSM. 2011. pp. 554–557.
  48. 48. Pew Research Center. Sizing Up Twitter Users. Pew Research Center; 2019. https://www.pewresearch.org/internet/2019/04/24/sizing-up-twitter-users/
  49. 49. Work S, Haustein S, Bowman TD, Larivière V. Social Media in Scholarly Communication. A Review of the Literature and Empirical Analysis of Twitter Use by SSHRC Doctoral Award Recipients. Social Sciences and Humanities Research Centre; 2015. https://crctcs.openum.ca/files/sites/60/2015/12/SSHRC_SocialMediainScholarlyCommunication.pdf
  50. 50. Domenget J-C. Usages professionnels et figures d’usager des médias socionumériques. Revue française des sciences de l’information et de la communication. 2015;6.
  51. 51. Côté IM, Darling ES. Scientists on Twitter: Preaching to the choir or singing from the rooftops? FACETS. 2018;3: 682–694.
  52. 52. Carlson J, Harris K. Quantifying and contextualizing the impact of bioRxiv preprints through automated social media audience segmentation. PLoS Biology. 2020;18: e3000860. pmid:32960891
  53. 53. Tsou A, Bowman TD, Ghazinejad A, Sugimoto CR. Who tweets about science? Proceedings of the 2015 international society for scientometrics and informetrics. 2015. pp. 95–100.
  54. 54. Bex RT, Lundgren L, Crippen KJ. Scientific Twitter: The flow of paleontological communication across a topic network. PLOS ONE. 2019;14: e0219688. pmid:31361749
  55. 55. How does Altmetric track Twitter. DS Metrics [Internet]. [cited 23 May 2021]. https://help.altmetric.com/support/solutions/articles/6000235926-twitter
  56. 56. Holmberg K, Bowman TD, Haustein S, Peters I. Astrophysicists’ Conversational Connections on Twitter. PLoS ONE. 2014;9: e106086. pmid:25153196
  57. 57. Costas R, Mongeon P, Ferreira MR, van Honk J, Franssen T. Large-scale identification and characterization of scholars on Twitter. Quantitative Science Studies. 2020; 1–21.
  58. 58. Ke Q, Ahn Y-Y, Sugimoto CR. A systematic identification and analysis of scientists on Twitter. PLOS ONE. 2017;12: e0175368. pmid:28399145
  59. 59. Birkle C, Pendlebury DA, Schnell J, Adams J. Web of Science as a data source for research on scientific and scholarly activity. Quantitative Science Studies. 2020;1: 363–376.
  60. 60. Larivière V, Desrochers N. Langues et diffusion de la recherche: le cas des sciences humaines et sociales. Acfas Magazine. 2015. https://www.acfas.ca/publications/magazine/2015/11/langues-diffusion-recherche-cas-sciences-humaines-sociales
  61. 61. Haunschild R, Leydesdorff L, Bornmann L, Hellsten I, Marx W. Does the public discuss other topics on climate change than researchers? A comparison of explorative networks based on author keywords and hashtags. Journal of Informetrics. 2019;13: 695–707.
  62. 62. Wickham H, Averick M, Bryan J, Chang W, McGowan L, François R, et al. Welcome to the Tidyverse. JOSS. 2019;4: 1686.
  63. 63. Wickham H. ggplot2. WIREs Comp Stat. 2011;3: 180–185.
  64. 64. Lehmkuhl M, Promies N. Frequency distribution of journalistic attention for scientific studies and scientific sources: An input–output analysis. PLOS ONE. 2020;15: e0241376. pmid:33175868
  65. 65. Toupin R, Haustein S. 2nd Codebook for users categorization—Climate change research. figshare; 2019. https://doi.org/10.6084/M9.FIGSHARE.8236598.V3
  66. 66. Kelley CP, Mohtadi S, Cane MA, Seager R, Kushnir Y. Climate change in the Fertile Crescent and implications of the recent Syrian drought. Proc Natl Acad Sci USA. 2015;112: 3241–3246. pmid:25733898
  67. 67. McGlade C, Ekins P. The geographical distribution of fossil fuels unused when limiting global warming to 2°C. Nature. 2015;517: 187–190. pmid:25567285
  68. 68. Urban MC. Accelerating extinction risk from climate change. Science. 2015;348: 571–573. pmid:25931559
  69. 69. Watts N, Adger WN, Agnolucci P, Blackstock J, Byass P, Cai W, et al. Health and climate change: policy responses to protect public health. The Lancet. 2015;386: 1861–1914. pmid:26111439
  70. 70. Kerr JT, Pindar A, Galpern P, Packer L, Potts SG, Roberts SM, et al. Climate change impacts on bumblebees converge across continents. Science. 2015;349: 177–180. pmid:26160945
  71. 71. Springmann M, Godfray HCJ, Rayner M, Scarborough P. Analysis and valuation of the health and climate change cobenefits of dietary change. Proc Natl Acad Sci USA. 2016;113: 4146–4151. pmid:27001851
  72. 72. Sarkar A, Mukherjee AD, Bera MK, Das B, Juyal N, Morthekai P, et al. Oxygen isotope in archaeological bioapatites from India: Implications to climate change and decline of Bronze Age Harappan civilization. Sci Rep. 2016;6: 26555. pmid:27222033
  73. 73. Springmann M, Mason-D’Croz D, Robinson S, Garnett T, Godfray HCJ, Gollin D, et al. Global and regional health effects of future food production under climate change: a modelling study. The Lancet. 2016;387: 1937–1946. pmid:26947322
  74. 74. Schleuning M, Fründ J, Schweiger O, Welk E, Albrecht J, Albrecht M, et al. Ecological networks are more sensitive to plant than to animal extinction under climate change. Nature Communications. 2016;7: 13965. pmid:28008919
  75. 75. Sanderson FJ, Pople RG, Ieronymidou C, Burfield IJ, Gregory RD, Willis SG, et al. Assessing the Performance of EU Nature Legislation in Protecting Target Bird Species in an Era of Climate Change: Impacts of EU nature legislation. Conservation Letters. 2016;9: 172–180.
  76. 76. Joubert M, Costas R. Getting to Know Science Tweeters: A Pilot Analysis of South African Twitter Users Tweeting about Research Articles. Journal of Altmetrics. 2019;2: 2.
  77. 77. Van Bavel JJ. Scientists have passions outside the lab. We should embrace that. Science. 2021.
  78. 78. Toupin R, Millerand F, Larivière V. Scholarly communication or public communication of science? Assessing who engage with climate research on Twitter. 17th International Conference on Scientometrics & Informetrics. 2019. pp. 2115–2020. https://crc.ebsi.umontreal.ca/publications/scholarly-communication-or-public-communication-of-science-assessing-who-engage-with-climate-research-on-twitter/