Skip to main content
Advertisement
  • Loading metrics

The role of science in the climate change discussions on Reddit

  • Paolo Cornale,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation ISI Foundation, Turin, Italy

  • Michele Tizzani,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation ISI Foundation, Turin, Italy

  • Fabio Ciulla,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation ISI Foundation, Turin, Italy

  • Kyriaki Kalimeri,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation ISI Foundation, Turin, Italy

  • Elisa Omodei,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Network and Data Science, Central European University, Vienna, Austria

  • Daniela Paolotti,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation ISI Foundation, Turin, Italy

  • Yelena Mejova

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    yelenamejova@acm.org

    Current Address: Via Chisola 5, ISI Foundation, Turin, Italy 10126

    Affiliation ISI Foundation, Turin, Italy

Correction

10 Jun 2025: The PLOS Climate Staff (2025) Correction: The role of science in the climate change discussions on Reddit. PLOS Climate 4(6): e0000657. https://doi.org/10.1371/journal.pclm.0000657 View correction

Abstract

Well-informed collective and individual action necessary to address climate change hinges on the public’s understanding of the relevant scientific findings. Social media has been a popular platform for the deliberation around climate change and the policies aimed at addressing it. Whether such deliberation is informed by scientific findings is an important step in gauging the public’s awareness of scientific resources and their latest findings. In this study, we examine the use of scientific sources in the course of 14 years of public deliberation around climate change on one of the largest social media platforms, Reddit. We find that only 4.0% of the links in the Reddit posts, and 6.5% in the comments, point to domains of scientific sources, although these rates have been increasing in the past decades. These links are dwarfed, however, by the citations of mass media, newspapers, and social media, the latter of which peaked especially during 2019–2020. Further, scientific sources are more likely to be posted by users who also post links to sources having central-left political leaning, and less so by those posting more polarized sources. Scientific sources are not often used in response to links to unreliable sources, instead, other such sources are likely to appear in their comments. This study provides the quantitative evidence of the dearth of scientific basis of the online public debate and puts it in the context of other, potentially unreliable, sources of information.

Introduction

Climate change poses a critical threat that requires urgent global action. Despite a broad scientific agreement around a strong anthropogenic component of climate change [1], as of 2023, only 56% of US respondents to the Yale Climate Opinion survey thought that “most scientists think global warming is happening” [2, 3]. Given the importance of public understanding of the latest scientific findings necessary for informed decision-making, in this study, we examine to what degree scientific resources are used to drive or substantiate the online discussions around climate change, in comparison to other sources, such as news and social media, including sources known to be unreliable.

Despite its privileged status in academia and industry, scientific communication competes for clicks in a cutthroat attention economy of the Web, contending with the fickle proprietary recommendation systems and shortening attention spans of their users [4]. Further, the perception, understanding, and citation of scientific literature by non-experts depend on a myriad of factors, including numerical literacy [5], religious beliefs [6] and spirituality [7], social context [8], as well as moral rhetoric [9] that enforces climate denialism [10]. The direct citation of science on the Web and social media may then suffer from decreased information retention and interest over time [11], and may also be replaced with mainstream news media reporting as a mediator in the access to scientific news [12].

Beyond the traditional mainstream media, social media is becoming an increasingly important source of information, with Pew Research Center concluding in 2023 that half of U.S. adults get news at least sometimes from social media [13]. Climate change debate has been extensively studied on Twitter [14, 15], yielding observations of homophilous segregation of users into like-minded camps of “skeptics” and “activists”, which can be detected via the posted content [16] or network analysis [17], and which intensify during events such as the COP Climate Change conference [18]. However, Reddit—the fifth most visited website in the US [19], which is much less studied—has been shown to display much less polarization than Twitter [20] and may foster more deliberative interactions. The literature is lacking in the broad, longitudinal examination of scientific discourse on this platform, instead focusing on particular subreddits such as r/science [21, 22], or those relevant to the climate change debate, i.e. r/climate or r/climateskeptics [2326]. A broad view of all the Reddit communities is necessary to capture the diversity and reach of this topic in online discourse.

In the US, the debate is further complicated by the politicization of stances around climate change: in 2023, 23% of Republicans considered climate change a major threat, compared to 78% of Democrats [27]. Indeed, the stated policies of the two parties concerning climate change differ substantially: whereas the Democratic party elites have been consistently supportive of the climate consensus [28], the Republican party, and especially its neoliberal champions, argue that environmentalists in the government “intrude” on society by curtailing consumer choice and property rights [29, 30]. In fact, the attitudes towards science, in general, are different between the two parties: 47% of Republicans view science as benefiting society, compared to 69% of Democrats [31]. In this study, we use 14 years of climate change-related Reddit posts and comments spanning thousands of subreddits to gauge the use of scientific resources in this deliberative space, including in the context of political interest. Its results point to a scant, but increasing, utilization of scientific sourcing, more frequently used by those showing center-left political interests. Alas, we find little evidence of it cited in response to information from unreliable sources.

Materials and methods

Reddit dataset collection

We choose a high-precision keyword-based approach to collect a dataset related to Climate Change. This method has been used extensively in the literature [26, 32, 33], as it has been shown that conversations relevant to climate change happen in many subreddits, most of them not devoted exclusively to this topic. We use the data collected by Pushshift via the Reddit API [34] in the 168 months between January 2009 and December 2022. Using manual examination of the dataset, we compose a set of 64 word bigrams (e.g., “global warming”) that maximize the coverage and minimize false positives (see S1 Table). We first collect the posts and comments that contain at least one of these bigrams in the title (for posts) or the content (posts and comments). We then add to our dataset all comments to the selected posts regardless of their match to the keywords list. The matching resulted in 1,301,970 posts and 6,428,051 comments, and an additional 15,273,754 comments in response to the posts. After removing duplicates, a total of 20,279,912 comments remain in our dataset. The volume of posting increases over time, and peaks around 2019-2020 (see S1 Fig).

To assess the relevance of the resulting dataset, all six authors, who are fluent in English, manually labeled a random sample of the submissions and comments that matched keywords by using three labels: “relevant,” “partially relevant” and “non-relevant.” After labeling 324 posts, we found that 84.9% were labeled as relevant, 10.5% as partially relevant, and 4.6% as non-relevant. The Cohen’s kappa, computed on a sample of 60 posts, is . After labeling 384 comments that matched keywords, 79% were judged to be relevant, 16% as partially relevant, and 5% as non-relevant. The Cohen’s kappa, computed on a sample of 66 comments, is . The comments in response to relevant posts were often too short and uninformative to be accurately labeled. We assume they are relevant in the discussion, because they are answers to posts mostly considered pertinent.

Sources of information

As the focus of this study is the citation of different kinds of information, and specifically science, we consider the URLs shared in the posts and comments that talk about climate change. We disregard URLs pointing to Reddit itself and resolve URLs to web.archive.org or archive.is—the two most popular archive services for web pages in our dataset. In our study, we consider only the subreddits that have shared at least 10 URLs in the 14 years of the dataset. The remaining 7837 subreddits (12.19% of the total) allow us to keep 778,728 (96.83%) URLs shared in the posts, and 2,929,061 (99.00%) URLs of the comments.

We then focus on the domains of the extracted URLs and define six categories characterizing them as sources of information: social media, newspapers, mass media, WikiMedia, governmental sources, and scientific sources (see S2 Table for a summary of the categories). We use both external sources to create the lists of domains of interest, as well as examine the top 100 domains used in our dataset that are not part of any list. By social media, we consider the six most popular ones in our dataset: Twitter, YouTube, Facebook, Instagram, LinkedIn, and Discord (“twitter.com,” “youtube.com,” “facebook.com,” “instagram.com,” “linkedin.com,” “discord.gg,” “discord.com”). We obtain the list of 4898 newspapers (with their domains) from the media portal Scimago, with the addition of Financial Times “ft.com" from the manual domain examination. The list of mass media is taken from the media ranking website AllSides, in particular by looking at four types of sources: News Media, Reference, Fact Check, and Think Tank/Policy Groups. We do not consider the individual authors. After removing domains already in other categories, the mass media list has 1623 domains. We cleaned this list by removing the sources added to other categories, and added 9 domains from manual examination (“huffingtonpost.com,” “businessinsider.com,” “abc.net.au,” “pbs.twimg.com,” “msn.com,” “news.gallup.com,” “nationalobserver.com,” “ctvnews.ca,” “oann.com”).

The WikiMedia category contains all the domains from the official webpage of the Wikimedia Foundation Project (https://wikimediafoundation.org/our-work/wikimedia-projects/#a2-collectionshttps://foundation.wikimedia.org/wiki/Home), adding also “upload.wikimedia.org,” used for access to the media files. In total, there is an amount of 28 domains in this category. For the governmental sources, we consider the domains ending with “.gov,” dropping the 4 that appear in the scientific journal list (“cdc.gov,” “ehp.niehs.nih.gov,” “nist.gov,” “wwwnc.cdc.gov”) and “eric.ed.gov” that is a preprint domain. In total, this category has 3194 .gov domains. To these ones, we added 39 domains collected from the official UN website (https://www.un.org/en/about-us/un-system).

For the scientific sources, we make a distinction between four subcategories: magazines, journals, scientific news aggregators, and preprints.

  • Magazines—the mainstream scientific source of information written for the general non-expert public. We obtain the list of the most popular English-language magazines, with their websites, from Wikipedia (https://en.wikipedia.org/wiki/Category:Science_and_technology_magazines_by_country) and manual research on the Web. After removing the few peer-reviewed ones (because they are considered journals), we collected 185 magazine URLs.
  • Journals—a peer-reviewed publication, written by and for experts. We obtain a list of journals by scraping the platform Web of Science (https://wosjournal.com/). After removing the journals without a URL (generally, they have only the link to the publisher, which could be misleading), we manually added different variations of domains, resulting in 1943 different domains.
  • Scientific news aggregators—web applications that aggregate scientific or technological content from different sources, which are not necessarily peer-reviewed. After manual research on the Web, we collect five: “sciencedaily.com,” “phys.org,” “eurekalert.org,” “esciencenews.com” and “researchgate.net.”
  • Preprints—scientific papers published before the peer-review process. We scrape their directories from the Directory of Open Access Preprint Repositories webpage (https://doapr.coar-repositories.org/repositories/), collecting 83 preprint domains.

We make the full list of domains and their categories available to the research community (https://github.com/ymejova/climate_sources_on_reddit).

To supplement our understanding of the quality of the domains, we use previous literature and reputable sources to create a list of unreliable domains. For this purpose, we use the Wikipedia Lists of fake news websites (https://en.wikipedia.org/wiki/List_of_fake_news_websites#Lists, https://en.wikipedia.org/wiki/List_of_miscellaneous_fake_news_websites), Media Bias Fact-Check (MBFC) lists of conspiracy and fake news webistes (https://mediabiasfactcheck.com/conspiracy/, https://mediabiasfactcheck.com/fake-news/) and previous literature on climate change on Reddit [23]. Additionally, we use the media ranking website All Sides political bias domain labels, merging “right” and “center right” into “right” labels and similarly for “left".

Finally, we enrich the domain list with (US-centric) political leaning information from AllSides, which provides five labels: left, left-center, center, right-center, and right. For computing statistics, we merge “right” and “center right” into “right” labels and similarly for “left.” On the other hand, when we compute a political bias score for each subreddit based on the URLs appearing in its posts and comments, we assign numerical values to these labels from –2 to 2 (from “left” to “right”) and average these scores for each subreddit. We perform the same computation for the users to summarize the political leaning of the URLs they have shared in our dataset. To avoid noise due to sparsity (wherein not enough URLs were posted by each user), we examine the distribution of these scores. To gauge the sparsity of the dataset, we plot the distribution of the user scores for users having at least t links with bias information, where t is a threshold from 1 to 10 (see S2 Fig). We then compute the Jensen-Shannon Distance between the pairs of consecutive distributions. We choose as the threshold 5, as the first time the Jensen-Shannon Distance between the distributions is lower than 0.2 is between thresholds 5 and 6. Thus, for further analysis, we consider only the users that shared at least 5 URLs with a known bias score, resulting in 24,453, which is 14.6% of the users in the whole dataset.

Modeling scientific URL use

We compute the political bias score for the users in a similar way as we have for the subreddits and we keep only the users that shared at least 5 biased links. Therefore, we consider 26,620 users. In order to find the most relevant attributes related to the sharing of scientific links, we decided to build an explanatory model by focusing on the different number of categories of domains and on the top 100 subreddits (by the number of links) in our dataset. The remaining subreddits are placed in the “other subreddits” variable. We remove every scientific reference in the design matrix, both in the politically biased links (some scientific sources have a “central” bias) and in the number of URLs shared on the subreddits. After shuffling the data, we take the logarithm of each of these numeric values (to which 1 was previously added [35], to compute the logarithm of the zeros) because the data is highly skewed/asymmetrical and run a Random Forest model having the number of scientific links as the dependent variable. We use 3-fold cross-validation to find the best values of the hyperparameters (number of trees and their depth) obtaining an average score (i.e., mean accuracy) of 0.63. Finally, we explain the model with SHAP (SHapley Additive exPlanations), a method that uses the Shapley values from cooperative game theory to explain how the coefficients of the model interact with the output [36].

Conditional probability of URL in response

To better understand how the different URL categories are used in response to potentially politically biased content, we compute the conditional probabilities as follows. Given a post with a URL of a particular category, we compute the conditional probability that a URL of another category is used in a first-level comment to that post. Note that, for this computation, we consider all posts that have at least one URL, and all first-level comments to them that have at least one URL.

Results

Domain citation and engagement

Using a dataset of 1.3M posts and 20.3M comments on Reddit around the topic of Climate Change, we examine the categories of URLs used in this discussion. We were able to categorize 69.5% of URLs in posts and 55.2% in comments into 6 source types (see the legend of Fig 1A). The largest category of URLs cited in the past 14 years is mass media (30.2% in posts and 15.9% in comments), followed by newspapers and social media. The latter (social media) has especially peaked during 2019 and 2020 (see Fig 1C and 1D). Science-related URLs appear in only 4.0% of URLs in posts and 6.5% in comments, though the proportion of science-related URLs has been increasing in the last decade. These URLs to scientific domains, along with Wikimedia projects (0.1% in posts, 8.8% in comments) and governmental domains (0.5%, 5.7%) appear mostly in comments, rather than posts, pointing to their importance in the substantiation of discussion. Among the scientific URLs, journal domains are more likely to be cited in comments, in comparison to scientific magazines and aggregators (which may have less rigorous inclusion criteria). Interestingly, preprints, which may contain cutting-edge reporting that has not passed peer review, are the least cited scientific domain category, at 0.1% and 0.2% in posts and comments, respectively. The last three statistics shown in Fig 1A are characteristics of URLs that may overlap with those above: domains known to publish unreliable content, and those having a right or left political leaning. Science-related domains are cited at a similar rate to domains known to be unreliable, though these are less likely to be used in the comments (5.4% of URLs in posts and 2.0% in comments). Furthermore, when the political leaning of a URL is known, it is more likely to be left-leaning than right-leaning, pointing to an unequal coverage of the topic. The quality of these URLs is also different between the two sides: 55% of right-leaning URLs in posts and 33% in comments are listed as unreliable, compared to only 0.01% of left-leaning URLs in posts and 0.09% in comments (echoing findings in [37]).

thumbnail
Fig 1. Statistics of URL usage in the dataset:

(a) proportion of URLs in a particular category, separately for posts (preceded with “P”) and comments (preceded with “C” and dashed), (b) engagement with the posts containing a URL of a particular category in terms of the percentage of posts having at least one comment, the average number of comments for posts having at least one comments, and the average length of the comments in terms of words, (c–d) proportion of URLs in a particular category in posts and comments, over time.

https://doi.org/10.1371/journal.pclm.0000541.g001

In terms of engagement, the categories of domains that receive at least one comment are those from Wikimedia, scientific journals, and magazines, followed by the governmental ones (see Fig 1B). Interestingly, despite being a popular domain category, social media receives comparatively fewer comments. However, the average length of the comments, which provides another way to measure engagement, remains remarkably stable across the domain categories, ranging around 47 - 56 words per comment. Whereas left-leaning domains tend to receive more comments compared to right-leaning ones, it is the domains listed as unreliable that receive the longer comments.

The distribution of the scientific links among the subreddits is extremely concentrated, with the top 10 subreddits (by the number of scientific links) accounting for 40.2% of all science-related URLs in our dataset. These include r/worldnews (contributing 20,451 scientific URLs, which make up 7.2% of all URLs in that community in our data), r/science (11,235, 15.4%), r/environment (9665, 7.2%), r/politics (8995, 3.5%), r/collapse (7646, 9.0%), r/climate (7140, 9.8%), r/climateskeptics (6764, 8.0%), r/Futurology (6422, 8.3%), r/climatechange (5741, 14.4%), and r/AskReddit (4600, 8.4%). Among several communities around Climate Change specifically, we also find more general ones, such as r/worldnews and r/politics, as well as r/AskReddit, attesting to the mainstream interest in the topic and the prevalence of scientific referencing even in non-specialized circles. Interestingly, r/climateskeptics, a community dedicated to “Questioning climate related environmentalism” (in the description of the subreddit), contributes over 6K links to science-related domains (which are 8.0% of all domains on that subreddit in our dataset, a similar rate to r/worldnews and r/climate). Turning to users who have contributed the highest number of scientific links, at the top we find ILikeNeurons (15,685), worldnews (20,451), BurnerAcc2020 (3254), AutoModerator (2962), ZephirAWT (2926), Jaagsiekte (2412), EcoInternetNewsfeed (3382), MmmBaconBot (3382), kamjaxx (1093), and avogadros_number (1684). These top 10 users contribute 16.6% of all scientific URLs in our data. We find several accounts (3/10) that are explicitly bots: AutoModerator, EcoInternetNewsfeed, and MmmBaconBot, echoing previous findings on the prevalence of bots on the platform [38]. However, from the behavior of the other accounts, it is likely that they are also at least partially automated, such as the ILikeNeurons. This finding suggests that there is a high number of bots on Reddit, something that was already noted in previous literature [38]. These bots, however, are not necessarily malicious, as they are explicit about their nature, and follow the “bottiquette” (https://www.reddit.com/wiki/bottiquette/) [39, 40]. Given the importance of (semi-)automated accounts, we do not attempt to remove them from our dataset.

Political leaning and scientific citation

Next, we consider users whose link posting activity puts them into the left, center-left, center-right, or right political leaning (as defined by the media bias ratings website AllSides.com). We find that those in the center (especially center-left) are more likely to cite science than those in the extremes (see leftmost panel of Fig 2, and S3 Table). In particular, out of all URLs posted by the center-left users, on average, 7.4% are science-related, whereas 3.3% of the ones posted by center-right users (compared to 2.2% and 0.8% for left and right, respectively). Due to the large dataset sizes, we find all of the within-category differences between the consecutive groups statistically significant at p<0.001, despite the small effect size, except in the case of social media (which all groups of users use at roughly indistinguishable rates). Among the other categories, we find right-leaning users to favor mass media, whereas left, and center-left users – newspapers. The most striking difference between the groups, however, is the posting of unreliable sources, which are more likely to be on the right political spectrum.

thumbnail
Fig 2. Distributions of the proportion of URLs posted by a user that are from a particular category, grouped by users whose URLs have a particular political leaning.

Under each distribution, the mean proportion is shown, and a * is shown between two consecutive groups if their distributions differ using the Kolmogorov-Smirnov two-sample test at p<0.001.

https://doi.org/10.1371/journal.pclm.0000541.g002

To understand the importance of political leaning in comparison with other climate change-related interests of the users, we train a model to predict how many (log-normalized) scientific URLs a user posts in our dataset. Fig 3 shows the SHapley Additive exPlanations (SHAP) graph, a game theoretical approach developed to explain the contribution of each feature to the final output of a ML model [36]. We find that posting such URLs is associated with posting on popular scientific subreddits such as r/science, r/collapse, and r/environment, and, echoing previous results, with posting links with a center-left political leaning. Further, posting scientific URLs is more likely by users who post many kinds of URLs in comments, this relationship is reversed for social media – those posting social media links in their posts are less likely to also post science.

thumbnail
Fig 3. SHapley Additive exPlanations (SHAP), a game theoretical approach for explaining the contribution of each feature to the final output of a ML model.

The Random Forest model predicts how many (log-normalized) science-related URLs a user has posted in our dataset (here, “high” means more URLs were posted), using behavioral features including the categories of the other URLs they shared, as well as the political leaning of those URLs. Top 100 most popular subreddits are used as features, and all others are summed in “other subreddits.”

https://doi.org/10.1371/journal.pclm.0000541.g003

Finally, we explore the relationship between citations in posts and comments (see Fig 4). We find that posts with scientific URLs are much more likely to be responded to with other scientific URLs (26% of the time). Unfortunately, this is not the case for the posts sharing a link to an unreliable source: only 5% of URLs in reply to these are to science sources, instead, links from social media, mass media, and—more likely—other unreliable sources are posted in response. Similarly, posts having right or left-leaning URLs have about the same chance, around 5%, of having a scientific URL in response.

thumbnail
Fig 4. Conditional probability of a first-level comment with a URL containing a certain URL category (columns), given it is in response to a post having a scientific, unreliable, right- or left-leaning URL (rows).

https://doi.org/10.1371/journal.pclm.0000541.g004

In summary, when considering individual users and the political leaning of other sources they cite, we do not find a strong polarization in terms of using scientific sources, with those on center-left being more likely to post science than on center-right. However, the defining feature of Reddit are the community, many of which can revolve around a topic or political theme, and which may have their own cultures beyond individual users. We explore these next.

Case study

To delve further into the nature of the Reddit communities (subreddits), we select several subreddits out of those contributing the most posts to our dataset such that they span a variety of points of view: r/climate and r/climateskeptics (largest climate-related ones); r/science, r/worldnews, and r/politics (more general ones); and r/The_Donald (dedicated to the Republican politician Donald Trump), and r/SandersForPresident (supporting the Independent/Democrat politician Bernie Sanders). Note that, besides having the largest share of posts in our data among politically-oriented subreddits, Donald Trump and Bernie Sanders represent political extremes of the right and left, respectively. See Supplementary Table S4 for statistics on the sizes of these subreddits. Fig 5 shows (a) the percentage of URLs having a particular domain category and (b) the percentage of URLs having a particular political leaning. We find a greater variety of URLs in the comments than in posts, such that we are able to identify the category of fewer URLs in comments. Again, we find science, Wikipedia, and governmental links to often appear in the comments more than in posts. Also, the posts more often contain newspapers, mass, and social media links than the comments. Instead, the comments more often cite Wikipedia, governmental and science links, suggesting these are important sources of argumentation. Unsurprisingly, science links are mentioned the most in the r/science subreddit, but also in the r/climate and r/worldnews. Neither of the political subreddits do not share references to science, suggesting that the political discussion of the subject is not explicitly supported by direct scientific references. In the case of r/climateskeptics, few science URLs are included in posts, but many more are cited in the comments. The subreddit with the most right-leaning URLs is r/The_Donald, with the posts having many more right-leaning URLs than comments (see Fig 5B). We see a similar behavior in r/climateskeptics. The URLs in the rest of the selected subreddits are leaning to the left, with r/SandersForPresident and r/climate ones being the most left-leaning, which is surprising, since r/climate is ostensibly not a political subreddit. In summary, our case study suggests that, despite the Climate Change debate being highly politicized, the use of scientific evidence is lacking in the communities centered around politics, and instead is more prevalent in scientific and even in science-skeptic communities (especially in their comments).

thumbnail
Fig 5. Case study of select subreddits,

( a) the percentage of URLs having a particular domain category and ( b) the percentage of URLs having a particular political leaning. Statistics are shown separately for posts (P) and comments (C).

https://doi.org/10.1371/journal.pclm.0000541.g005

Discussion

Thomas Jefferson is often attributed the (likely apocryphal) quote “An educated citizenry is a vital requisite for our survival as a free people" [41]. Since then, the connection between democratic deliberation and scientific education has been promoted by educators and reformers, such as John Dewey in How We Think [42], and more recently by the U.S. National Research Council, positing that “knowledge of science and engineering is required to engage with the major public policy issues of today” [43]. Our findings show that, in the Reddit discussions of climate change, scientific sources have been dwarfed by links to news and social media, although the share of links to scientific resources has increased in the past decade. When they do appear, they are more likely to be in the comments (along with the links to governmental sources and Wikipedia), pointing to the importance of these resources to the deliberative process around this topic. Unfortunately, we find that scientific links are much more likely to be posted in response to posts with other scientific links, whereas posts having links to unreliable sources do not often receive scientific links in their replies. Instead, other unreliable sources are more likely to be cited.

Meanwhile, surveys show that between 2009 and 2019 (roughly in the duration of the examined data), the share of US respondents who acknowledge an increase in average global temperature rose by 8 percentage points, and the share who believe that humans have contributed to this rose by 11 percentage points [44]. Whether the use of scientific resources contributed to this change of opinion is questionable. Experimental results suggest articles linking to scientific papers promote greater trust, however linking to any mainstream media may have the same effect [45]. We find that scientific links appear not only in communities asserting the existence of anthropogenic climate change, but also in those “skeptical” of it. According to the 2024 report by the Center for Countering Digital Health, climate change denialism has evolved in the past few years, as global temperatures rose dramatically [46]. Instead of opposing the concept of climate change itself, the “New Denial” themes include “the impacts of global warming are beneficial or harmless”, “climate solutions won’t work” and “climate science and the climate movement are unreliable”. The report points specifically to social media companies (including Instagram, Facebook, TikTok, and X (previously Twitter)) as potentially benefiting from the popularity of such content, and allowing for the monetization and direct profit for its creators. What role the latest scientific evidence may play in tackling these New Denial themes is an open question.

However, the mere presence of scientific evidence may not necessarily correspond to a cross-partisan conversation. Psychology literature suggests that individuals more knowledgeable on an issue are more susceptible to selection bias and motivated reasoning [4749]. Our discovery that 9.4% of the URLs in r/climateskeptics community’s comments are scientific links points to the active use of science in the community. Previous studies found that, for instance, vaccine skeptics often express respect for the scientific method and are interested in the rigorous scientific examination of matters affecting them personally [50]. Further, the level of one’s education may affect the trust in climate science via the perception of having a lower or higher social status [51]. To some, attitudes towards climate science may be “not just an opinion on an issue, but [an] aspect of self that defines who they are, what they stand for, and who they stand with (and against)” [52]. Thus, the citation of science may be a part of the construction of self-evaluation as “eco-habitus”, a concept favoring environmental actions and engagement in a “green” lifestyle [53]. [51] found that such a subjective view of one’s social status may contribute to the distrust in climate science. What role the citation of scientific literature plays in the individuals’ formation of a self-image is an interesting future research direction.

In the U.S., a major aspect of such self-image may be one’s political affiliation. The stated policies of the two parties concerning climate change differ substantially: whereas the Democratic party elites have been consistently supportive of the climate consensus [28], the Republican party, and especially its neoliberal champions, argue that environmentalists in the government “intrude” on society by curtailing consumer choice and property rights [29, 30]. Furthermore, concerning science and academia, in the past decade, there has been a sharp decline among Republicans of those who “believe that colleges and universities have a “positive effect” on the country” [54]. However, in our case study, we find that both the Republican (r/The_Donald) and Democrat/Independent (r/SandersForPresident) community had a negligible number of links to scientific sources. The little scientific citation that does circulate in politically-oriented discussions may be influenced by the communiqués of NGOs, think tanks, and government reports (papers cited by such reports are more likely to be highly cited [55]), each bringing its own agenda. Conversely, the perception of a scientific source may be affected by the political stances of its editors [56]. Instead, social media dominates these communities’ links (21% in posts on r/The_Donald and 40% on r/SandersForPresident). As the major social media platforms have been thoroughly documented for spreading scientific misinformation [57, 58], and some smaller ones boasting even more permissive policies [59], the extensive use of these as a resource for policy and science discussions is highly concerning and should be further investigated.

Conclusion

In this study, we quantify the sources of information that are used on one of the largest social media platforms, Reddit, when discussing climate change, with a particular focus on direct links to scientific resources. We find that, although over the past 10 years such links have been used at an increasing rate, on average they constitute 4% of all the links found in relevant posts. These findings point to the lack of scientific communication reach into the public discourse around this topic, despite the importance of the public’s understanding of the scientific findings and consensus around climate. We hope this study motivates further research into the characteristics of successful scientific communication, and into the role of mainstream and social media as intermediaries of scientific findings to the public.

Supporting information

S1 Table. Keywords regarding climate change.

A set of 64 key phrases used to retrieve Reddit posts and comments relevant to the topic of climate change

https://doi.org/10.1371/journal.pclm.0000541.s001

(PDF)

S2 Table. URL domain categories and their sources.

Summary of the domain categories and their sources. Those above double-line are mutually exclusive, whereas those below (unreliable and political leanings) are not.

https://doi.org/10.1371/journal.pclm.0000541.s002

(PDF)

S1 Fig. Volume of Reddit posts and comments around climate change.

Temporal statistics of the dataset (both posts and comments), aggregated by month. The left figure shows the raw number of posts and comments, and the right one shows the proportion of these posts and comments of the whole Reddit posting volume.

https://doi.org/10.1371/journal.pclm.0000541.s003

(TIFF)

S2 Fig. Link-based political leaning of users.

Distribution of link-based political leaning score for users having at least t links with political bias information, where t is a threshold from 1 to 10.

https://doi.org/10.1371/journal.pclm.0000541.s004

(TIFF)

S3 Table. URL sharing behavior of users with political leaning.

Mean, median, and standard deviation of the proportion of URLs of a certain category posted by users having a specific political leaning (identified via other URLs they have shared).

https://doi.org/10.1371/journal.pclm.0000541.s005

(PDF)

S4 Table. Detailed description of the subreddits in the case study.

For each subreddit in the case study, the table shows its description (from Reddit), its membership in terms of users, number of posts and comments in our dataset, and the number of URLs present in these. All statistics were collected in April 2024, except those for The_Donald, which was banned at the time, for which its Wikipedia page was used: https://en.wikipedia.org/wiki/R/The_Donald.

https://doi.org/10.1371/journal.pclm.0000541.s006

(PDF)

References

  1. 1. Abbass K, Qasim MZ, Song H, Murshed M, Mahmood H, Younis I. A review of the global climate change impacts, adaptation and sustainable mitigation measures. Environ Sci Pollut Res Int. 2022;29(28):42539–59. pmid:35378646
  2. 2. Marlon JR, Wang X, Bergquist P, Howe PD, Leiserowitz A, Maibach E, et. al. Change in US state-level public opinion about climate change: 2008 –2020. Environ Res Lett. 2022;17(12):124046.
  3. 3. Marlon J, Goddard E, Howe P, Mildenberger M, Jefferson M, Fine E, et. al. Yale Climate Opinion Maps 2023 ; 2023. Available from: https://climatecommunication.yale.edu/visualizations-data/ycom-us/
  4. 4. Hyland K. Academic publishing and the attention economy. J Engl Acad Purp. 2023;64:101253.
  5. 5. Roozenbeek J, Schneider CR, Dryhurst S, Kerr J, Freeman AL, Recchia G, et. al. Susceptibility to misinformation about COVID-19 around the world. R Soc Open Sci. 2020;7(10):201199. pmid:33204475
  6. 6. Schwarz J, Sikkink D. Blinded by religion? Religious school graduates and perceptions of science in young adulthood. Cardus Religious Schools Initiative; 2016.
  7. 7. Browne M, Thomson P, Rockloff MJ, Pennycook G. Going against the herd: psychological and cultural factors underlying the ‘vaccination confidence gap’. PLoS One. 2015;10(9):e0132562. pmid:26325522
  8. 8. Lewandowsky S, Cook J, Fay N, Gignac GE. Science by social media: attitudes towards climate change are mediated by perceived social consensus. Mem Cognit. 2019;47(8):1445–56. pmid:31228014
  9. 9. D’Ignazi J, Kalimeri K, Beiró MG. Beyond sentiment: examining the role of moral foundations in user engagement with news on Twitter. arXiv. preprint. arXiv:250212009, 2025.
  10. 10. Ramos R, Vaz P, Rodrigues MJ. Climate Denialism on social media: qualitative analysis of comments on Portuguese newspaper Facebook pages. Psychol Int. 2025;7(1):6.
  11. 11. Hwang S, Horvát E, Romero DM. Information retention in the multi-platform sharing of science. In: Proceedings of the International AAAI Conference on Web and Social Media. vol. 17; 2023. pp. 375–86. https://doi.org/10.1609/icwsm.v17i1.22153
  12. 12. Takahashi B, Tandoc EC Jr. Media sources, credibility and perceptions of science: learning about how people learn about science. Public Underst Sci. 2016;25(6):674–90. pmid:25792288
  13. 13. Pew Research. Social media and news fact sheet; 2023 . Available from: https://www.pewresearch.org/journalism/fact-sheet/social-media-and-news-fact-sheet/
  14. 14. Effrosynidis D, Karasakalidis AI, Sylaios G, Arampatzis A. The climate change Twitter dataset. Expert Syst Appl. 2022;204:117541.
  15. 15. Karimiziarani M, Shao W, Mirzaei M, Moradkhani H. Toward reduction of detrimental effects of hurricanes using a social media data analytic approach: how climate change is perceived? Clim Risk Manage. 2023;39:100480.
  16. 16. Upadhyaya A, Fisichella M, Nejdl W. A multi-task model for sentiment aided stance detection of climate change tweets. In: Proceedings of the International AAAI Conference on Web and Social media. vol. 17 2023. pp. 854–65.
  17. 17. Williams HT, McMurray JR, Kurz T, Lambert FH. Network analysis reveals open forums and echo chambers in social media discussions of climate change. Global Environ Change. 2015;32:126–38.
  18. 18. Falkenberg M, Galeazzi A, Torricelli M, Di Marco N, Larosa F, Sas M, et. al. Growing polarization around climate change on social media. Nat Clim Chang. 2022;12(12):1114–21.
  19. 19. Similarweb. Top websites ranking; 2024 . Available from: https://www.similarweb.com/top-websites/united-states/
  20. 20. De Francisci Morales G, Monti C, Starnini M. No echo in the chambers of political interactions on Reddit. Sci Rep. 2021;11:2818.
  21. 21. Moriarty D, Mehlenbacher AR. Reddit, engaged science communication online: An examination of reddit’s R/science ask-me-anythings and science discussion series. Tech Commun Q. 2024;33(1):54–70.
  22. 22. Hara N, Abbazio J Perkins K. An emerging form of public engagement with science: ask me anything (AMA) sessions on Reddit r/science. PLoS One. 2019;14(5):e0216789. pmid:31091264
  23. 23. Gadanidis T. The discourse of climate change on Reddit. Toronto Working Papers in Linguistics. 2020 . Available from: https://twpl.library.utoronto.ca/index.php/twpl/article/view/41010
  24. 24. Oswald L, Bright J. How do climate change skeptics engage with opposing views online? Evidence from a major climate change skeptic forum on Reddit. Environ Commun. 2022;16(6):805–21.
  25. 25. Villanueva II. Climate change frames and emotional responses on Reddit. University of Arkansas; 2021.
  26. 26. Parsa MS, Shi H, Xu Y, Yim A, Yin Y, Golab L. Analyzing climate change discussions on Reddit. In: 2022 International Conference on Computational Science and Computational Intelligence (CSCI). IEEE; 2022. pp. 826–32.
  27. 27. Pew Research. What the data says about Americans’ views of climate change; 2023 . Available from: https://www.pewresearch.org/short-reads/2023/08/09/what-the-data-says-about-americans-views-of-climate-change/
  28. 28. Merkley E, Stecula DA. Party cues in the news: democratic elites, Republican backlash and the dynamics of climate skepticism. Br J Polit Sci. 2021;51(4):1439–56.
  29. 29. Antonio RJ, Brulle RJ. The unbearable lightness of politics: climate change denial and political polarization. Sociol Q. 2011;52(2):195–202.
  30. 30. Smith EK, Bognar MJ, Mayer AP. Polarisation of climate and environmental attitudes in the United States 1973 -2022. npj Clim Action. 2024;3(1):2.
  31. 31. Viswanathan G. Americans’ trust in science declining, Pew survey says; 2023 . Available from: https://edition.cnn.com/2023/11/14/health/trust-in-science-pew-survey/index.html
  32. 32. Treen K, Williams H, O’Neill S, Coan TG. Discussion of climate change on Reddit: polarized discourse or deliberative debate? Environ Commun. 2022;16(5):680–98.
  33. 33. Shah M, Seraj S, Pennebaker JW. Climate denial fuels climate change discussions more than local climate-related disasters. Front Psychol. 2021;12:682057. pmid:34512442
  34. 34. Baumgartner J, Zannettou S, Keegan B, Squire M, Blackburn J. The pushshift reddit dataset. In: Proceedings of the International AAAI Conference on Web and Social Media. vol. 14; 2020. pp. 830–9.
  35. 35. Pither J. Introduction to biostatistics; 2023 . Available from: https://ubco-biology.github.io/BIOL202/
  36. 36. Lundberg SM, Lee SI. A unified approach to interpreting model predictions. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, et. al., editors. Advances in Neural Information Processing Systems 30; 2017. pp. 4765–74.
  37. 37. Robertson RE, Green J, Ruck DJ, Ognyanova K, Wilson C, Lazer D. Users choose to engage with more partisan news than they are exposed to on Google search. Nature. 2023;618(7964):342–8. pmid:37225979
  38. 38. Ferrara E, Varol O, Davis C, Menczer F, Flammini A. The rise of social bots. Commun ACM. 2016;59(7):96–104.
  39. 39. Hurtado S, Ray P, Marculescu R. Bot detection in reddit political discussion. In: Proceedings of the Fourth International Workshop on Social Sensing; 2019. pp. 30–35.
  40. 40. Ma MC, Lalor JP. An empirical analysis of human-bot interaction on reddit. In: Proceedings of the Sixth Workshop on Noisy User-generated Text (w-NUT 2020); 2020. pp. 101–6.
  41. 41. Bowman J. Thomas Jefferson & American education; 2019 . Available from: https://www.proedtn.org/news/339466/Thomas-Jefferson–American-Education.htm
  42. 42. Dewey J. How we think. Heath & Co Publishers; 1933.
  43. 43. National Research Council. A framework for K-12 science education: practices, crosscutting concepts, core ideas. Washington and DC: National Academies Press; 2012.
  44. 44. Carlsson F, Kataria M, Krupnick A, Lampi E, Löfgren Å, Qin P, et. al. The climate decade: Changing attitudes on three continents. J Environ Econ Manage. 2021;107:102426.
  45. 45. Verma N, Fleischmann KR, Koltai KS. Human values, trust in scientific journals, the mainstream media and fake news. Proc Assoc Inf Sci Technol. 2017;54(1):426–35.
  46. 46. Center for Countering Digital Health. The new climate denial. Center for Countering Digital Health; 2024 . Available from: https://counterhate.com/wp-content/uploads/2024/01/CCDH-The-New-Climate-Denial_FINAL.pdf
  47. 47. Bushey B, Farady M, Perkins D. Everyday reasoning, the roots of intelligence. In: Voss JF, Perkins DN, Segal JW, editors, Informal reasoning, education. Lawrence Erlbaum Associates and Inc.; 1991, pp. 83—105.
  48. 48. Hannon M. Are knowledgeable voters better voters? Polit Philos Econ. 2022;21(1):29–54.
  49. 49. Kahan DM. Ideology, motivated reasoning and cognitive reflection. Judgm Decis Mak. 2013;8(4):407–24.
  50. 50. Koltai KS, Fleischmann KR. Questioning science with science: the evolution of the vaccine safety movement. Proc Assoc Inf Sci Technol. 2017;54(1):232–40.
  51. 51. Hoekstra AG, Noordzij K, de Koster W, van der Waal J. The educational divide in climate change attitudes: understanding the role of scientific knowledge and subjective social status. Glob Environ Change. 2024;86:102851.
  52. 52. Bliuc AM, McGarty C, Thomas EF, Lala G, Berndsen M, Misajon R. Public division about climate change rooted in conflicting socio-political identities. Nat Clim Change. 2015;5(3):226–9.
  53. 53. Kennedy EH, Givens JE. Eco-habitus or eco-powerlessness? Examining environmental concern across social class. Sociol Perspect. 2019;62(5):646–67.
  54. 54. Atkeson LR, Taylor AJ. Partisan affiliation in political science: insights from Florida and North Carolina. PS Polit Sci Polit. 2019;52(4):706–10.
  55. 55. Bornmann L, Haunschild R, Boyack K, Marx W, Minx JC. How relevant is climate change research for climate change policy? An empirical analysis based on Overton data. PLoS One. 2022;17(9):e0274693. pmid:36137101
  56. 56. Zhang FJ. Political endorsement by Nature and trust in scientific expertise during COVID-19. Nat Hum Behav. 2023;7(5):696–706. pmid:36941467
  57. 57. Osman W, Mohamed F, Elhassan M, Shoufan A. Is YouTube a reliable source of health-related information? A systematic review. BMC Med Educ. 2022;22(1):382. pmid:35590410
  58. 58. Do Nascimento IJB, Pizarro AB, Almeida JM, Azzopardi-Muscat N, Gonçalves MA, Björklund M, et. al. Infodemics and health misinformation: a systematic review of reviews. Bull World Health Organ. 2022;100(9):544. pmid:36062247
  59. 59. Bär D, Pröllochs N, Feuerriegel S. New threats to society from free-speech social media platforms. Commun ACM. 2023;66(10):37–40.