Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

12-year observation of tweets about rubella in Japan: A retrospective infodemiology study

  • Yukie Sano ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Project administration, Visualization, Writing – original draft

    sano@sk.tsukuba.ac.jp

    Affiliation Faculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, Ibaraki, Japan

  • Ai Hori

    Roles Conceptualization, Validation, Writing – review & editing

    Affiliation Faculty of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan

Correction

16 Nov 2023: Sano Y, Hori A (2023) Correction: 12-year observation of tweets about rubella in Japan: A retrospective infodemiology study. PLOS ONE 18(11): e0294796. https://doi.org/10.1371/journal.pone.0294796 View correction

Abstract

Although rubella is an infectious disease that can be prevented by vaccination, there have been periodic epidemics in Japan, mainly among adult males. One of the reasons for this is the lack of interest in vaccination among the target adult male population. To clarify the reality of the discussion about rubella and provide basic resource for enlightening activities for rubella prevention, we collected and analyzed Twitter posts about rubella in Japanese between January 2010 and May 2022. We examined time series, number of tweets per account, tweeted contents, and retweet network. We found that the weekly number of rubella reports and the number of Twitter posts fluctuate simultaneously. During the 2018 rubella epidemic, the number of tweets increased due to the start of the rubella routine vaccination program and the use of cartoons to raise awareness. While 80% of the accounts posted three times or fewer during the period, some accounts posted multiple times per day for more than 12 years. Medical terms such as vaccines and antibodies were frequently used in the tweet contexts. In the retweet activity, a variety of actors, including mass media, medical professionals, and even rubella sufferers, contributed to disseminate rubella-related information.

Introduction

Rubella in Japan

Rubella is a vaccine-preventable disease; rubella-containing vaccine and measles-rubella vaccine are approved in Japan as of 2023. However, periodic outbreaks have occurred in Japan, mainly among adult men who did not have the opportunity to be vaccinated during their childhood. While women of the same age had the opportunity to be vaccinated, men born before April 1, 1979 did not have the opportunity to be vaccinated even once [1].

In the 2012–2013 rubella epidemic, there were more than 14,000 reported cases of infection [2], and 45 cases of congenital rubella syndrome were reported [3] with the key clinical characteristic of conjunctivitis [4] After that, the Japanese government set a goal of eliminating rubella by 2020 [5]. The municipal government offered partial expense support for rubella antibody testing and vaccination [6]. However, the voluntary rubella vaccination rate remained low, especially among men who did not plan to have babies [7]. A catch-up vaccination program for adult men was not developed at that time.

Then the rubella outbreak occurred again in 2018. The U.S. Centers for Disease Control and Prevention (CDC) recommended that unvaccinated people and pregnant women refrain from traveling to Japan [8]. Due to concerns about the negative impact of the rubella outbreak on the upcoming 2020 Rugby World Cup and Tokyo Olympic/Paralympic Games [9], the rubella routine vaccination program was initiated in 2019. In the new rubella routine vaccination program, free vaccination was offered to men born between fiscal years 1962 and 1978 who were preliminarily tested for antibodies freely and found to have low antibody titer [10]. The promotion measures were introduced to allow working-age men to take rubella antibody tests on the occasion of annual health checkups at their workplaces or in their communities [11]. However, use of the catch-up program remained low at 20% [12] of the eligible population at the end of 2021, and there was a risk of a resurgence of rubella outbreaks under the current circumstances. Therefore, the Japanese government decided to extend the rubella routine vaccination program for three years from 2022 [13], and further promotion of the program is required.

One of the reasons for the stagnation of routine rubella vaccination is the lack of interest among the target population, men in their 40s and 50s. Compared to women, adult men are known to be less likely to take actions such as checking rubella vaccination history, antibody testing, and immunization [14]. Factors associated with the use of the routine immunization program include knowing the government’s recommendation, having acquaintances who have used the program, and being aware that their generation did not have the opportunity to be immunized [15].

Infection disease and SNS

Monitoring and enlightining of infectious diseases using SNS such as Facebook and Twitter has been active in public health targeting measles [1623], human papillomavirus (HPV) [2426], Ebola [27, 28] and zika [29, 30] even before the COVID-19 infodemic [3134]. During the rubella epidemic in the Netherlands in 2013, the number of rubella cases and online news increased simultaneously, leading to an increase in tweets (Twitter posts) [16]. It is also reported that tweets increase in response to a main political event such as mandatory immunizations in Italy [21]. Public agencies such as the CDC and World Health Organization (WHO) were influential in disseminating information during the zika outbreak in 2015–2016 [29].

These previous studies have mainly analyzed a couple of years of epidemics. On the contrary, few studies exist that track the topic of specific infectious diseases, especially rubella, over ten years or more, including periods of no epidemic.

According to a 2021 survey, the percentage of individuals using social networking services (SNS) in Japan reached 78.7% [35]. In order to arouse widespread interest in rubella, the Ministry of Health, Labor and Welfare (MHLW) in Japan has begun actively using Twitter, one of the popular SNS in Japan, to announce rubella-related information. Similarly, rubella-related actors, such as sufferers or family members, and doctors are also actively using Twitter to disseminate information.

Purpose of the study

The purpose of this study is to clarify the reality of the discussion about rubella on Japanese Twitter space and provide basic data for enlightening activities on rubella prevention. We analyzed posts on SNS for rubella over a period of 12 years and 5 months. In particular, we analyzed posts on Twitter, which is said to have 45 million users in Japan as of 2017 [36]. There has been little debate in favor of or against the rubella vaccine in Japan, but the lack of interest in rubella has been problematic. Therefore, it is crucial to observe how this pubic interest in rubella has evolved.

In the following sections, we first provide an overview of the data and the main analytical methods used. Next, we present the results of our analysis of long-term fluctuations and the content of the posts. Finally, we summarize the results of this analysis and discuss the significance of the study.

Methodology

Data

In this study, Twitter Academic API was used to retrieve tweets about rubella written in Japanese. Our project was approved by Twitter’s Academic Research Program, which gave us access to the full archive data (https://developer.twitter.com/en/use-cases/do-research/academic-research). The acquisition condition was defined as tweets containing “rubella” expressed in either Kanji (Chinese characters) or Hiragana from January 1, 2010 to May 31, 2022. We collected these rubella-related tweets posted publicly on Twitter.

Usually, when text-based tweets are collected, they may contain spam tweets intended as advertisements. In the case of rubella in Japanese, there were almost no spam-related tweets, probably because “rubella” is not a very common word. Therefore, no special filtering process was used in this data collection.

We separated an original tweet and a retweet based on whether a tweet included “RT” at the beginning of the body of the tweet. Therefore, quoted retweets that precede the quoted text with their own opinion were treated as original tweets.

Overview of analysis

This study aimed to provide a basic analysis of rubella-related Twitter posts; therefore, we focus on the following four points.

  • Time series of rubella-related tweets and rubella reports
  • Number of tweets per account
  • Visualization of content
  • Retweet network

Time series of tweets and reports.

Weekly counts of tweets were conducted to determine the overall fluctuation of tweets about rubella and compare them with the number of rubella reports [2]. The number of rubella reports was counted by downloading the information available on the website (https://www.niid.go.jp/niid/ja/hassei/3086-rubella-sokuhou-rireki.html). To be consistent with the time period for the reported cases, we used the tweet time period of ten years from 2012. We then operated StatsLinearCorrelationTest by Igor Pro 9.0 (WaveMetrics, Inc.) to calculate Pearson’s correlation coefficient.

Number of tweets per account.

To determine the extent to which accounts posting about rubella, we counted the number of tweets per account throughout the entire period from 2010 to 2022. In addition to MHLW, the top two accounts with the most tweets were individually web-surveyed to determine whom they were inferred to be based on publicly available information. In case that these accounts agreed, we included their screen names in the result.

Visualization of content.

In order to understand tweet content, we visualized tweets using wordcloud (http://amueller.github.io/word_cloud/). We created a wordcloud using the top 150 most frequent words for ease of visualization. Here, as a pre-processing of the tweet body, the words were segmented using NEologd [37], a dictionary that also supports Internet slang, omitting punctuation and symbols.

We automatically translated the original Japanese words into English using Google translate (https://translate.google.com/). Then, the author (AH) with domain knowledge of medical terminology checked the translation and manually corrected. At that time, we ensured that one Japanese word corresponds to one English word and is not duplicated.

Retweet network.

We built a retweet network that a node represents each account and a link represents retweet between them. If there were multiple retweets between the same accounts, we reflected as a link weight.

For the network visualization, we showed the retweet network by extracting only those link weights greater than 100. For the top fourteen accounts with their link weights, we individually web-surveyed to determine whom they were inferred to be based on publicly available information including number of followers. For those among top fourteen link weight accounts that they agreed, their screen name was stipulated in the results. The size of the nodes was proportional to the size of the followers after taking the logarithm. The color and size of the nodes were divided between mass media/government agencies, doctors, and rubella-related actors.

Results

We collected 2,410,868 tweets from 575,311 accounts in total. The percentage of retweets was 64.9%. The average number of tweets (sum of both original tweets and retweets) per day for the entire period covered was 532 (187 original tweets and 345 retweets). Thus, daily rubella-related tweets were very small compared to the Japanese Twitter population.

Time series of tweets and reports

Fig 1 shows the weekly number of rubella reports and the rubella-related tweets. The changes in original tweets and retweets were almost synchronous, with a correlation coefficient r = 0.71 (p < .001, 95%CI 0.67–0.75). The overall changes were also similar to the number of rubella reports, with an increase in the number of tweets in 2013 and 2018. In particular, the number of reports and the number of original tweets fluctuate simultaneously, with a correlation coefficient r = 0.69 (p < .001, 95%CI 0.65–0.74). On the contrary, the correlation coefficient between the number of reports and the number of retweets was less similar, r = 0.21 (p < .001, 95%CI 0.13–0.29).

thumbnail
Fig 1. Weekly time series of tweets and rubella reports.

From the top row, the weekly number of rubella reports, original tweets, and retweets, respectively.

https://doi.org/10.1371/journal.pone.0285101.g001

On a daily basis, the day with the largest number of original tweets was December 11, 2018 with 4,820 tweets. Fig 1 shows weekly numbers that have the highest peak in the middle of 2018 for original tweets. The day with the most retweets was October 11, 2018 with 27,068 retweets. The median number of daily tweets increased more than double before and after 2018, when the second epidemic occurred; the value varied from 153 (95 original tweets and 57 retweets) in 2017 to 555 (219 original tweets and 333 retweets) in 2019.

Number of tweets per account

Approximately 320 thousand accounts, or 56.6% of the total accounts, made only one tweet, 90 thousand accounts made two tweets, followed by 40 thousand accounts with three tweets (Fig 2(a) and S1 Appendix for more details).

thumbnail
Fig 2. Number of tweets per account.

(a) Ratio of tweets per account. The majority of the tweets were made by only a small number of users. (b) Distribution of number of tweets per account (logarithmic on both axes). The typical power distribution with an exponent of 1.8.

https://doi.org/10.1371/journal.pone.0285101.g002

Contrarily, one account made 33,073 posts during this period. This account (@Dr_RasuKaru) is a doctor with about ten thousand followers, and has been regularly tweeting about rubella, using a bot that automatically posts tweets. The next highest account (@knimama) is a family member of those affected by congenital rubella syndrome who made 19,565 tweets. This account was very active in the rubella eradication effort, and although it does not use any automated framework, it made numerous posts. In addition, the official account of MHLW (@MHLWitter) was also active in tweeting information on rubella, posting 1,136 tweets during the period. MHLW was the 56th most tweeted among the 575,311 accounts. Thus, overall, the number of tweets about rubella per account was highly skewed and showed power-law distribution P(x) ∼ xα with its exponent α estimated [38] as 1.8 (Fig 2(b)).

Visualization of written content

Fig 3 shows wordclouds created with original tweets and retweets. The most tweeted words were “Vaccination” for original tweets and “Vaccine” for retweets. Although these words have very similar meanings, their Japanese translations differ. “Vaccination” is a four-character Kanji word that refers to the act of inoculation, while “Vaccine” refers to the vaccine itself (S1 Appendix).

thumbnail
Fig 3. Wordcloud created with the top 150 most frequently occurring words during the entire period.

(a): Original tweets only. (b): Retweets only.

https://doi.org/10.1371/journal.pone.0285101.g003

Fig 4 shows wordclouds of original tweets on December 10, 2018 (the day with the most original tweets) and retweets on October 11, 2018 (the day with the most retweets). The most tweeted word on December 10, 2018 was the same as the overall trend:“Vaccination.” The most retweeted word on October 11, 2018 was “Release.” The top 200 most frequent words with original Japanese forms appear in S1 Appendix.

thumbnail
Fig 4. Wordcloud created with the top 150 most frequently occurring words at the specific day.

(a): Original tweets only (Dec. 12th, 2018). (b): Retweets only (Oct. 11th, 2018).

https://doi.org/10.1371/journal.pone.0285101.g004

Retweet network

Fig 5 shows the retweet network of rubella-related tweets. In the network, top fourteen nodes with the largest number of links were divided into three types: the mass media (@nhk _news, @nhk_seikatu) and MHLW (@MHLWitter), medical professionals (@narumita, @Dr_RasuKaru, @syutoken_sanka, @imamura_kansen), and rubella-related actors (@knimama, @stop_fuushin). Within this network, the nodes with the highest degree centrality, which is an index proportional to the number of links, was the mass media account (@nhk_seikatu) with a large number of followers. Contrarily, the nodes with the highest betweeness centrality, which measures mediating shortest path [39], was the account of the rubella-related actor (@knimama).

thumbnail
Fig 5. Retweet network of rubella-related tweets.

Node size proportional to the logarithm number of followers as of February 2023. The blue squares represent the mass media and MHLW, the pink diamonds represent medical professionals, and the green circles represent the rubella-related actors.

https://doi.org/10.1371/journal.pone.0285101.g005

Discussion

Even rubella-related tweets are weak signals; we found that they have increased in recent years, particularly in response to news and related events. These results are consistent with SNS analyses of measles and other diseases conducted in other countries [19, 21].

Time series of tweets and reports

The weekly number of rubella cases and corresponding tweets exhibit a significant correlation, particularly for original tweets (r = 0.69). Similar correlations between tweets and disease surveillance are reported in other studies. For instance, in the US, a study on influenza revealed a strong correlation (r = 0.93) between the number of tweets classified as valid and the rates of influenza-like illness, although the strength of the relationship varied across different cities [40]. In the case of the 2013 measles outbreak in the Netherlands, the correlation between tweets and disease incidence was reported to be r = 0.56 [16]. Not only infectious diseases but also hay fever has been reported correlation (r = 0.97) in the UK [41]. In Japan’s case, tweets related to allergic rhinitis were highly correlated (r = 0.84) with their drug sales [42]. We reached similar results using longer-term data.

The day with the largest number of original tweets was the day MHLW announced that vaccinations would be free for three years for men aged 39 to 56 as a measure against rubella. The day with the most retweets was the day the episode about rubella in the cartoon “Konodori” was released for free. “Konodori” is a popular medical cartoon featuring an obstetrician. On the day of the event, the cartoon created many tweets because it was published online for free to stimulate interest in rubella.

Number of tweets per account

A small number of accounts continue to disseminate information on rubella actively for more than ten years. Although the Japanese MHLW was in the top 1% of most tweeted account in our data, it was hardly the most influential in the Japanese Twitter space for rubella. Instead, individuals such as a doctor and a family member with congenital rubella syndrome were most active. A previous study also reports existence of hidden influential users who have a small number of followers but being retweeted multiple times as well as normal influential users who have a large number of followers in Ebola tweets [27]. We obtained similar results.

The majority of accounts that posted about rubella tweeted only once or twice. This suggests that the majority of accounts are interested in something other than rubella on a daily basis. These results suggest that Twitter’s activities to raise awareness using tie-up projects about rubella may reach people who were not interested in the disease in some sense.

Visualization of content

As an overall trend, many of the words that frequently appeared in both original tweets and retweets were common. Those common words were medical terms such as “Vaccination,” “Vaccine,” and “Antibody.” There were also many tweets containing “Pregnant woman.” This suggests that the majority of the tweets probably conveyed correct medical information that pregnant women infected with rubella may have children with congenital rubella syndrome, which can be prevented by vaccination.

On December 11, 2018, MHLW announced that antibody testing and vaccination would be free for men aged 39 to 56. At the time, major newspapers reported the news, and many people shared it on the web. This event caused “Man” and “Free” to appear on the day’s wordclud, in addition to “Vaccination.” The highest number of retweets occurred on October 11, 2018, with several characteristic words (“Release,” “Konodori,” “Free”) appearing that were not present during the other periods. The event caused the episode about rubella in the cartoon “Konodori” released for free to arouse public interest in rubella. It is suggested that press releases using tie-up projects with popular content can be effective in promoting the spread of public health information.

The word “Free” was shared on both days, with the largest number of original tweets and retweets, even though it appeared in separate contexts. These were free vaccinations in the case of the original tweet and free cartoon publication in the case of the retweet. The word “Free” may be attractive and have attracted people, and it is important to examine this finding for future health-promoting campaigns.

Retweet network

The retweet network revealed the existence of important accounts of dissemination of rubella information in Japanese Twitter space. Consistent with the previous studies [18, 27, 29], tweets from the mass media and MHLW, which have a large number of followers, were frequently retweeted. On the contrary, although the numbers of followers were smaller, accounts of individual doctors and rubella-related actors also frequently retweeted or were being retweeted. Zika’s research on Twitter also pointed out the existence of a small number of hidden influencers who have a small number of followers but a large number of retweets [27]. Our result also confirmed a similar phenomenon.

The retweet network revealed a cooperative effort between mass media with a large number of followers and individuals with a small number of followers who mediate the dissemination of information. The dissemination of rubella information in the Japanese Twitter space is considered to be a hybrid of mass media publicity and grassroots activities.

Limitation and future study

Finally, we discuss some limitations and future directions of this study. First, this study was conducted only on Japanese tweets, those containing the word “rubella.” There may be discussions about rubella that do not include the word “rubella” explicitly in their tweets. Second, Japanese Twitter users are skewed by age, with the largest number in their 20s [43]. As a result, there exists the bias in the person profile contained in our data. Third, although we found a correlation between the actual number of cases and the number of tweets, a causality cannot be confirmed from the results. Finally, this study focused on presenting a basic analysis of discussions about rubella in Japanese Twitter space. For example, simple word frequency is not a sufficient measure of context because it is sometimes used with a negative word. In the future, a more detailed analysis through topic analysis [44] and sentiment analysis [45] will also be necessary for the deeper understanding of rubella context. In the retweet network, a more detailed analysis that takes into account the link directions and temporal dynamics is also needed.

Conclusions

We presented a chronological change in the Japanese Twitter space regarding rubella over a period of 12 years and 5 months. In Japanese Twitter space, interest in rubella has never been high, and the number of tweets is tiny compared to the number of total Japanese Twitter users. Analysis of the accounts participating in the tweets and the content of the tweets revealed how different actors, including the mass media and various rubella-related actors, collaborated to spread information about rubella. Empirically observing and recording not only the number of rubella cases but also the social interest in the disease are highly desirable as a resource for future public health lessons.

Supporting information

S1 Appendix. Raw numbers and words used in the study.

In the file, we provide raw numbers of tweets and rubella reports in Japan. Additionally, the file includes words that frequently appear in both Japanese and English.

https://doi.org/10.1371/journal.pone.0285101.s001

(XLSX)

References

  1. 1. Ueda K. Development of the rubella vaccine and vaccination strategy in Japan. Vaccine. 2009;27(24):3232–3233. pmid:19366581
  2. 2. National Institute of Infectious Diseases. Epidemiological information on rubella (in Japanese); 2022. [Cited 2022 October 25]. Available from: https://www.niid.go.jp/niid/images/epi/rubella/2022/rubella220518.pdf.
  3. 3. Kanai M, Sunagawa T, Kamiya H, Okuno H, Taya K, Oishi K, et al. Report on the results of a follow-up study of 45 cases of congenital rubella syndrome born between 2012 and 2014 (in Japanese). National Institute of Infectious Diseases, Japan; 2018. 3.
  4. 4. Nomoto H, Ishikane M, Nakamoto T, Ohta M, Morioka S, Yamamoto K, et al. Conjunctivitis, the key clinical characteristic of adult rubella in Japan during two large outbreaks, 2012–2013 and 2018–2019. PLoS ONE. 2020;15(4):e0231966. pmid:32330153
  5. 5. Ministry of Health, Labor and Welfare. Guidelines for prevention of specific infectious diseases related to rubella (in Japanese); 2014. [Cited 2022 October 25]. Available from: https://www.mhlw.go.jp/file/06-Seisakujouhou-10900000-Kenkoukyoku/0000186690.pdf.
  6. 6. Notification: Further thoroughness of measures to prevent outbreaks of congenital rubella syndrome (in Japanese). National Institute of Infectious Diseases, Japan; 2013. [Cited 2022 October 25]. Available from: https://www.niid.go.jp/niid/ja/iasr-sp/2250-related-articles/related-articles-398/3417-dj3982.html.
  7. 7. Hori A, Wada K, Smith DR. A socio-demographic examination of adults responding to governmental vaccination recommendations during the Japanese rubella outbreak of 2013. PLoS ONE. 2015;10(6):e0129900. pmid:26057740
  8. 8. U.S. CDC warns pregnant women against traveling to Japan amid rubella outbreak. The Japan Times. 2018 Oct 24 [Cited 2022 October 25]. Available from: https://www.japantimes.co.jp/news/2018/10/24/national/science-health/u-s-cdc-warns-pregnant-women-traveling-japan-amid-rubella-outbreak/.
  9. 9. Kato H. The fifth routine immunization phase so far and future after the 2018 rubella outbreak (in Japanese). National Institute of Infectious Diseases, Japan; 2022.
  10. 10. Ministry of Health, Labor and Welfare. Additional measures for rubella (in Japanese); 2022. [Cited 2022 October 25]. Available from: https://www.mhlw.go.jp/stf/seisakunitsuite/bunya/kenkou_iryou/kenkou/kekkaku-kansenshou/rubella/index_00001.html.
  11. 11. Ministry of Health, Labor and Welfare. Measures to improve the implementation rate of rubella countermeasures (antibody testing) (in Japanese); 2020. [Cited 2022 October 25]. Available from: https://www.mhlw.go.jp/content/10906000/000590968.pdf.
  12. 12. Ministry of Health, Labor and Welfare. Current status of additional measures regarding rubella (in Japanese); 2021. [Cited 2022 October 25]. Available from: https://www.mhlw.go.jp/content/10906000/000868298.pdf.
  13. 13. Ministry of Health, Labor and Welfare. Minutes of the 46th meeting of the basic immunization policy subcommittee on immunization and vaccine / the 57th meeting of the subcommittee on infectious diseases of the health sciences council (joint meeting) (in Japanese); 2021. [Cited 2022 October 25]. Available from: https://www.mhlw.go.jp/stf/newpage_23317.html.
  14. 14. Norizuki M, Hori A, Wada K. Factors associated with adults’ actions to confirm their own rubella immune status in Japan’s drive toward rubella elimination: cross-sectional online survey of non-healthcare workers in their 20s to 40s. Environ Health Prev Med. 2021;26(1):77. pmid:34380430
  15. 15. Hori A, Yoshii S, Isaka Y, Wada K. Factors associated with participation in an ongoing national catch-up campaign against rubella: a cross-sectional internet survey among 1680 adult men in Japan. BMC Public Health. 2021;21(1):292. pmid:33541317
  16. 16. Mollema L, Harmsen IA, Broekhuizen E, Clijnk R, De Melker H, Paulussen T, et al. Disease detection or public opinion reflection? Content analysis of tweets, other social media, and online newspapers during the measles outbreak in The Netherlands in 2013. J Med Internet Res. 2015;17(5):e128. pmid:26013683
  17. 17. Broniatowski DA, Hilyard KM, Dredze M. Effective vaccine communication during the disneyland measles outbreak. Vaccine. 2016;34(28):3225–3228. pmid:27179915
  18. 18. Radzikowski J, Stefanidis A, Jacobsen KH, Croitoru A, Crooks A, Delamater PL. The measles vaccination narrative in Twitter: a quantitative analysis. JMIR Public Health Surveill. 2016;2(1):e1. pmid:27227144
  19. 19. Gunaratne K, Coomes EA, Haghbayan H. Temporal trends in anti-vaccine discourse on Twitter. Vaccine. 2019;37(35):4867–4871. pmid:31300292
  20. 20. Cossard A, Morales GDF, Kalimeri K, Mejova Y, Paolotti D, Starnini M. Falling into the echo chamber: the Italian vaccination debate on Twitter. In: Proceedings of the International AAAI Conference on Web and Social Media. vol. 14; 2020. p. 130–140.
  21. 21. Ajovalasit S, Dorgali VM, Mazza A, d’Onofrio A, Manfredi P. Evidence of disorientation towards immunization on online social media after contrasting political communication on vaccines. Results from an analysis of Twitter data in Italy. PLoS ONE. 2021;16(7):e0253569. pmid:34242253
  22. 22. Deiner MS, Fathy C, Kim J, Niemeyer K, Ramirez D, Ackley SF, et al. Facebook and Twitter vaccine sentiment in response to measles outbreaks. Health Informatics J. 2019;25(3):1116–1132. pmid:29148313
  23. 23. Wawrzuta D, Jaworski M, Gotlib J, Panczyk M. Social media sharing of articles about measles in a European context: text analysis study. J Med Internet Res. 2021;23(11):e30150. pmid:34570715
  24. 24. Dunn AG, Leask J, Zhou X, Mandl KD, Coiera E. Associations between exposure to and expression of negative opinions about human papillomavirus vaccines on social media: an observational study. J Med Internet Res. 2015;17(6):e144. pmid:26063290
  25. 25. Surian D, Nguyen DQ, Kennedy G, Johnson M, Coiera E, Dunn AG. Characterizing Twitter discussions about HPV vaccines using topic modeling and community detection. J Med Internet Res. 2016;18(8):e232. pmid:27573910
  26. 26. Lama Y, Chen T, Dredze M, Jamison A, Quinn SC, Broniatowski DA. Discordance between human papillomavirus Twitter images and disparities in human papillomavirus risk and disease in the United States: mixed-methods analysis. J Med Internet Res. 2018;20(9):e10244. pmid:30217792
  27. 27. Liang H, Fung ICH, Tse ZTH, Yin J, Chan CH, Pechta LE, et al. How did Ebola information spread on twitter: broadcasting or viral spreading? BMC Public Health. 2019;19(1):438. pmid:31023299
  28. 28. Kim EHJ, Jeong YK, Kim Y, Kang KY, Song M. Topic-based content and sentiment analysis of Ebola virus on Twitter and in the news. J Inf Sci Eng. 2016;42(6):763–781.
  29. 29. Stefanidis A, Vraga E, Lamprianidis G, Radzikowski J, Delamater PL, Jacobsen KH, et al. Zika in Twitter: temporal variations of locations, actors, and concepts. JMIR Public Health Surveill. 2017;3(2):e22. pmid:28428164
  30. 30. Fu KW, Liang H, Saroha N, Tse ZTH, Ip P, Fung ICH. How people react to Zika virus outbreaks on Twitter? A computational content analysis. Am J Infect Control. 2016;44(12):1700–1702. pmid:27566874
  31. 31. Zarocostas J. How to fight an infodemic. Lancet. 2020;395(10225):676. pmid:32113495
  32. 32. The Lancet Infectious Diseases. The COVID-19 infodemic. Lancet Infect Dis. 2020;20(8):875.
  33. 33. Saeki S, Shimato M. Combatting infodemics for a sustainable healthcare system. Nihon Koshu Eisei Zasshi. 2021;68(6):444–445. pmid:33994493
  34. 34. Pascual-Ferrá P, Alperstein N, Barnett DJ. Social network analysis of COVID-19 public discourse on Twitter: implications for risk communication. Disaster Med Public Health Prep. 2022;16(2):561–569. pmid:32907685
  35. 35. Ministry of International Affairs and Communications. 2021 White paper on information and communications in Japan; 2022.
  36. 36. Twitter Japan. The number of monthly users in Japan has exceeded 45 million. (in Japanese); 2017. [Cited 2022 October 25]. Available from: https://twitter.com/TwitterJP/status/923671036758958080.
  37. 37. Sato T, Hashimoto T, Okumura M. Implementation of a word segmentation dictionary called mecab-ipadic-NEologd and study on how to use it effectively for information retrieval. In: Proceedings of the Twenty-three Annual Meeting of the Association for Natural Language Processing. The Association for Natural Language Processing; 2017. p. NLP2017–B6–1.
  38. 38. Alstott J, Bullmore E, Plenz D. Powerlaw: a python package for analysis of heavy-tailed distributions. PLoS ONE. 2014;9(1). pmid:24489671
  39. 39. Menczer F, Fortunato S, Davis CA. A first course in network science. Cambridge University Press; 2020.
  40. 40. Aslam AA, Tsou MH, Spitzberg BH, An L, Gawron JM, Gupta DK, et al. The reliability of tweets as a supplementary method of seasonal influenza surveillance. J Med Internet Res. 2014;16(11):e250. pmid:25406040
  41. 41. de Quincey E, Kyriacou T, Pantin T. #hayfever; a longitudinal study into hay fever related tweets in the UK. In: Proceedings of the 6th International Conference on Digital Health Conference. DH’16. New York, NY, USA: Association for Computing Machinery; 2016. p. 85–89.
  42. 42. Wakamiya S, Morimoto O, Omichi K, Hara H, Kawase I, Koshiba R, et al. Exploring relationships between tweet numbers and over-the-counter drug sales for allergic rhinitis: retrospective analysis. JMIR Form Res. 2022;6(2):e33941. pmid:35107434
  43. 43. Institute for Information and Communications Policy, Ministry of Internal Affairs and Communications, Japan; 2022. Survey on information and communication media usage time and information behavior in FY2021.
  44. 44. Blei DM, Ng AY, Jordan MI. Latent dirichlet allocation. J Mach Learn Res. 2003;3(Jan):993–1022.
  45. 45. Mohammad SM, Turney PD. Crowdsourcing a word-emotion association lexicon. Comput Intell. 2013;29(3):436–465.