Mobile, social, real-time: the ongoing revolution in the way people communicate has given rise to a new kind of epidemiology. Digital data sources, when harnessed appropriately, can provide local and timely information about disease and health dynamics in populations around the world. The rapid, unprecedented increase in the availability of relevant data from various digital sources creates considerable technical and computational challenges.
Citation:Salathé M, Bengtsson L, Bodnar TJ, Brewer DD, Brownstein JS, et al. (2012) Digital Epidemiology. PLoS Comput Biol 8(7): e1002616. doi:10.1371/journal.pcbi.1002616
Editor: Philip E. Bourne, University of California San Diego, United States of America
Published: July 26, 2012
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding:The authors received no specific funding for this article. The content of this paper is solely the responsibility of the authors and does not necessarily represent the official views of the Office of Behavioral and Social Sciences Research or the National Institutes of Health.
Competing interests: The authors have declared that no competing interests exist.
Epidemiology, literally the “study of what is upon people”, is concerned with the dynamics of health and disease in human populations. Research in epidemiology aims to identify the distribution, incidence, and etiology of human diseases  to improve the understanding of the causes of diseases and to prevent their spread. Traditionally, epidemiology has been based on data collected by public health agencies through health personnel in hospitals, doctors' offices, and out in the field. In recent years, however, novel data sources have emerged where data are frequently collected directly from individuals through the digital traces they leave as a consequence of modern communication  and an increased use of electronic devices.
The communication revolution—the explosion of mobile phone and Internet usage—unfolding in the past few decades has led to two major outcomes: that all types of modern communication are now digital, and that the number of users of devices enabling digital communication is in the billions, rapidly approaching full coverage in large parts of the world . As a consequence, an increasingly large fraction of what we do and say—including epidemiologically relevant behaviors such as deciding on preventive measures and treatment choices, as well as reporting disease symptoms—is stored electronically, often in accessible form and thus amenable to analysis. Extracting meaningful information from this data deluge is challenging, but holds unparalleled potential for epidemiology. The observation of the spatiotemporal movements of millions of people during disease outbreaks , the rapid detection of an unusual respiratory illness in a remote village anywhere on the globe , the near real-time estimation of influenza activity levels , , and the assessment of vaccination sentiments during pandemic preparedness efforts  are examples of realizations of this potential.
Web-based data mining is having a revolutionary impact on the way we monitor global health outcomes and behaviors. Some types of infectious and chronic disease data can be captured from and disseminated in near real-time through an array of online sources including chat rooms, social networks, blogs, web search records, and online news media. These online sources provide a picture of global health that is often different  from the picture created by traditional surveillance systems. In fact, these data streams have become invaluable data sources for a new generation of public health surveillance systems that operate across international borders, fill in gaps in public health infrastructure, and complement existing traditional surveillance systems , . While for many of the most vulnerable countries, lab and clinical surveillance capacity are still years from being realized, health information is already being exchanged via web queries, social networking sites, and mobile devices.
These data sources, when harnessed appropriately, can provide local and timely information about disease outbreaks and related events around the world. Further, these sources have been credited with decreasing the time between an outbreak and formal recognition of an outbreak , thus allowing for an expedited response to the public health threat. Data from search engines can now provide early warning of respiratory illnesses in local communities while data from social networking sites can provide early warning of vaccine refusal stemming from conspiracy theories or other reasons. Online news media can provide a window into the emergence of pandemics weeks before it is brought to light by traditional surveillance. Similarly, data from social media could tell us about emerging trends in a wide range of health behaviors—e.g., the uptake of new tobacco products—at the local and national level.
Traditional surveillance methods emerged in a world that was very different from an epidemiological perspective. Prior to the introduction of vaccines, most deaths were caused by infectious diseases (see  for the vital statistics rates in the United States). In the past, networks on which diseases spread were much more limited geographically in their expansion, due to limited social and spatial mobility. This was also manifested by slower geographic dissemination of diseases , . Nowadays, non-communicable diseases are by far the main cause of illness and death in high-income countries, while accounting for about half of the burden of disease in low- and middle-income countries . Depression, type-II diabetes, and cardiovascular and pulmonary diseases pose a substantial public health risk and are typically associated with behavioral risk factors . These risk factors—such as drug abuse, smoking, and poor diet and exercise—and the associated diseases are often found to be clustered in the population . The processes by which this empirical pattern arises are currently not fully understood, but as more individual health behaviors and outcomes are shared online, digital epidemiology offers an increasingly clear picture of the dynamics of these processes. With respect to infectious diseases, newly emerging pathogens can appear unexpectedly, spread very rapidly, and be potentially devastating to millions. A consequence of this change in the epidemiologic landscape is that individual behaviors are now at the center of disease dynamics and control. Individual behaviors will play a key role in social distancing efforts as early responses to newly emerging, rapidly spreading infectious diseases. One of the key advantages of online social media data, apart from the increasingly large data volumes, is that they are highly contextual and networked , and increasingly hyperlocal (Figure 1). For example, the networked nature of the Twitter data in the vaccination sentiment study by Salathé and Khandelwal  allowed for the identification of network clusters with strong sentiment bias, and of positive dyadic assortativity of vaccination sentiments across the entire network of users. Overall, these advantages allow us to study individuals and groups in the rich contexts in which their lives unfold, and to study person-to-person spread of disease and behaviors at the level at which it actually occurs.
Inset shows greater Los Angeles area. Brightness of color corresponds to geographic density of tweets.
Thus, there is great potential to deepen understanding of disease dynamics through the analysis of digital traces. To date, however, most epidemiologic studies involving such data have focused on presumed routes of transmission that have not yet been empirically established. For instance, we are still in need of data that indicate the relative importance of droplet, airborne, and contact transmission of influenza and other common respiratory infections in natural community settings . Until researchers employ rigorous and sensitive study designs for identifying modes of transmission with confidence , the empirical basis of prevention advice for many infectious diseases will remain weak. Fortunately, diverse types of digital trace data may enhance exposure measurement and facilitate strong tests of specific routes of transmission. For example, in studies of small communities, such as schools or workplaces, individuals could carry or wear digital devices that sense their face-to-face proximity to others as well as record their spatial movements. Proximity and spatial mobility data, when coupled with regular surveillance of symptoms and incident infections and viral sequencing, may often distinguish modes of transmission in particular cases. Persons with genetically related infections who had no face-to-face proximity during the period when any of them were symptomatic would imply that transmission did not occur by droplets. Other combinations of proximity and spatiotemporal overlap for persons with genetically related infections would imply other modes of transmission.
The everyday movements of humans create the dynamic links that connect populations and enable geographic spread and sustained transmission of infectious diseases. Difficulties in measuring these types of human movements, traditionally estimated using travel surveys, road networks, or small-scale global positioning system (GPS) studies, have long hindered efforts to understand these dynamics. Mobile phone data in the form of call data records (containing information about the location of the mobile phone tower used during a call from a mobile phone) provide one of today's most exciting opportunities to study human mobility  and its influence on disease dynamics. Analogously, advances in wearable devices have radically improved our capability to track human contacts at high spatial and temporal resolution , affording a much more detailed characterization and understanding of social behaviors , complementing previous work based on large-scale surveys and self-reported information . Objective measurements of social contact and mobility networks complement self-reported data and pave the way to a more accurate description of infectious disease dynamics. In particular, high quality data are needed to improve parameterization of large-scale computer simulation disease models. The introduction of these models has enabled us to broaden the traditional modeling perspective to encompass large numbers of individuals, rather than population aggregates. Mobile phone data have already been used to create realistic models of human mobility , predict the rate of spread of drug resistance , assess the prospects of malaria eradication , and monitor population movements during the Haiti cholera outbreak in near real-time . Models based on recorded sequences of human contacts can inform the design of containment measures and of targeted immunization strategies  and marks an important departure from the static representation of contact networks . Large-scale mobility data can be used to map the worldwide circulation of emerging infectious diseases such as the 2009 H1N1 pandemic , . In other words, data are increasingly shaping the development of computer simulations that create in silico experiments hardly feasible in real systems with the goal of providing better scenario analysis for the policy making process and crisis management.
The technical challenges in all these efforts are significant. The collection, storage, and analysis of massively large data sets is made through the interface of infrastructure, software, and sophisticated algorithms. The infrastructure requirements include high bandwidth, low-latency computer networks, access to vast amounts of storage, and the availability of large clusters of machines for computation. Through state-of-the-art innovations in the cloud computing industry, unparalleled computational power and storage resources can be leased on-demand and economically. Given the real-time, large-scale demands of scientific data today, data collection and storage software need to run continuously, impervious to hardware, software, and network failure. A further challenge is the design of algorithms and data structures that are efficient and scalable for processing, mining, and analyzing dynamic and large-scale epidemiologic data. This requires the adaptation of current algorithms to run on computer clusters (cloud or dedicated), and the development of new algorithms that leverage emerging data processing techniques such as MapReduce, a programming model for processing large data sets in parallel on large distributed computer systems . In addition, the extraction of knowledge (e.g., filtering, classification, anomaly detection) requires cutting-edge data mining algorithms specifically designed for the context of epidemiology. These challenges require a new breed of practitioners, combining epidemiologic expertise, analytical expertise, and advanced computational skills. They also require a curiosity to keep up with the fast pace at which novel communication tools are adopted. The adoption of social media services by hundreds of millions of people in just a few years is staggering to contemplate. At the same time, novel data streams always require careful consideration of potential biases. For example, a recent Pew Internet study  of Twitter users in the United States found significant differences among age groups, race/ethnicity groups, and among geographic locations.
Finally, challenges regarding data access, data sharing, and privacy need our constant attention. Some of the electronic traces that we leave as digital citizens are meant to be public, while others are not, resulting in ethical and legal challenges . Furthermore, while it is easy to imagine the potential benefits of extracting information from big data, access to such data is often limited, costly, or altogether impossible for many in the research community . There is also substantial variability in the sharing of data after it has been analyzed, an issue that is particularly problematic when dealing with very large data volumes because numerous—often subjective—filters need to be applied to make the original, noisy data suitable for analysis. What's more, while some data sources are legally accessible, their sharing is often not. These challenges notwithstanding, we believe that a digital epidemiology will on balance have substantial societal benefits due to the great improvements in the speed, scope, and focus of information available for public health purposes. And indeed, while these challenges still remain significant obstacles, web- and phone-based data mining is already having immediate impact on the operational activities of public health agencies worldwide.
Marcel Salathé is an Assistant Professor of Biology at the Pennsylvania State University, adjunct faculty at the Computer Science and Engineering Department, and a Society in Science – Branco Weiss fellow. His research group at the Center for Infectious Disease Dynamics (CIDD) is interested in how health and disease dynamics are affected by the interaction of biological and social diffusion processes. He's the co-creator of crowdbreaks.com, a crowd-sourced disease surveillance system using social media data.
Linus Bengtsson is a medical doctor at the Division of Global Health at Karolinska Institute, Stockholm, Sweden. He is co-founder of the non-profit initiative Flowminder.org. His research focuses on uses of mobile phone operator data to follow population movements during natural disasters and infectious disease outbreaks in order to improve efficiency of relief operations.
Todd Bodnar is a computational biologist at Penn State University who is interested in the spread of disease and behavior with in human populations. His recent work lies at the nexus of machine learning and agent-based modeling.
Devon D. Brewer, PhD, is the director of Interdisciplinary Scientific Research (http://www.interscientific.net) in Seattle, United States of America. He conducts research in the health and social sciences on social networks, research methods and design, infectious disease, substance abuse, crime and violence, and other diverse topics.
John Brownstein, PhD, is an Associate Professor at Harvard Medical School and directs the Computational Epidemiology Group at the Children's Hospital Informatics Program in Boston. His research is dedicated to statistical and informatics approaches aimed at improving public health practice. He has been at the forefront of the development and application of public health surveillance, including HealthMap.org, an Internet-based participatory global infectious disease intelligence system.
Caroline Buckee's work focuses on the population dynamics of genetically diverse pathogen species including the malaria parasite and the meningococcus. She uses a range of modeling techniques to understand the relationship between the evolution of these species and the epidemiological patterns of infection and disease among human populations.
Ellsworth Campbell is a University Graduate Fellow and doctoral student in the Salathé Research Group at the Center for Infectious Disease Dynamics. His research employs theoretical models of human behavior and infectious disease to aid in the development of rational public policy.
Ciro Cattuto is a senior researcher at the ISI Foundation in Turin, Italy. His initial training is in computational statistical physics. He has recently worked on measuring, analyzing, and modeling human contact networks in hospitals and schools, as well as on computational investigations of epidemic processes over time-dependent complex networks.
Shashank Khandelwal is a software developer at the Center for Infectious Disease Dynamics at Penn State University. He designs and implements big data software systems to solve interesting problems at the intersection of biology and computer science. He has recently worked on creating a disease surveillance system based on open-source social media data.
Patricia L. Mabry is a behavioral scientist and a Senior Advisor in the Office of Behavioral and Social Sciences Research at the National Institutes of Health. She has devoted the past several years to facilitating the adoption of systems science approaches (including a variety of modeling and simulation methods) by the behavioral and social science research community. In particular, she has developed training institutes, educational videocasts, and funding and cross-disciplinary networking opportunities for those pursuing health research questions.
Alessandro Vespignani is the Sternberg Distinguished Professor at Northeastern University in Boston, where he leads the Laboratory for the Modeling of Biological and Socio-technical Systems. He is fellow of the American Physical Society, member of the Academy of Europe, and fellow of the Institute for Quantitative Social Sciences at Harvard University. He is also serving in the board/leadership of a variety of journals and the Institute for Scientific Interchange Foundation. He is now focusing his research activity in modeling diffusion phenomena in complex systems, including the realistic and data-driven computational modeling of infectious diseases spread.
This paper originated at the workshop “Data Science & Epidemiology” on October 6 and 7, 2011, organized by Marcel Salathé and held at the Center for Infectious Disease Dynamics (CIDD) at Penn State University.
- 1. Green MD, Freedman DM, Gordis L (2000) Reference guide on epidemiology. Reference manual on scientific evidence (Federal Judicial Center). Available: http://www.fjc.gov/public/pdf.nsf/lookup/sciman06.pdf/file/sciman06.pdf.Accessed 29 June 2012.
- 2. Eysenbach G (2009) Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res 11: e11. doi: 10.2196/jmir.1157.
- 3. International Telecommunication Union (2011) Measuring the information society 2011. 157 p. Available: http://www.itu.int/net/pressoffice/backgrounders/general/pdf/5.pdf.Accessed 29 June 2012.
- 4. Bengtsson L, Lu X, Thorson A, Garfield R, von Schreeb J (2011) Improved response to disasters and outbreaks by tracking population movements with mobile phone network data: a post-earthquake geospatial study in Haiti. PLoS Med 8: e1001083 doi:10.1371/journal.pmed.1001083.
- 5. Brownstein JS, Freifeld CC, Madoff LC (2009) Digital disease detection–harnessing the Web for public health surveillance. N Engl J Med 360: 2153–2155, 2157 doi:10.1056/NEJMp0900702.
- 6. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, et al. (2009) Detecting influenza epidemics using search engine query data. Nature 457: 1012–1014 doi:10.1038/nature07634.
- 7. Signorini A, Segre AM, Polgreen PM (2011) The use of Twitter to track levels of disease activity and public concern in the U.S. during the influenza A H1N1 pandemic. PLoS ONE 6: e19467 doi:10.1371/journal.pone.0019467.
- 8. Salathé M, Khandelwal S (2011) Assessing vaccination sentiments with online social media: implications for infectious disease dynamics and control. PLoS Comput Biol 7: e1002199 doi:10.1371/journal.pcbi.1002199.
- 9. Brownstein JS, Freifeld CC, Reis BY, Mandl KD (2008) Surveillance sans frontieres: Internet-based emerging infectious disease intelligence and the HealthMap project. PLoS Med 5: e151 doi:10.1371/journal.pmed.0050151.
- 10. Heymann DL, Rodier GR (2001) WHO Operational Support Team to the Global Outbreak Alert and Response Network (2001) Hot spots in a wired world: WHO surveillance of emerging and re-emerging infectious diseases. Lancet Infect Dis 1: 345–353 doi:10.1016/S1473-3099(01)00148-7.
- 11. Heymann DL, Rodier GR (2004) Global surveillance, national surveillance, and SARS. Emerging Infect Dis 10: 173–175. doi: 10.3201/eid1002.031038
- 12. Chan EH, Brewer TF, Madoff LC, Pollack MP, Sonricker AL, et al. (2010) Global capacity for emerging infectious disease detection. Proc Nat Acad Sci U S A 107: 21701–21706 doi:10.1073/pnas.1006219107.
- 13. Grove R, Hetzel A (1968) Vital statistics rates in the United States, 1940–1960. U.S. Department of Health, Education, and Welfare. Public Health Service. Public Health Service Publication No. 1677. Washington (D.C.): National Center for Health Statistics. 887 p.
- 14. Noble JV (1974) Geographic and temporal development of plagues. Nature 250: 726–729. doi: 10.1038/250726a0
- 15. Hufnagel L, Brockmann D, Geisel T (2004) Forecast and control of epidemics in a globalized world. Proc Nat Acad Sci U S A 101: 15124–15129 doi:10.1073/pnas.0308344101.
- 16. World Health Organization (2008) The global burden of disease: 2004 update. 146 p. Available: http://www.who.int/entity/healthinfo/global_burden_disease/GBD_report_2004update_full.pdf.Accessed 29 June 2012.
- 17. Mokdad AH, Marks JS, Stroup DF, Gerberding JL (2004) Actual causes of death in the United States, 2000. JAMA 291: 1238–1245 doi:10.1001/jama.291.10.1238.
- 18. Schuit AJ, van Loon AJM, Tijhuis M, Ocké M (2002) Clustering of lifestyle risk factors in a general adult population. Prev Med 35: 219–224. doi: 10.1006/pmed.2002.1064
- 19. GoldfrankLR, LivermanCT (2007) Preparing for an Influenza Pandemic: Personal Protective Equipment for Healthcare Workers. Washington (D.C.): The National Academies Press.
- 20. Brewer DD, Hagan H, Sullivan DG, Muth SQ, Hough ES, et al. (2006) Social structural and behavioral underpinnings of hyperendemic hepatitis C virus transmission in drug injectors. J Infect Dis 194: 764–772 doi:10.1086/505585.
- 21. Gonzalez MC, Hidalgo CA, Barabasi A-L (2008) Understanding individual human mobility patterns. Nature 453: 779–782 doi:10.1038/nature06958.
- 22. Cattuto C, Van den Broeck W, Barrat A, Colizza V, Pinton J-F, et al. (2010) Dynamics of Person-to-Person Interactions from Distributed RFID Sensor Networks. PLoS ONE 5: e11596 doi:10.1371/journal.pone.0011596.
- 23. Pentland A, Pentland S (2008) Honest signals: how they shape our world. Cambridge (MA): MIT Press.
- 24. Mossong J, Hens N, Jit M, Beutels P, Auranen K, et al. (2008) Social contacts and mixing patterns relevant to the spread of infectious diseases. PLoS Med 5: e74 doi:10.1371/journal.pmed.0050074.
- 25. Lynch C, Roper C (2011) The transit phase of migration: circulation of malaria and its multidrug-resistant forms in Africa. PLoS Med 8: e1001040 doi:10.1371/journal.pmed.1001040.
- 26. Tatem AJ, Qiu Y, Smith DL, Sabot O, Ali AS, et al. (2009) The use of mobile phone data for the estimation of the travel patterns and imported Plasmodium falciparum rates among Zanzibar residents. Malar J 8: 287 doi:10.1186/1475-2875-8-287.
- 27. Salathé M, Kazandjieva M, Lee JW, Levis P, Feldman MW, et al. (2010) A high-resolution human contact network for infectious disease transmission. Proc Nat Acad Sci U S A 107: 22020–22025 doi:10.1073/pnas.1009094108.
- 28. Stehlé J, Voirin N, Barrat A, Cattuto C, Colizza V, et al. (2011) Simulation of an SEIR infectious disease model on the dynamic contact network of conference attendees. BMC Med 9: 87 doi:10.1186/1741-7015-9-87.
- 29. Balcan D, Hu H, Goncalves B, Bajardi P, Poletto C, et al. (2009) Seasonal transmission potential and activity peaks of the new influenza A(H1N1): a Monte Carlo likelihood analysis based on human mobility. BMC Med 7: 45 doi:10.1186/1741-7015-7-45.
- 30. Merler S, Ajelli M, Pugliese A, Ferguson NM (2011) Determinants of the spatiotemporal dynamics of the 2009 H1N1 pandemic in Europe: implications for real-time modelling. PLoS Comput Biol 7: e1002205 doi:10.1371/journal.pcbi.1002205.
- 31. Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters. In Proceedings of Operating Systems Design and Implementation (OSDI). San Francisco, CA. pp 137–150.
- 32. Smith A, Brenner J (2012) Twitter use 2012. Pew Internet & American Life Project, May 31, 2012. Available: http://pewinternet.org/~/media/Files/Reports/2012/PIP_Twitter_Use_2012.pdf.Accessed 29 June 2012.
- 33. Boyd D, Crawford K (2011) Six provocations for big data. A decade in internet time: symposium on the dynamics of the internet and society, September 2011. Available: http://ssrn.com/abstract=1926431 and doi:10.2139/ssrn.1926431. Accessed 29 June 2012.
- 34. Manovich L (2012) Trending: the promises and the challenges of big social data. In: Debates in the digital humanities. Gold MK, editor Minneapolis: University of Minnesota Press. 532 p.