Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

COVID-19 and crime: Analysis of crime dynamics amidst social distancing protocols

  • Shelby M. Scott ,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Validation, Visualization, Writing – original draft

    sscott41@vols.utk.edu

    Affiliation Department of Ecology and Evolutionary Biology, University of Tennessee, Knoxville, Tennessee, United States of America

  • Louis J. Gross

    Roles Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    Affiliations Department of Ecology and Evolutionary Biology, University of Tennessee, Knoxville, Tennessee, United States of America, National Institute for Mathematical and Biological Synthesis, Knoxville, Tennessee, United States of America

Abstract

In response to the pandemic in early 2020, cities implemented states of emergency and stay at home orders to reduce virus spread. Changes in social dynamics due to local restrictions impacted human behavior and led to a shift in crime dynamics. We analyze shifts in crime types by comparing crimes before the implementation of stay at home orders and the time period shortly after these orders were put in place across three cities. We find consistent changes across Chicago, Baltimore, and Baton Rouge with significant declines in total crimes during the time period immediately following stay at home orders. The starkest differences occurred in Chicago, but in all three cities the crime types contributing to these declines were related to property crime and statutory crime rather than interpersonal crimes.

Introduction

Crime is a major public concern in the United States. Gun violence leads to the deaths of 36,000 individuals and the non-fatal injuries of 85,000 others [1]. Other crime types can produce property damage, trauma for victims, and fractures in community trust [2]. Across the five major crime categories (personal, property, inchoate, statutory and financial), some rely on regular interpersonal interactions and social dynamics [3].

In early 2020, COVID-19 emerged in the United States and case numbers quickly grew across the country. In response to the pandemic, many cities implemented a variety of mitigation policies to minimize spread. A major strategy for preventing viral spread focuses on reducing contacts between individuals using stay at home orders, which closed non-essential businesses, mandated wearing masks, and encouraged citizens to minimize all non-essential visits [4]. Adherence to these policies was initially strong, but faded over time, as evidenced by self-reporting and cell phone movement data (see S1-S3 Figs in S1 File) [5]. Implementing these types of policies resulted in drastic changes in the behaviors of citizens. Because crime is associated with human behavior, many have questioned how reductions in human contact have changed the dynamics of crimes across the country [615].

In a pandemic which strains health care resources, collateral mortality may increase, due to the inability of the health care system to respond as effectively to crime-derived injuries [16]. Evaluating the impact of the pandemic on crime in a rigorous manner can assess the potential for significant changes in crime-derived mortality.

We test whether there are significant differences in the crime dynamics in Chicago, IL when comparing the time periods pre- and post-establishment of the stay at home orders, and then compare these results to Baton Rouge, LA and Baltimore, MD. We choose to analyze the first two weeks following the stay ay home order implementation because adherence to the mandates was strongest immediately following implementation (see S1-S3 Figs in S1 File) [5]. Our main focus is Chicago, due to its high rates of both COVID-19 and crime. Comparison of the crime dynamics in the three cities determines whether similar patterns exist (Fig 1). We hypothesize that changes in crime dynamics in all three cities following the implementation of stay at home orders are not uniform across all crime types and that there are differences between crimes associated with property, those which are statutory, and those involving interpersonal interactions. We define property crimes (denoted with P for this study) as those which involve interference with the property of another [3]. We define statutory crimes (denoted with S for this study) as those which are proscribed by statute [3]. We define interpersonal crimes (denoted with I for this study) as those that result in physical or mental harm to another person [3]. We find that total crimes declined significantly in the two weeks following implementation of stay-at-home orders across all three cities. In Chicago total crimes declined 31.5%. The property crimes with significant declines were burglary (22.9%), criminal trespass (50.1%), robbery (25.8%), and theft (41.0%). The statutory crimes with significant declines were interference with public officers (93.1%), narcotics (86.1%), and other offenses (41.2%). The interpersonal crimes with significant declines were assault (19.4%), and criminal sexual assault (56.0%). Baltimore also experienced significant declines in total crimes (25.9%). The crime types showing significant declines were auto theft (29.9%), burglary (29.2%), and larceny (35.0%), which are all property crimes. Baton Rouge also experienced significant declines in total crimes (22.4%). The crime types that showed significant declines were narcotics (52.3%) and other crimes (41.5%), which are both statutory crimes.

thumbnail
Fig 1. The total crime trends seen in Chicago, Baltimore, and Baton Rouge from the beginning of the year through the end of our study period.

Each point is the total number of crimes observed on that day. The vertical line represents the day when the stay at home order was implemented for each city. The dark line represents a moving average of the data with k = 5 to observe shifts in dynamics over a five day temporal window [23]. More information regarding these methods is available in the S1 File.

https://doi.org/10.1371/journal.pone.0249414.g001

Materials and methods

Data

Chicago, Baltimore, and Baton Rouge each have publicly available crime datasets through citywide data portals [1719]. Due to lack of consensus on collecting, defining, and reporting crime, care should be taken when comparing one dataset to another. Descriptions of each crime type included are available in the (see S2 Table in S1 File). These three cities were chosen because they had openly available crime data and they differ in demographics (see S1 Table in S1 File) [20]. Chicago has a 4.5 times larger population than Baltimore and 12 times larger than Baton Rouge [20]. All three cities have fairly high poverty rates and regularly receive media attention for their crime dynamics. Crime in all three cities remained fairly consistent from 2017-2019 (see S4-S6 Figs in S1 File). They also exist in three different regions of the country, making them interesting comparisons for this study [20].

All data and code files used in this analysis are available through GitHub at https://github.com/shelbymscott/COVIDandCrime.

Chicago data.

The Chicago City Data Portal provides crime reports from 2001-present [19]. Data are extracted from the CLEAR (Citizen Law Enforcement Analysis and Reporting) system. The information from this dataset used for this analysis includes the date, primary type, and description, but a number of other items are available. We isolated the crimes which occurred from January 1, 2020 through April 4, 2020, which gave data from before the onset of the pandemic (01/01/2020—03/08/2020), during the state of emergency (03/09/2020—03/20/2020), and after the stay at home order was put in place (03/21/2020—04/04/2020) for temporal comparisons. There are 32 different crime types available, but for this analysis we choose 19 of the crime types with high occurrence and denote them as property (P), statutory (S), or interpersonal (I). They include:

  • Total Crimes
  • Gun Crimes (pulled from crime descriptions that included firearm use)
  • Arson (P)
  • Burglary (P)
  • Criminal Damage (P)
  • Criminal Trespass (P)
  • Robbery (P)
  • Theft (P)
  • Weapons Violation (P)
  • Interference with Public Officer (S)
  • Narcotics (S)
  • Other Offense (S)
  • Public Peace Violation (S)
  • Assault (I)
  • Battery (I)
  • Criminal Sexual Assault (I)
  • Homicide (I)
  • Sex Offense (I)

These crime types were chosen because they composed a high proportion of total crimes or were present in the Baltimore or Baton Rouge datasets for potential comparison. Definitions of these crime types are available in the (see S2 Table in S1 File). Those crime types excluded due to low numbers were: concealed carry license violations, deceptive practices, gambling, human trafficking, intimidation, kidnapping, liquor law violations, obscenity, offenses involving children, other narcotics violations, prostitution, public indecency, and stalking. We determined whether the crime types should be included based on if they comprised greater than or equal to 0.2% of total crimes. This number was found by determining the lowest percentage from the Baltimore and Baton Rouge datasets and only including those crime types which exceeded this amount.

Baltimore data.

Baltimore, Maryland has Victim Based Crime data available for public download [18]. The data are preliminary and therefore may be subject to change [18]. The data provided includes a number of different options from which to choose. The relevant information we use includes the date of the crime and the crime type. We isolate those crime types which occurred from the beginning of the year (1/1/20) to when the stay at home order was put in place (3/29/20) and the two weeks following the implementation (3/30/20—4/13/20). The 11 crime types available for analysis are denoted as property (P) or interpersonal (I) as this dataset did not account for statutory crimes since it only provides crimes where an individual was victimized. Definitions of these crime types are available in the (see S2 Table in S1 File). The dataset includes:

  • Total Crimes
  • Gun Crimes (determined by finding those crimes which involved a firearm as a weapon)
  • Arson (P)
  • Auto Theft (P)
  • Burglary (P)
  • Larceny (P)
  • Robbery (P)
  • Assault (I)
  • Homicide (I)
  • Rape (I)
  • Shooting (I)

Baton Rouge data.

Crimes reported in Baton Rouge are handled by the Baton Rouge Police Department and are publicly available [17]. The data are pulled from police reports using automatic statistical reporting, which can lead to some errors [17]. We obtained the dates and crime types from the dataset and parse for the time period from the beginning of the year to when the stay at home order was put in place (1/1/20—3/21/20) and the two weeks following the stay at home order (3/22/20—4/5/20). The 15 crime types analyzed are denoted as property (P), statutory (S), and interpersonal (I). Definitions of these crime types are available in the (see S2 Table in S1 File). The dataset includes:

  • Total Crimes
  • Burglary (P)
  • Criminal Damage (P)
  • Robbery (P)
  • Theft (P)
  • Juvenile (S)
  • Narcotics (S)
  • Nuisance (S)
  • Other (S)
  • Vice (S)
  • Assault (I)
  • Battery (I)
  • Firearm (I)
  • Homicide (I)
  • Sexual Assault (I).

t-test analysis

In order to determine whether the differences seen in crime dynamics are significant or not, we performed numerous t-tests that compared whether different years and time periods differed significantly [21]. T-tests determine whether the means of two sets of data are significantly different from each other [21]. Because we were performing a number of statistical tests simultaneously, we used the Bonferroni correction to be sure that spurious positives were not included by random chance [22]. The Bonferroni correction sets the significance value, α, for the entire set of n t-tests run equal to α* by taking: Formally, given n t-tests Ti for hypotheses Hi (i between 1 and n) under the assumption H0 that all hypotheses Hi are false, and if the individual test critical values are less than or equal to α/n, then the critical value is less than or equal to α. In equation form, if: for 1 ≤ in, then which follows from the Bonferroni inequalities [21]. The p-value result from a t-test represents the probability of obtaining test results at least as extreme as the results actually observed, under the assumption that the null hypothesis is correct [21].

There were t-tests performed on the datasets in order to determine whether what has been observed in 2020 is significantly different behavior from other years. These included:

  • Year to year tests to determine whether the 2020 observed behavior in Chicago differs from what we would have expected from previous years (Table 1, S4-S6 Figs in S1 File).
  • Within year analysis to determine whether the behavior before pandemic response (1/1/20—3/20/20) and after the stay at home orders were put in place in Chicago (3/21/20—4/3/20) differ from one another (Table 2, S7-S10 Figs in S1 File).
  • Time period comparisons over Baltimore and Baton Rouge to determine whether the patterns seen in response to COVID in Chicago are consistent across numerous cities (Table 2, S11 and S12 Figs in S1 File).
  • Comparison tests with past years to determine whether the observed behavior is due to seasonality or differing temporal dynamics during the pandemic (S3-S19 Tables in S1 File, S4-S6 Figs in S1 File).
thumbnail
Table 1. Comparisons of each Chicago crime type in the first three months 2019, 2018, and 2017 compared to crime types in the same time period of 2020.

The degrees of freedom for these analyses are 179 and α = .05 is adjusted after Bonferroni correction (with n = 18) to α = 0.0027. The values for mean μ, standard deviation σ, and percent change are also provided. Bolded crime types show significant differences between years and crime categories are denoted by (P) for property, (S) for statutory, and (I) for interpersonal crimes.

https://doi.org/10.1371/journal.pone.0249414.t001

thumbnail
Table 2. Comparisons of the time period before the stay at home order was put in place and the two weeks after it was put in place in Chicago, Baltimore, and Baton Rouge.

The observed time period for the stay at home order spans from 03/21/2020—04/04/2020 in Chicago. The degrees of freedom for these analyses are 89 and α = .05 is adjusted after Bonferroni correction (with n = 18) to α = 0.0027. The two weeks after Baltimore’s stay at home period span from 03/30/20—04/13/20. The degrees of freedom for these analyses are 101 and α = .05 is adjusted after Bonferroni correction (with n = 11) to α = 0.0045. The two weeks after Baton Rouge’s stay at home order span from 03/22/20—04/05/20. The degrees of freedom for these analyses are 93 and α = .05 is adjusted after Bonferroni correction (with n = 15) to α = 0.0033. The values for mean μ, standard deviation σ, and percent change are also provided. Bolded crime types show significant differences between years and crime categories are denoted by (P) for property, (S) for statutory, and (I) for interpersonal crimes.

https://doi.org/10.1371/journal.pone.0249414.t002

Results

Comparing January through early April Chicago crime data (early 2020) to the same time period in each of the three previous years determines which crime types in 2020 are significantly different [19]. The results (Table 1, S3-S5 Tables and S9-S17 Tables in S1 File) show that between the early months of 2019 and 2020, there were decreases in total crimes, burglaries, narcotics, other offenses, and thefts. Between 2018 and 2020, total crimes, burglaries, criminal damages, criminal trespasses, narcotics, other offenses, robberies, and thefts all decreased, while weapons violations increased. Between 2017 and 2020, total crimes, burglaries, criminal damages, criminal trespasses, other offenses, public peace violations, robberies, and thefts all decreased, while weapons violations increased. These comparisons include the time period from January 1 to April 4.

To determine whether there were significant differences in crime between time periods, we performed a series of t-tests [21, 22]. While Chicago had three distinct time periods: pre-COVID, a state of emergency, and a stay at home order, the results from the state of emergency were not as stark as comparisons between the time period before the stay at home order was implemented and the two weeks after implementation (see supplementary text, S3-S17 Tables in S1 File, and S4 Fig in S1 File). Total crimes, assaults, burglaries, criminal sexual assaults, criminal trespasses, interference with public officers, narcotics, other offenses, robberies, and thefts each had significant decreases from the time period before the stay at home order was put in place to the two weeks following implementation (Table 2, Fig 2a).

thumbnail
Fig 2. All crime types across Chicago, Baltimore, and Baton Rouge split into pre- and post-stay-at-home order time periods.

We also split the crime types into the three crime categories: interpersonal, statutory, and property. The crime types that show significant differences are denoted with an asterisk.

https://doi.org/10.1371/journal.pone.0249414.g002

In order to determine whether similar patterns have been observed in other cities with different demographics (S1 Table in S1 File), we test victim-based crime data from Baltimore, before the stay at home order was put in place and two weeks after implementation (Table 2) [18]. We find that total crimes, auto thefts, burglaries, and larceny all showed significant declines between the two time periods (Fig 2b).

As a further comparison to a smaller population city with different demographics (S1 Table in S1 File), crime data from Baton Rouge were analyzed (Table 2) [17]. We find that total crimes, narcotics, and other crimes all decreased significantly after the stay at home order was put in place (Fig 2c).

Discussion and conclusions

The analysis of crime data from three cities indicates significant impacts on certain crime types arising from changes in social dynamics due to regulations implemented in response to the COVID-19 pandemic. The results of pair-wise t-tests, appropriately corrected, show that the crime dynamics experienced in 2020 significantly differ from previous years and that the implementation of strict stay at home orders in all three cities initially impacted crime.

Chicago’s total crimes during the first three months of the year (including the time period following the stay at home order) declined in 2020 compared to 2017, 2018, and 2019 (see S3-S17 Tables in S1 File). Before the time period during which COVID protocols were put in place, there were no significant changes in total crimes compared to 2018 and 2019. There were some changes in particular crime types that may have been due to social factors, policing protocols, or other mechanisms occurring in past years. There were significant changes in total crimes between 2017 and 2020, with all significant crime types but weapons violations showing declines (S11 Table in S1 File). Once the stay at home order was put in place, there were more stark significant differences between past years and 2020 (see S12-S14 Tables in S1 File). Total crimes during this time period declined compared to the past three years. There are a number of different crime types contributing to this decline, and few of the contributing crime types are interpersonal (see S7-S10 and S14 Figs in S1 File). The exceptions are significant declines in assaults and batteries between 2017 and 2019 compared to 2020 (S12 and S14 Tables in S1 File). These results show that the crime dynamics of 2020 are significantly different from those in past years and that the changes would not have been expected based on time-based observations prior to the pandemic outbreak.

We also compared the crime numbers in Chicago between different time periods. Comparing crime types before the stay at home order was put in place to the two weeks after implementation indicates that most of the crime types tested showed significant declines. They include total crimes, assaults, burglaries, criminal sexual assaults, criminal trespasses, interference with public officers, narcotics, other offenses, robberies, and thefts (Table 2, Fig 2, S14 Fig in S1 File). This shows that the immediate time period after stay at home orders were announced does correlate with decreased total crimes, but that the crimes contributing to this decline are related more to property crimes and statutory crimes than to interpersonal crimes (S7-S10 Figs in S1 File).

To determine whether this pattern holds in other cities, we also carried out time period comparisons for Baltimore, MD and Baton Rouge, LA (Table 2). Both cities showed similar results. In Baltimore, comparing the time period before the stay at home order was implemented and the two weeks after shows that total crimes, auto thefts, burglaries, and larceny showed significant differences (Fig 2, S14 Fig in S1 File). For Baton Rouge, total crimes, narcotics, and other crimes showed significant differences when comparing the two weeks after the stay at home order was put in place and the time period before the order was implemented (Fig 2, S14 Fig in S1 File).

In all of our tests across different years and different time periods, we find that the implementation of social distancing and quarantine protocols led to significant decreases in crime in the first two weeks. There were declines during the state-of-emergency time period (March 9—March 21), but they were not statistically significant (S7 Table in S1 File). Total crimes declined in Chicago after the stay at home order was put in place, but the crime types contributing to this decline are mostly property-based and statutory rather than interpersonal (Fig 2, S7-S10 and S14 Figs in S1 File). Similar patterns hold for both Baltimore, Maryland and Baton Rouge, Louisiana. Both cities showed declines in crimes after the introduction of stay at home orders. As in Chicago, the crime types contributing to this decline are more often property-based or statutory rather than individuals (S11 and S12 Figs in S1 File). These patterns may have only been present in the initial time period following implementation and may not persist over longer time periods.

The observed patterns could be the result of several different mechanisms. First, there may be differences in policing and reporting under stay at home orders. For interpersonal crimes, victims who are quarantined with their abusers may be less likely to speak up. Social distancing may prevent law enforcement officers from responding to and reporting certain crime types. This pattern may also arise from individuals spending less time in public spaces and therefore participating in social interactions. The exact reasons contributing to this change in crime dynamics are difficult to determine, but it is clear that in the immediate time period following implementation of stay at home orders, there was a significant change in crime in Chicago, Baltimore, and Baton Rouge.

This study has a number of limitations. There is differential data availability across the three cities. Chicago has far more crime types publicly accessible for analysis, and there is no consensus on how the data are collected and reported nationally. We have also only analyzed the data for three cities. This pattern therefore may not exist across all regions, especially if adherence to stay at home orders differs between cities. The use of t-tests also limits the information we can obtain from these data. Finally, we have only observed the two weeks following the implementation of stay at home orders. The declines in crime may be limited to this time period and not subsist. With this analysis, we cannot pinpoint exactly when the decline began and when crime returned to previously expected levels. Recent reports show that violent crime has increased as cities are reopening [6].

These limitations leave open questions for future research. First, there is a need to explore the data presented here more in depth using various statistical tests, expanding the temporal window, or exploring confounding variables in all three cities. Additionally, analysis of patterns of crime data from additional cities is necessary to verify that the observed changes are national in scope. There is also a need to determine some of the mechanisms which have produced these declines and how adherence to stay at home orders impacts the crimes which occur. Overall, stay at home orders produced declines in crime over the initial time period and the crimes contributing to this decline were mainly property-based. The COVID-19 pandemic responses present a forced social experiment impacting many behavioral components and providing opportunities for novel explorations of the connection between behavioral constraints and crime. Given our results, the vigorous public policy debates regarding the impacts of potential interventions on violent crime, particularly gun crime, could benefit from further detailed analysis of imposed regulations arising from the pandemic.

Supporting information

S1 File. Complete supplementary text, figures, and tables.

https://doi.org/10.1371/journal.pone.0249414.s001

(PDF)

Acknowledgments

The authors acknowledge the participants of the NIMBioS Investigative Workshop on the Mathematics of Gun Violence and two anonymous reviewers who provided feedback on a previous version of this manuscript.

References

  1. 1. Centers for Disease Control and Prevention, “Web-based injury statistics query and reporting system (WISQARS)” (2017, https://www.cdc.gov/injury/wisqars/index.html).
  2. 2. Riley C., Roy B., Harari N., Vashi A., Violano P., Greene A., et al. Preparing for disaster: a cross-sectional study of social connection and gun violence. J. Urban Health. 94, 619–628 (2017). pmid:28116587
  3. 3. Justia, “Types of criminal offenses” (2018, https://www.justia.com/criminal/offenses/).
  4. 4. Lewnard J., Lo N., Scientific and ethical basis for social-distancing interventions against COVID-19 Lancet Infect Dis. 20 631–633 (2020). pmid:32213329
  5. 5. Unacast, “Social Distancing Scoreboard” (https://www.unacast.com/covid19/social-distancing-scoreboard).
  6. 6. Abt T., Rosenfeld R., Lopez E., “COVID-19 and homicide: final report to Arnold Ventures” (Arnold Ventures, 2020).
  7. 7. Ashby M.P.J., Initial evidence on the relationship between the coronavirus pandemic and crime in the United States Crime Science. 9 6 (2020). pmid:32455094
  8. 8. Boman J.H. and Gallupe O., Has COVID-19 changed crime? Crimes rates in the United States during the pandemic American Journal of Criminal Justice. 45 537–545 (2020). pmid:32837168
  9. 9. Fenton J., “Baltimore gun violence is down and police are closing more cases, but outbursts still occur” (Baltimore Sun, 2020, https://www.baltimoresun.com/news/crime/bs-md-ci-cr-baltimore-homicides-summer-20200522-r7otukatfbanxkhvxu3h3ry22m-story.html)
  10. 10. Hunter M., “Arrests are down in the New Orleans area, but has crime decreased amid coronavirus?” (Nola.com, 2020, https://www.nola.com/news/crime_police/article_fbce9da2-7084-11ea-8988-8f5b9b29688e.html.)
  11. 11. MacFarquhar N., Chiarito R., “Chicago gun violence spikes and increasingly finds the youngest victims” (The New York Times, 2020, https://www.nytimes.com/2020/07/05/us/chicago-shootings.html).
  12. 12. Smith P., “For those touched by Chicago’s violence, shootings aren’t always senseless” (WBEZ Chicago, 2020, https://www.wbez.org/stories/for-those-touched-by-chicagos-violence-shootings-arent-always-senseless/388d4c20-d7e2-4aed-9572-8e06f0867f76).
  13. 13. Stickle B. and Felson M., Crime rates in a pandemic: the largest criminological experiment in history. American Journal of Criminal Justice. 45 525–536 (2020).
  14. 14. Sweeney A., Mahr J., Gorner J., “COVID-19 hitting hardest in Chicago ZIP codes already struggling with gun violence” (Telegraph Herald, 2020, https://www.telegraphherald.com/coronavirus/article_abfd00dc-9b5b-11ea-bbf5-f38b6a89d876.html.)
  15. 15. Yin A., “12 Shot in Chicago, the city’s most violent day since stay-at-home order issued” (Chicago Tribune, 2020, https://www.chicagotribune.com/news/breaking/ct-chicago-shootings-little-village-20200326-fo7duxet3zcodg6ettf5a7c4yi-story.html.)
  16. 16. Van Den Bos J., Creten N., Davenport S., Roberts M., Cost of community violence to hospitals and health systems. American Hospital Association. (2017).
  17. 17. Open Data B.R., “Baton Rouge crime incidents” (2020, https://data.brla.gov/Public-Safety/Baton-Rouge-Crime-Incidents/fabb-cnnu.)
  18. 18. Open Baltimore, “B.P.D. part 1 victim based crime data” (2020, https://data.baltimorecity.gov/Public-Safety/BPD-Part-1-Victim-Based-Crime-Data/wsfq-mvij)
  19. 19. Chicago Police Department Citizen Law Enforcement Analysis & Reporting (CLEAR) System, “Crimes—2001 to present” (2020, https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-Present/ijzp-q8t2).
  20. 20. U.S. Census, “QuickFacts” (2019, https://www.census.gov/programs-surveys/sis/resources/data-tools/quickfacts.html)
  21. 21. Kim T.K., T test as a parametric statistic Korean J. Anesthesiol. 68 540–546 (2015).
  22. 22. VanderWeele T.J., Mathur M.B., Some desirable properties of the Bonferroni correction: is the Bonferroni correction really so bad? Am. J. Epidemiol. 188 617–618 (2019). pmid:30452538
  23. 23. Hansun S., A new approach of moving average method in time series analysis 2013 Conference on New Media Studies (CoNMedia). 1-4 (2013).