Figures
Abstract
Background
Recently, several randomized controlled trials (RCTs) have evaluated the effect of N95 respirators compared with medical masks to protect against acute respiratory infections. However, these studies are limited by modest sample sizes and inconclusive results. Therefore, the goal of the present study was to review the relevant and available published RCTs with the aid of the increased power of meta-analytic methods in order to assess the effectiveness of medical masks and N95 respirators in reducing the risk of respiratory infections.
Methods
This meta-analysis follows the recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement for conducting and reporting results. We searched PubMed, Web of Science, Embase, and Cochrane databases from inception through April 1, 2020 to identify potentially relevant studies. Two authors (LS and JS) independently searched the titles and abstracts of the potentially eligible articles. They independently retrieved required data from the eligible trials; the data were initially tabulated for statistical analysis. Two authors (JRL and LS) independently assessed the methodological quality of the included RCTs using the Cochrane Collaboration’s tool for assessing risk of bias.
Results
Six articles met the inclusion criteria. The pooled analysis showed that N95 respirators did not reduce the risk of infection with respiratory viruses compared with medical/surgical masks (5.7% vs. 7.9%; RR = 1.12; 95% CI: 0.88–1.41; p = 0.36); however, there was no statistically significant difference in laboratory-confirmed influenza between N95 and medical masks (RR = 0.91; 95% CI: 0.77–1.07; p = 0.26). Medical masks provided similar protection against other viruses, including coronavirus (RR = 0.74; 95% CI: 0.32–1.73; p = 0.49). Respiratory illness, as well as influenza-like illness were less frequently observed with N95 respirators.
Conclusions
Our meta-analysis suggests that there are insufficient data to definitively determine whether N95 respirators are superior to medical masks in protection against transmissible acute respiratory infections. Further randomized trials are necessary to compare the above methods of respiratory protection in the context of COVID-19 incidence.
Citation: Barycka K, Szarpak L, Filipiak KJ, Jaguszewski M, Smereka J, Ladny JR, et al. (2020) Comparative effectiveness of N95 respirators and surgical/face masks in preventing airborne infections in the era of SARS-CoV2 pandemic: A meta-analysis of randomized trials. PLoS ONE 15(12): e0242901. https://doi.org/10.1371/journal.pone.0242901
Editor: Charles S. Wiysonge, South African Medical Research Council, SOUTH AFRICA
Received: April 20, 2020; Accepted: November 11, 2020; Published: December 15, 2020
Copyright: © 2020 Barycka et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data are used in manuscript.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Background
The COVID-19 pandemic has now affected most countries in the world. The SARS-CoV-2 infection is droplet-transmitted and poses a serious threat to public health globally because of the high number of infections, including a high incidence of severe respiratory failure. In many regions, acute respiratory distress syndrome is leading to depletion of resources and capacities of the healthcare systems [1]. Clinically, the COVID-19 pandemic presents with coughing, dyspnea, fever, headache, sore throat, and loss of smell. However, serious complications of COVID-19 can occur after disease progression, the most common major complication is Acute Respiratory Distress Syndrome or also known as ARDS. This clinical feature is one of the reasons the COVID-19 pandemic became infamous for its requirement of mechanical ventilation. However, further systemic complications such as cardiac arrhythmia as well as other immunologic and thromboembolic events. It is thus essential to use appropriate protection, including personal protective equipment (PPE), of which a suitable respirator, such as those rated N95, is a crucial component [2]. No specific treatment is yet available for COVID-19, although work is underway on the use of previously known drugs such as chloroquine and its derivatives or antivirals. Currently many centers are working on the development of a vaccine but at the moment, prevention and isolation are of primary importance.
Recently, several randomized controlled trials (RCTs) have evaluated the effect of N95 respirators compared with medical masks to protect against acute respiratory infections. An N95 respirator or N95 mask is a mechanical filter respirator that is designed to meet the NIOSH N95 classification of air filtration, filtering at least 95% of airborne particles with a penetrating aerosol size of 0.3 μm. They have to adhere strictly to 42 CFR Part 84 regulations in order to be able to be considered an official N95. In contrast, medical masks also known as surgical masks are designed to be more fluid resistance and to protect the wearer against fluid penetration. However, surgical masks are not designed to be and are prohibited from being labelled as antimicrobial or antiviral protection or particulate filtration. Surgical masks instead have to adhere to a different standard, ASTM F1862, which regulates the fluid impact amount, velocity, and viscosity. During the COVID-19 pandemic, the demand for both of these kinds of masks increased exponentially, resulting in shortages across all hospital systems. The global spread of the epidemic combined with the massive scale served to deplete existing stockpiles as well as greatly hinder the production of new respirators. During the epidemic, drastic steps were taken to order new respirators as well as even attempt to sterilize previously used respirators in order to increase the effective size of the existing stockpiles.
However, these studies are limited by modest sample sizes and inconclusive results [3–8]. Therefore, the goal of the present study is to review the relevant and available published RCTs with the aid of the increased power of meta-analytic methods in order to test the hypothesis that, compared with medical masks N95 respirators would reduce the risk of respiratory infections.
Methods
This meta-analysis follows the recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement for conducting and reporting results [9]. The protocol of this meta-analysis has not been registered.
Eligibility criteria
The meta-analysis included published RCTs comparing medical/surgical masks (MSMs) with N95 respirators to protect against acute respiratory infections. Case-control studies, non-randomized studies, trials conducted on simulated models, editorials, reviews, guidelines, and theoretical models were excluded from the review.
Information sources and search strategy
We searched PubMed, Web of Science, Embase, and Cochrane databases from inception through to April 1, 2020 in order to identify potentially relevant studies. The search terms included: “influenza” OR “coronavirus” OR “virus” OR “COVID-19” OR “SARS-CoV-2” OR “SARS-CoV” OR “SARS” OR “MERS” OR “acute respiratory tract infection” OR “acute respiratory infection” AND “masks” OR “respiratory protective device” OR “personal protect” OR “personal protective equipment” OR “medical mask” OR “surgical mask” OR “facemask” OR “N95” OR “respirators”. The search was performed with no language restriction. Reference lists of relative articles were also reviewed.
Study selection
Two authors (LS and JS) independently searched the titles and abstracts of the potentially eligible articles. Furthermore, full texts of the possible articles were retrieved and assessed for eligibility. Any disputes between the two authors were solved by discussion and consultation with a third author (JRL).
Data collection process
Two authors (LS and JS) independently retrieved the required data from the eligible trials; the data was initially tabulated in a Microsoft ExcelTM (Microsoft Corp., Redmond, WA, USA) data set. Another author (KJF) cross-checked the data before analysis.
Data items
The following data was retrieved from the full texts of all studies: first author, year of publication, sample size, characteristics of participants, type of mask, laboratory-confirmed infection with any respiratory virus, laboratory-confirmed bacterial colonization, laboratory-confirmed influenza (including influenza A and B) as well as other respiratory viruses, respiratory illness, influenza-like illness, and work absence.
Risk of bias in the included studies
Two authors (JRL and LS) independently assessed the methodological quality of the included RCTs using the Cochrane Collaboration’s tool for assessing risk of bias [10]. The following domains were assessed: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome measurement, incomplete outcome data, and selective reporting. For each domain of bias, the trials were classified as representing low, unclear, or high risk of bias.
Statistical analysis
Statistical heterogeneity was assessed with the I2 methodology. Values of I2 > 50% and > 75% were considered to indicate moderate and significant heterogeneity among studies, respectively [11]. Because of possible clinical heterogeneity due to study design and participant population, we used a fixed effect model for all pooled analyses. The pooled effect estimates for binary variables were expressed as relative risk (RR). All statistical variables were calculated with 95% confidence interval (CI). All p-values were two-tailed and considered statistically significant if p < 0.05. Publication bias was evaluated by visually inspecting the funnel plots. All statistical analyses were performed with the Review Manager software, version 5.3 (RevMan, Cochrane Collaboration, Oxford, UK).
Results
Trial identification and characteristics
The literature search yielded 831 records, and six multi-center RCTs fulfilling inclusion criteria were eligible for final analysis [3–8]. The overview of the study selection process is presented in Fig 1. The Cochrane risk of bias score varied across the trials (S1 and S2 Figs). The main characteristics of the included studies are shown in Table 1. Three of them were conducted in China [5–7], one in Canada [3], one in Australia [4], and one in the USA [8].
A total of 8406 participants were included in the final analysis: 4355 in the N95 respirator group and 4051 in the MSM group.
Laboratory-confirmed influenza
Five RCTs reported laboratory-confirmed influenza [4–6, 8]. The pooled analysis showed that there was no statistically significant difference in laboratory-confirmed influenza between N95 and MSM (6.1 vs. 6.2%; RR = 0.91; 95% CI: 0.77–1.07; p = 0.26) (Fig 2A).
Forest plot of: (2A) laboratory confirmed influenza in medical masks vs. N95 groups; (2B) laboratory confirmed influenza A; (2C) laboratory confirmed influenza B. The center of each square represents the weighted mean difference for individual trials, and the corresponding horizontal line stands for 95% confidence interval. The diamonds represent pooled results.
Additional analysis revealed that there were also no statistically significant differences between N95 and MSM in laboratory-confirmed influenza A risk (6.5 vs. 5.4%; RR = 0.82; 95% CI: 0.67–1.01; p = 0.07; Fig 2B) or in that of laboratory-confirmed influenza B (1.7 vs. 1.7%; RR = 1.02; 95% CI: 0.69–1.51; p = 0.90; Fig 2C).
Laboratory-confirmed other respiratory viruses
Two RCTs presented data regarding laboratory-confirmed virus infection other than influenza [3, 4]. The prevalence of laboratory-confirmed other respiratory viruses in the N95 and MSM groups was varied and amounted to 1.9 and 1.6%, respectively (RR = 0.85; 95% CI: 0.53–1.37; p = 0.49). The sub-analyses did not show statistically significant differences in laboratory-confirmed respiratory viruses other than influenza between N95 and MSM (Table 2).
Laboratory-confirmed infection with any respiratory virus
Laboratory-confirmed infection with any virus was reported in four RCTs [4–6]. The pooled analysis showed that N95 respirators did not reduce the risk of infection with respiratory viruses compared with MSM (5.7% vs. 7.9%; RR = 1.12; 95% CI: 0.88–1.41; p = 0.36), despite non-significant heterogeneity among the studies (I2 = 26%) (Fig 3).
The center of each square represents the relative risk for individual trials, and the corresponding horizontal line stands for 95% confidence interval. The diamonds represent pooled results.
Laboratory-confirmed bacterial colonization
Two trials reported laboratory-confirmed bacterial colonization [6, 7], with lower risk of laboratory-confirmed bacterial colonization while using N95 compared with MSM (5.6% vs. 13.7%; RR = 2.04; 95% CI: 1.58–2.64; p < 0.001) (S3 Fig).
Secondary outcomes
Four RCTs reported respiratory illness as an outcome [4, 5, 8], with lower risk of respiratory illness in the N95 group compared with the MSM group (38.6 vs. 47.4%; RR = 1.04; 95% CI: 1.04–1.13; p < 0.001) (Fig 4A).
Forest plot of secondary outcomes in medical masks vs. N95 groups: (4A) respiratory-like illness; (4B) influenza-like illness. The center of each square represents the weighted mean difference for individual trials, and the corresponding horizontal line stands for 95% confidence interval. The diamonds represent pooled results.
Influenza-like illness was observed in five RCTs [3–6, 8]. The pooled analysis showed a statistically significant difference in the risk of influenza-like illness occurrence between the N95 and MSM groups (3.5 vs. 5.0%; RR = 1.06; 95% CI: 1.03–1.55; p = 0.03; Fig 4B).
Discussion
In this meta-analysis, we compared the use of N95 respirators with MSMs to protect against acute respiratory infections.
The rapid emergence of severe acute respiratory syndrome (SARS) due to the novel coronavirus SARS-CoV-2 (COVID-19) in December 2019 took the world by surprise. Mechanisms of transmission are believed to include contact, droplet, and possibly airborne based off of historical experiences related to SARS-CoV outbreaks [12–15]. Globally, until November 7, 2020, there have been 35,858,601 confirmed cases and 1,050,771 deaths reported in the COVID-19 pandemic [15]. As indicated by Wang et al. [16], infection prevention and control are of great importance in healthcare settings, especially with regard to personal protection of healthcare workers. Super-spreading events of SARS-CoV-2 have occurred in healthcare settings around the world. Transmission to healthcare workers within healthcare facilities has been documented with first deaths reported of physicians who acquired the disease while caring for infected patients [17]. Personal protective equipment necessary for contact with patients that are confirmed or suspected to have COVID-19 include a fluid-resistant gown, gloves, eye protection, a full-face shield, and a fit-tested N95 respirator [1, 18]. Vertical tape strips can be used to help keep gloves secured to the gown. These precautions are particularly important to emergency medicine personnel as they do not know the patients’ medical history at first contact and have no way of knowing about COVID-19 status especially with the possibility of asymptomatic transmission. Therefore, full personal protective equipment must be used when in contact with any patient.
Currently, the recommendations of the usage of masks can be contradictory as for example, the Centers for Disease Control and Prevention (CDC) recommend mask usage in both high and low risk patients; the World Health Organization recommends the usage of masks in low risk cases and respirators in high risk ones. In the current situation of a pandemic, it can be necessary for medical personal to wear N95 respirators or other masks for extended periods of time while caring for infected patients [19].
One important concern for healthcare workers is that N95 respirators need proper fit-testing to assure good seal as this is the only way to secure ambient air flow only through the filter [20]. It can occur also that multiple donning and doffing of the N95 respirators can result in test failure due to the stresses placed on the seal as the device is being removed and replaced on the face [21]. In addition, there are other concerns to the appropriate fit of the N95 respirators such as male facial hair, for example only 32% of male healthcare workers achieved adequate fit of the filtering facepiece respirator [22]. Any leakage due to an improperly installed N95 respirator potentially leads to partial breathing of ambient air without any filtration. All the analyzed studies indicated the discomfort associated with the use of N95 respirators. Many of the studies raised the issue of compliance with the recommendation to use N95 respirators or MSMs. The latter cause less discomfort, which may increase the exposure of medical personnel who put on N95 respirators without providing adequate sealing or do not use them at all recommended times [23, 24]. This factor may affect the steady effectiveness of N95 respirators in preventing acute respiratory infections. In fact, healthcare workers were able to get infected during resuscitation of patients with SARS despite wearing N95 masks [23].
Limitations
This study has a few potential limitations. First, all RCTs included in this meta-analysis involved at least a moderate risk of bias; specifically in that the type of facemask could not be blinded to the participants in the studies. Secondly, the number of RCTs fulfilling the inclusion criteria was small. Another limitation is the fact that the results are not generalizable to infections transmitted primarily through airborne routes.
Conclusions
Our meta-analysis suggests that there is insufficient data to definitively determine whether N95 respirators are superior to MSMs in protection against transmissible acute respiratory infections. However, we suggest N95 respirators as a more appropriate respiratory protection method than medical masks for medical personnel. Further randomized trials are necessary to compare the above methods of respiratory protection in the context of COVID-19 incidence.
Supporting information
S1 Fig. Evaluation of bias in all included studies across the various domains.
Green, red, and yellow circles indicate low, high, and unclear risk of bias, respectively.
https://doi.org/10.1371/journal.pone.0242901.s002
(TIF)
S2 Fig. Summary of the risk of bias among the included studies.
https://doi.org/10.1371/journal.pone.0242901.s003
(TIF)
S3 Fig. Forest plot of laboratory-confirmed bacterial colonization in medical masks vs. N95 groups.
The center of each square represents the relative risk for individual trials, and the corresponding horizontal line stands for 95% confidence interval. The diamonds represent pooled results.
https://doi.org/10.1371/journal.pone.0242901.s004
(TIF)
S4 Fig. Forest plot of work absence in medical masks vs. N95 groups.
The center of each square represents the relative risk for individual trials, and the corresponding horizontal line stands for 95% confidence interval. The diamonds represent pooled results.
https://doi.org/10.1371/journal.pone.0242901.s005
(TIF)
References
- 1. Ruetzler K, et al. The COVID-19 pandemic—a view of the current state of the problem. Disaster Emerg Med J 2020; 5(2)106–7.
- 2. Smereka J, et al. COVID 19 a challenge for emergency medicine and every health care professional. Am J Emerg Med. 2020 Mar 24. pii: S0735-6757(20)30180-7. pmid:32241630
- 3. Loeb M, et al. Surgical mask vs N95 respirator for preventing influenza among health care workers: a randomized trial. JAMA 2009;302(17):1865–71. pmid:19797474
- 4. MacIntyre CR, et al. Face mask use and control of respiratory virus transmission in households. Emerg Infect Dis 2009;15(2):233–41. pmid:19193267
- 5. MacIntyre CR, et al. A cluster randomized clinical trial comparing fit-tested and non-fit-tested N95 respirators to medical masks to prevent respiratory virus infection in health care workers. Influenza Other Respir Viruses 2011;5(3):170–9. pmid:21477136
- 6. MacIntyre CR, et al. A randomized clinical trial of three options for N95 respirators and medical masks in health workers. Am J Respir Crit Care Med 2013;187(9):960–6. pmid:23413265
- 7. MacIntyre CR, et al. Efficacy of face masks and respirators in preventing upper respiratory tract bacterial colonization and co-infection in hospital healthcare workers. Prev Med 2014;62:1–7. pmid:24472436
- 8. Radonovich LJ Jr, et al. N95 respirators vs medical masks for preventing influenza among health care personnel: a randomized clinical trial. JAMA 2019;322(9):824–33. pmid:31479137
- 9. Shamseer L, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;350:g7647. pmid:25555855
- 10. Higgins JP, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Br Med J 2011;343:d5928. pmid:22008217
- 11. Hozo S, et al. Estimating the mean and variance from the median, range, and the size of a sample. BMC Med Res Methodol 2005;5:13. pmid:15840177
- 12. Christian MD, et al. Possible SARS coronavirus transmission during cardiopulmonary resuscitation. Emerg Infect Dis. 2004 Feb;10(2):287–93. pmid:15030699
- 13. Zhang L, et al. Potential interventions for novel coronavirus in China: A systematic review. J Med Virol. 2020; 92(5):479–490. pmid:32052466
- 14. Stower H. Spread of SARS-CoV-2. Nat Med. 2020 Apr 9. pmid:32273606
- 15.
Coronavirus COVID-19 global cases by Johns Hopkins CSSE. 2020 (Available at:) https://gisanddata.maps.arcgis.com/apps/opsdashboard/index.html#/bda7594740fd40299423467b48e9ecf6 (last accessed November 2020).
- 16. Wang J, et al. Reasons for healthcare workers becoming infected with novel coronavirus disease 2019 (COVID-19) in China. J Hosp Infect 2020;S0195-6701(20)30101-8. pmid:32147406
- 17. Szarpak L, et al. Cloth masks versus medical masks for COVID-19 protection. Cardiol J 2020; pmid:32285928
- 18. Carenzo L, et al. Hospital surge capacity in a tertiary emergency referral centre during the COVID-19 outbreak in Italy. Anaesthesia. 2020 Apr 4.
- 19. Zhou SS, et al. Assessment of a respiratory face mask for capturing air pollutants and pathogens including human influenza and rhinoviruses. J Thorac Dis 2018;10(3):2059–69. pmid:29707364
- 20. Kim H, et al. Comparison of fit factors among healthcare providers working in the Emergency Department Center before and after training with three types of N95 and higher filter respirators. Medicine 2019;98(6):e14250. pmid:30732139
- 21. Vuma CD, Manganyi J, Wilson K, et al. The effect on fit of multiple consecutive donning and doffing of N95 filtering facepiece respirators. Ann Work Expo Health 2019;63(8):930–6. pmid:31504129
- 22. Sandaradura I, Goeman E, Pontivivo G, et al. A close shave? Performance of P2/N95 respirators in healthcare workers with facial hair: results of the BEARDS (BEnchmarking Adequate Respiratory DefenceS) study. J Hosp Infect 2020;S0195-6701(20)30008-6. pmid:31978416
- 23. Suen LKP, Guo YP, Ho SSK, et al. Comparing mask fit and usability of traditional and nanofibre N95 filtering facepiece respirators before and after nursing procedures. J Hosp Infect 2020;104(3):336–43. pmid:31545991
- 24. Radonovich LJ Jr, Bessesen MT, Cummings DA, et al. The respiratory protection effectiveness clinical trial (ResPECT): a cluster-randomized comparison of respirator and medical mask effectiveness against respiratory infections in healthcare personnel. BMC Infect Dis 2016;16:243. pmid:27255755