Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A multistate assessment of population normalization factors for wastewater-based epidemiology of COVID-19

  • Andrew L. Rainey ,

    Contributed equally to this work with: Andrew L. Rainey, Song Liang, Joseph H. Bisesi Jr., Tara Sabo-Attwood, Anthony T. Maurelli

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Resources, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Environmental and Global Health, College of Public Health and Health Professions, University of Florida, Gainesville, Florida, United States of America, Emerging Pathogens Institute, University of Florida, Gainesville, Florida, United States of America

  • Song Liang ,

    Contributed equally to this work with: Andrew L. Rainey, Song Liang, Joseph H. Bisesi Jr., Tara Sabo-Attwood, Anthony T. Maurelli

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Environmental and Global Health, College of Public Health and Health Professions, University of Florida, Gainesville, Florida, United States of America, Emerging Pathogens Institute, University of Florida, Gainesville, Florida, United States of America

  • Joseph H. Bisesi Jr. ,

    Contributed equally to this work with: Andrew L. Rainey, Song Liang, Joseph H. Bisesi Jr., Tara Sabo-Attwood, Anthony T. Maurelli

    Roles Conceptualization, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Department of Environmental and Global Health, College of Public Health and Health Professions, University of Florida, Gainesville, Florida, United States of America, Emerging Pathogens Institute, University of Florida, Gainesville, Florida, United States of America, Center for Environmental and Human Toxicology, University of Florida, Gainesville, Florida, United States of America

  • Tara Sabo-Attwood ,

    Contributed equally to this work with: Andrew L. Rainey, Song Liang, Joseph H. Bisesi Jr., Tara Sabo-Attwood, Anthony T. Maurelli

    Roles Writing – original draft, Writing – review & editing

    Affiliations Department of Environmental and Global Health, College of Public Health and Health Professions, University of Florida, Gainesville, Florida, United States of America, Emerging Pathogens Institute, University of Florida, Gainesville, Florida, United States of America, Center for Environmental and Human Toxicology, University of Florida, Gainesville, Florida, United States of America

  • Anthony T. Maurelli

    Contributed equally to this work with: Andrew L. Rainey, Song Liang, Joseph H. Bisesi Jr., Tara Sabo-Attwood, Anthony T. Maurelli

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    amaurelli@phhp.ufl.edu

    Affiliations Department of Environmental and Global Health, College of Public Health and Health Professions, University of Florida, Gainesville, Florida, United States of America, Emerging Pathogens Institute, University of Florida, Gainesville, Florida, United States of America

Abstract

Wastewater-based epidemiology (WBE) has become a valuable tool for monitoring SARS-CoV-2 infection trends throughout the COVID-19 pandemic. Population biomarkers that measure the relative human fecal contribution to normalize SARS-CoV-2 wastewater concentrations are needed for improved analysis and interpretation of community infection trends. The Centers for Disease Control and Prevention National Wastewater Surveillance System (CDC NWSS) recommends using the wastewater flow rate or human fecal indicators as population normalization factors. However, there is no consensus on which normalization factor performs best. In this study, we provided the first multistate assessment of the effects of flow rate and human fecal indicators (crAssphage, F+ Coliphage, and PMMoV) on the correlation of SARS-CoV-2 wastewater concentrations and COVID-19 cases using the CDC NWSS dataset of 182 communities across six U.S. states. Flow normalized SARS-CoV-2 wastewater concentrations produced the strongest correlation with COVID-19 cases. The correlation from the three human fecal indicators were significantly lower than flow rate. Additionally, using reverse transcription droplet digital polymerase chain reaction (RT-ddPCR) significantly improved correlation values over samples that were analyzed with real-time reverse transcription quantitative polymerase chain reaction (rRT-qPCR). Our assessment shows that utilizing flow normalization with RT-ddPCR generate the strongest correlation between SARS-CoV-2 wastewater concentrations and COVID-19 cases.

Introduction

The Coronavirus disease 2019 (COVID-19) pandemic has challenged public health officials conducting geographically widespread and comprehensive disease surveillance throughout communities. There was an urgent need to develop new strategies to generate real-time data to monitor trends in infections, identify potential outbreaks, and detect the emergence of new severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) variants [1,2]. Early in the pandemic, wastewater-based epidemiology (WBE) emerged as a rapid, cost-effective approach that overcomes limitations of traditional disease monitoring methods (e.g., their dependence on individual health seeking behaviors) to generate much-needed surveillance data [36]. WBE was a viable option because, though SARS-CoV-2 is a respiratory pathogen, the virus also replicates in the human intestine and is shed in the feces of an infected individual, irrespective of their symptomatic status [79]. In September 2020, the Centers for Disease Control and Prevention (CDC) developed the National Wastewater Surveillance System (NWSS) to support and coordinate SARS-CoV-2 wastewater surveillance programs across the United States (U.S.) [6]. WBE of SARS-CoV-2 has been extremely successful in monitoring infection trends among a broad range of communities across the globe [1015]. Measurement of SARS-CoV-2 concentrations in wastewater to monitor trends in infections is a key analytical approach of SARS-CoV-2 WBE. The data generated by SARS-CoV-2 WBE issued to inform key stakeholders making decisions such as utilization of mobile test clinics, allocation of clinical testing resources, or changing social distancing and mask wearing requirements in public spaces [6]. However, using raw SARS-CoV-2 wastewater concentrations to monitor infection trends does not account for the relative human contribution to a wastewater sample that is collected for analysis. This is important because a wastewater sample collected for analysis may not have fecal input from the entire human population within a community, or it may have additional non-human fecal contributions from animals that live in the surrounding environment. Adjusting SARS-CoV-2 wastewater concentrations to account for the relative human contribution may improve the data for analysis and interpretation.

Normalization of wastewater concentrations with a population biomarker has been long studied, however, there is no consensus on a single normalization factor that is best for WBE of SARS-CoV-2. Population normalization factors can be endogenous or exogenous physical, chemical, or biological biomarkers that are analyzed and quantified from a wastewater sample [1619]. Examples of previously used population normalization factors used for SARS-CoV-2 WBE are wastewater flow rate, human fecal indicator organisms, electrical conductivity, ammonium, caffeine, paraxanthine, creatinine, and 5-hydroxyindoleacetic acid [2025]. Currently, CDC NWSS recommends wastewater flow rate and human fecal indicator organisms for normalizing SARS-CoV-2 wastewater concentrations for disease trend analysis [26]. Human fecal indicators are bacteria and viruses that are shed exclusively in human feces and are measured to quantify the relative human population that are represented within a wastewater sample. Human fecal indicators used in SARS-CoV-2 WBE include Pepper Mild Mottle virus (PMMoV), crAssphage, Bacteroides HF183, or F+ Coliphage [22,23,27,28]. Previously, human fecal indicators have been shown to display mixed associations (yes and no association) with estimated serviced populations from wastewater catchment areas [22,29,30]. Studies that measured the ability of human fecal indicators to improve SARS-CoV-2 WBE analysis are also inconclusive, as they show positive or no positive effect on the correlation between SARS-CoV-2 wastewater concentrations and COVID-19 clinical cases [23,27,29].

The objective of this study is to assess the CDC NWSS recommended population normalization factors to determine which is best for monitoring COVID-19 trends within a community. We analyzed a large, multi-state CDC NWSS dataset to identify which population normalization factor provides the strongest correlation between SARS-CoV-2 wastewater concentrations and reported COVID-19 cases. This study has provided empirical evidence that the optimal analytical approach for SARS-CoV-2 WBE is to use the wastewater flow rate as a population normalization factor. We recommend that wastewater flow also be considered for population normalization in wastewater surveillance of other infectious diseases.

Methods

Data source and study sites

We obtained data which includes 18 months of data from six study sites, i.e., U.S. states that contributed SARS-CoV-2 wastewater data to CDC NWSS to help track and monitor COVID-19 in communities across the country [31]. The study sites include the following U.S. states: California (CA), Colorado (CO), North Carolina (NC), Ohio (OH), Virginia (VA), and Wisconsin (WI). Each study site provided wastewater data collected from multiple different sewersheds, which are defined as a geographic area that contributes wastewater to a specified point in the wastewater collection system (e.g., to a treatment plant or other sample collection location). The estimated service population of the individual sewershed was provided to CDC NWSS from each study site. Most sewersheds service an entire city, while some sewersheds service a smaller portion of a single city. Influent wastewater collected from each sewershed was used for sample analysis and data reporting to NWSS. These six study sites were included for our analysis based on availability of the following data variables: SARS-CoV-2 raw wastewater measurements, influent wastewater flow rate, fecal indicator raw wastewater measurements, and sewershed-level COVID-19 clinical cases. In total, 9,705 wastewater samples were analyzed across 182 sewersheds in the six study sites from May 27, 2020—October 4, 2021. Descriptive statistics of the study sites are summarized in Table 1.

thumbnail
Table 1. Descriptive statistics of the CDC NWSS study sites included for analysis.

https://doi.org/10.1371/journal.pone.0284370.t001

COVID-19 clinical cases

The daily confirmed COVID-19 cases at the sewershed level were reported to CDC NWSS by each reporting study site. A COVID-19 clinical case is defined by the previously described CDC COVID-19 case definition [32]. The COVID-19 case definition includes criteria that must be met to classify an individual as a suspected, probable, or confirmed COVID-19 case. COVID-19 clinical case data in this analysis only include probable and confirmed cases as classified by CDC [32]. The COVID-19 clinical cases corresponded to each individual wastewater sampling date for a given sewershed. To protect individual privacy, the daily number of COVID-19 cases for a given sewershed were suppressed if the total number of cases was greater than zero but less than five. For our analysis, we assigned a value of two COVID-19 cases to any observation that was suppressed.

Wastewater processing methods

Each lab that processed wastewater samples included the concentration and extraction procedures used to process the wastewater samples for molecular analysis. The specific concentration and extraction methods used by each study site are found in S1 Table. In general, concentration methods included ultracentrifugation, ultrafiltration, or electronegative membrane filtration. Extraction of nucleic acid was carried out using either column- and magnetic bead-based extraction kits, and also the 4S method was used by one processing lab [33]. Each study site used a SARS-CoV-2 surrogate as a process control for each wastewater sample that ensured there was no error in wastewater concentration, nucleic acid extraction, or nucleic acid amplification. Surrogates used as process controls included Human Coronavirus OC-43, Bovine Coronavirus, Murine Coronavirus, and Hepatitis G.

We included SARS-CoV-2 wastewater measurements of the CDC N1 and/or CDC N2 genetic targets [34]. Virginia included SARS-CoV-2 wastewater measurements using the ddCoV_N genetic target that is located on the same region as the CDC N2 genetic target, thus it was included as an N2 wastewater measurements for our analysis [35]. SARS-CoV-2 wastewater measurements were performed using either real-time reverse transcription quantitative polymerase chain reaction (rRT-qPCR) or reverse transcription droplet digital polymerase chain reaction (RT-ddPCR). California and Wisconsin used both molecular analysis methods, while the remaining study sites exclusively used RT-ddPCR. The molecular assay limit of detection was provided for each sample by the reporting laboratory. For our analysis, we assigned a value of half of the limit of detection for SARS-CoV-2 negative wastewater samples. All SARS-CoV-2 wastewater measurements were initially reported as the number of genomic copies per liter of wastewater (GC/L), which we converted to Log10GC/L for statistical analysis.

Population normalization factors

We normalized the wastewater concentrations using the fecal indicator wastewater concentration and/or the flow rate for each SARS-CoV-2 wastewater observation. PMMoV, crAssphage, and F+ coliphage were the fecal indicator organism targets used by the included study sites. PMMoV was analyzed across every study site, crAssphage was analyzed in a subsample of wastewater collected in Ohio, and F+ coliphage was analyzed in a subsample of wastewater collected in Colorado. The fecal indicator organism nucleic acid was concentrated extracted and analyzed using the same methods as used for SARS-CoV-2 nucleic acid (S1 Table). No limit of detection of the molecular assay for the fecal indicator organisms was provided, therefore, we did not assign numeric values to any negative/missing fecal indicator measurements. The fecal indicator wastewater concentration was reported as GC/L and we converted this value to Log10GC/L for statistical analysis. We performed fecal indicator normalization of the SARS-CoV-2 concentrations in wastewater by dividing the SARS-CoV-2 wastewater concentration (Log10GC/Day) over each fecal indicator wastewater concentration (Log10GC/Day) to obtain a unitless ratio of the two values, i.e., SARS-CoV-2 concentration to fecal indicator concentration. We also conducted fecal normalization with the flow normalized SARS-CoV-2 and fecal indicator wastewater concentrations (Log10GC/Day) to obtain the unitless flow and fecal normalized value.

The flow rate for each observation was reported by each sewershed for the specific day the raw influent wastewater sample was originally collected. The flow rate was reported as million gallons per day (MGD), and we converted this value to liters per day (L/Day) for our analysis. To flow normalize, we multiplied the initial SARS-CoV-2 wastewater measurement (GC/L) with the flow rate (L/Day) to obtain the final value of genomic copies per day (GC/Day), which we then converted to Log10GC/Day for statistical analysis. We also conducted fecal normalization (described above) with the flow normalized SARS-CoV-2 and fecal indicator wastewater concentrations (Log10GC/Day) to obtain the unitless flow and fecal normalized value.

Statistical analysis

We computed the descriptive statistics such as the mean, and ranges of the COVID-19 clinical cases and the measured wastewater concentrations of SARS-CoV-2 and the fecal indicators. The descriptive statistics of the COVID-19 clinical cases were computed using the total daily sum of the sewershed-level cases across all sewersheds within each study site.

We analyzed the correlation between the raw CDC N1 and CDC N2 wastewater concentration (Log10GC/L) of individual wastewater samples to determine the agreement of the quantified measurement of each genetic target. This analysis was then stratified by the different molecular analysis method used (rRT-qPCR and RT-ddPCR). This analysis was not conducted for observations from the state of Colorado because only the CDC N1 genetic target was used to analyze wastewater samples from this site. The correlation between the raw fecal indicator wastewater concentration (Log10GC/L) and the flow rate (L/Day) with the estimated population served by each sewershed was analyzed to determine if any normalization parameters were accurate population markers.

The next correlation analysis was performed between the SARS-CoV-2 wastewater concentrations with the corresponding sewershed-level COVID-19 clinical cases of each wastewater observation. The correlation analysis was conducted among the following four normalization categories: the raw SARS-CoV-2 wastewater concentration (Log10GC/L), the flow normalized SARS-CoV-2 wastewater concentration (Log10GC/Day), the raw fecal normalized value (for each individual fecal indicator), and the flow and fecal normalized value (for each individual fecal indicator). This test was performed for each study site, aggregating observations across all the sewersheds included within a study site, i.e., a U.S. state. This correlation analysis was stratified by the genetic targets (CDC N1 and CDC N2) of the molecular assay. The correlation analysis was also stratified by the molecular analysis method used, i.e., rRT-qPCR and RT-ddPCR. Multiple t-tests were performed using the range of the stratified correlation coefficients observed from the analysis of the 1) molecular analysis method used (rRT-qPCR and RT-ddPCR), 2) the SARS-CoV-2 genetic target (CDC N1 and N2) measured, and 3) across the normalization categories (raw, flow normalized, fecal normalized, flow and fecal normalized). All correlation analysis results were generated using the Spearman’s correlation coefficient. All statistical tests used a P-Value significance level of α = 0.05. All statistical analyses were conducted using RStudio version 2022.07.01 [36,37]. Figures were generated using the ggplot2 package in RStudio [38].

Results and discussion

COVID-19 clinical cases

The range and mean value of the daily sewershed-level COVID-19 clinical cases reported across the study sites are summarized in Table 2. Overall, daily sewershed-level COVID-19 clinical cases ranged from 2–5,805 cases, and the mean value from 24–209, with the highest mean value in California. The date with the highest number of reported COVID-19 cases (5,805 cases) was January 4, 2021, in California, in a community with an estimated 3.5 million individuals served by the corresponding sewershed. The timing of this high volume of cases could be representative of the surge of new COVID-19 cases associated with the highly contagious SARS-CoV-2 Omicron variant [39]. Overall, the COVID-19 pandemic had a significant burden of disease among our study sites throughout the study period.

thumbnail
Table 2. Descriptive statistics of the sewershed-level COVID-19 clinical cases, SARS-CoV-2 raw wastewater concentration (Log10GC/L), and fecal indicator raw wastewater concentration (Log10GC/L).

https://doi.org/10.1371/journal.pone.0284370.t002

SARS-CoV-2 wastewater concentrations

The raw SARS-CoV-2 wastewater concentration (Log10GC/L) for the CDC N1 and N2 genetic targets across the study sites are found in Table 2. Overall, the SARS-CoV-2 wastewater concentration ranged from 3.64–7.94 Log10GC/L (N1) and 3.91–7.14 Log10GC/L (N2). The lowest quantified SARS-CoV-2 wastewater concentration for the N1 genetic target was observed in Virginia (3.64 Log10GC/L) and the lowest N2 genetic target wastewater concentration was observed in North Carolina (3.91 Log10GC/L). The highest SARS-CoV-2 wastewater concentration for both, N1 (7.94 Log10GC/L) and N2 (7.14 Log10GC/L), was observed in California (Table 2).

It is both common and recommended to analyze wastewater nucleic acid extracts for more than one SARS-CoV-2 genetic target [11,40,41]. Many studies have investigated differences in the SARS-CoV-2 wastewater concentration measured by the CDC N1 and N2 genetic targets and have largely been inconclusive as to whether one target is more effective than the other [4245]. We analyzed the N1 and N2 wastewater concentrations across each study site to determine the level of agreement between quantified measurements for each genetic target from an individual wastewater observation. The Spearman correlation coefficients of the N1 and N2 genetic target measurements among each study site are found in Table 3. The strongest correlation was in the state of North Carolina (R = 0.93, P-Value<0.001) and the lowest was in Ohio (R = -0.06, P-Value = 0.23). However, it should be noted that in Ohio, <10% of all wastewater samples were analyzed for both N1 and N2. No correlation was computed for Colorado because wastewater samples were only measured using the N1 genetic target. Our results of the correlation of the N1 and N2 genetic target wastewater concentrations were high (Table 3), and consistent with data reported from other published studies across the globe [10,23,43,46].

thumbnail
Table 3. Spearman correlation coefficient analysis of the measured CDC N1 and CDC N2 wastewater concentration (Log10GC/L) of single wastewater samples across each sample site.

https://doi.org/10.1371/journal.pone.0284370.t003

Association of normalization factors with estimated population served

The first step to identifying the optimal population normalization factor is to identify which wastewater biomarker is most strongly associated with the estimated service population of a sewershed. This estimate was provided by each sewershed, and remained at a static value that did not adjust for real-time fluctuations in the serviced populations that may be influenced by factors such as travel by individuals for work or holidays. It is currently recommended by CDC NWSS to use either wastewater flow rate or a human fecal indicator organism as population normalization factors. We investigated flow rate and three recommended fecal indicator biomarkers to determine which are most associated with the corresponding estimated service population of a sewershed. The range of the correlation coefficients for the fecal indicator wastewater concentrations and the flow rate with the estimated population served can be found in Fig 1. A T-Test of the overall correlations stratified by the population biomarker showed that the correlations between the flow rate and estimated population served were significantly higher than the correlations of the fecal indicator concentrations (Mean difference = 0.68, P-value<0.001), and also significantly higher than the flow normalized fecal indicator concentrations (Mean difference = 0.19, P-value<0.001) with the estimated population served (Fig 1). The correlation of the flow normalized fecal indicators and the estimated population served was also significantly higher than the correlation of the fecal indicator concentrations and the estimated population served (Mean difference = 0.49, P-value = 0.033) (Fig 1). The individual correlation coefficients of the fecal indicators and the flow rate with the estimated population served across each sewershed can be found in S2 Table. Overall, the correlations of the raw wastewater concentrations (Log10GC/L) for all three human fecal indicator organisms (crAssphage, F+ Coliphage, PMMoV) with the estimated service population were low to moderate. The strongest correlation among the fecal indicators were observed with PMMoV in North Carolina, Wisconsin, Colorado, and California. The strongest correlation being in California using PMMoV (R = 0.56). There was no significant correlation observed for PMMoV in Ohio (R = 0.03, P-Value = 0.41) and Virginia (R = -0.04, P-Value = 0.47). The moderate correlation observed for PMMoV and the populations in our study was consistent with a study from Missouri which reported a similar correlation (R = 0.36) for PMMoV with the population served in their study [21]. Other studies have also reported no correlation with the PMMoV concentration and the population served [22,47]. Another study in Minnesota also reported a low to moderate association between the population served and PMMoV wastewater measurements [27]. One explanation for these results is that PMMoV is a plant virus, and the presence and concentration of PMMoV in human feces is strongly dependent on the dietary habits of the individuals within a community [48]. While PMMoV has been detected in wastewater across the globe without seasonal variability, it has been shown to have some geographic variability, likely due to regional diets, which can be a limitation when trying to use PMMoV wastewater concentrations as a population biomarker [49,50]. The discrepant correlations of PMMoV wastewater concentrations with populations served in our study and others means that more research should be conducted before PMMoV can be considered as a suitable population biomarker for WBE. The crAssphage fecal indicator target, which was only used in a subset of data from Ohio (20 sewersheds, 1,064 data points), displayed a moderate correlation with the estimated population served (R = 0.21). In contrast to our results, a previous study in Kentucky found no significant correlation between the crAssphage wastewater concentration and the population served [22]. A study in Italy also found no correlation between crAssphage concentrations and the flow capacity of the wastewater treatment plant, as well as reporting that the wastewater concentration method used will significantly influence the quantified crAssphage concentration in wastewater [30]. While only employed in Colorado (20 sewersheds, 1,914 data points) the correlation between F+ Coliphage and the estimated population served was extremely low (R = 0.08). A previous study from Colorado that analyzed F+ Coliphage concentration in their wastewater samples reported that the concentrations also displayed inconsistent geographic and temporal trends among their study sites, suggesting that F+ Coliphage was not an effective population biomarker [28]. Overall, our study results do not support the use of either one of these three fecal indicator wastewater concentrations as reliable population biomarkers for WBE.

thumbnail
Fig 1. Correlation coefficients of the fecal indicator raw wastewater concentration (Log10GC/L), fecal indicator flow normalized wastewater concentration (Log10GC/Day), and flow rate (L/Day) with the estimated population served across each study site.

Fecal indicator correlations include analysis results of PMMoV, crAssphage, and F+ Coliphage.

https://doi.org/10.1371/journal.pone.0284370.g001

We then proceeded to assess flow rate as a potential population biomarker. We observed a very strong correlation between the sewershed-level flow rate (L/Day) and estimated population served across all study sites, with the strongest correlation coefficient in Wisconsin (R = 0.96) and the lowest correlation observed in Virginia (R = 0.76) (Fig 1). Notably, the lower correlation observed in Virginia is still much stronger than any of the correlations of the fecal indicator concentration with the estimated population served as described above.

Because of the strong correlation between flow rate and the estimated population served, we wanted to determine if flow normalizing the fecal indicator concentration would generate a stronger correlation with population than what we observed from using raw fecal indicator concentrations alone. Flow normalization of the fecal indicator concentration did improve the correlation with the estimated population served, but the overall correlation was still lower than that observed using flow rate by itself. The strongest correlation with the flow normalized fecal indicator concentration and the estimated population served was observed with PMMoV (R = 0.89) in Wisconsin. In Ohio and Virginia, the flow rate improved the correlation of PMMoV and the estimated population served, producing a moderate, and significant positive correlation. The flow normalized crAssphage concentration in Ohio produced a strong correlation with the population served (R = 0.62). A previous study by Wilder et al. conducting WBE of SARS-CoV-2 in New York state compared flow normalized crAssphage wastewater concentrations to the estimated population served and reported a correlation of 0.72 [29]. A previous study by Holm et al. discussed significant temporal and spatial variability of raw fecal indicator wastewater concentrations and concluded that flow normalization of the fecal indicator concentration is an important step while conducting WBE [22]. While the results from our study show that flow normalization does improve the correlation between the fecal indicator and population served; flow rate by itself (without a fecal normalization) displayed the strongest correlation with the estimated population served.

A limitation of this analysis is that some areas will utilize combined sewer overflows (CSO), which take in wastewater, runoff, and precipitation, which could significantly increase the flow rate without an association to the population size. In our study we were not able to stratify our data by such variables because they were not consistently reported by each study site. Regardless, the results from our study still support the hypothesis that flow rate is strongly associated with the population served by an individual sewershed. Another limitation of our study is that we only investigated three of the CDC NWSS recommended population biomarkers. Many studies across the globe have proposed and investigated other population biomarkers such as β-2 microglobulin, creatinine, 5-hydroxyindoleacetic acid, caffeine, paraxanthine, ammoniacal total nitrogen, and total phosphorous [20,21,51]. These endogenous population biomarkers display a low to strong correlation with the population served (R = 0.06–0.8) [21]. Future multi-site studies across vast geographic and temporal space, such as this study, could include other population biomarkers along with flow rate to investigate and identify the most effective WBE population biomarker. Until such studies become available, we propose flow rate is the most consistent population normalization factor for WBE. Flow rate has the added advantage in that it is routinely measured by WWTP personnel in the U.S. and thus, can easily be included for population analysis when conducting WBE [52]. For communities where flow rate is not routinely measured, Maal-Bared et al. evaluated the cost-effectiveness of flow meters and suggest that it would be a helpful investment for facilitating future WBE efforts [47].

Correlation of SARS-CoV-2 wastewater concentrations and COVID-19 clinical cases

The use of population normalization factors with measured SARS-CoV-2 wastewater concentrations is common for WBE; however there is not yet a consensus as to which normalization factor is the most effective for monitoring disease trends in a community. We assessed the correlation of the SARS-CoV-2 wastewater concentration with reported COVID-19 cases using the current CDC NWSS recommended normalization approaches [26]. The Spearman correlation coefficients with COVID-19 cases from our four chosen normalization categories of the SARS-CoV-2 wastewater concentrations ranged from -0.09 (Ohio) to 0.9 (California) (Fig 2). Among the correlation values of all normalization categories, California observed the strongest mean correlation (R = 0.76) between the SARS-CoV-2 wastewater concentrations and COVID-19 cases. Ohio observed the lowest mean correlation (R = 0.06) between the SARS-CoV-2 wastewater concentrations and COVID-19 cases among all four normalization categories. Negative correlations were observed in Ohio, and we attribute this to the poor N1 and N2 wastewater concentrations measured that we discussed above. The remaining study sites had similar mean correlations with their wastewater concentrations and COVID-19 cases (Fig 2). A T-Test of the overall correlations stratified by the CDC N1 and N2 targets showed that there was no significant difference between the results produced by either genetic target (Mean difference = -0.07, P-value = 0.343).

thumbnail
Fig 2. Correlation coefficients of the SARS-CoV-2 wastewater concentrations and the sewershed-level COVID-19 cases for each study site.

This range includes the correlation coefficient using each of the four normalization categories used in the analysis.

https://doi.org/10.1371/journal.pone.0284370.g002

The correlation of the SARS-CoV-2 wastewater concentrations and COVID-19 clinical cases by each normalization category are displayed in Fig 3. The individual correlation values for each study site and normalization category can be found in S3 Table. Apart from the results we observed from Ohio, the correlation values reported among the study sites are consistent with previous findings, where the correlations with COVID-19 clinical cases typically ranged from 0.5–0.9 [10,12,14,23,53]. A limitation of our study is that we were only able to assess three CDC NWSS recommended normalization factors. While we were not able to assess other normalization factors directly, the results from our study are similar to a range of correlation values of normalized SARS-CoV-2 wastewater concentrations and COVID-19 cases (R = 0.2–0.7) produced from studies that utilized chemical normalization factors such as β-2 microglobulin, caffeine, creatinine, paraxanthine, 5-hydroxyindoleacetic acid, total nitrogen, or total phosphorus [21,47,51,54,55]. We further stress the importance of additional assessments of other population biomarkers in community wastewater to identify other potential targets to further improve WBE of infectious diseases.

thumbnail
Fig 3. Correlation coefficients of the SARS-CoV-2 wastewater concentrations and the sewershed-level COVID-19 cases for each study site by each normalization category.

https://doi.org/10.1371/journal.pone.0284370.g003

Our assessment showed that flow normalized SARS-CoV-2 wastewater concentrations generated the strongest correlation with COVID-19 clinical cases. By contrast, the fecal normalized SARS-CoV-2 wastewater concentrations generated the weakest correlation with COVID-19 clinical cases. Our T-Test results showed that the flow normalized correlation coefficients were significantly higher than the other three normalization categories (Table 4). Previous studies have also reported strong correlations of flow normalized SARS-CoV-2 wastewater concentrations with COVID-19 clinical cases [11,51,53]. We also found that the flow and fecal normalized correlations were significantly higher than just the fecal normalized correlations (Table 4). In contrast to our results, a study in Canada reported that normalization did not significantly improve their correlation with COVID-19 cases, when compared to the correlation using the raw SARS-CoV-2 wastewater concentration [47]. Additionally, weak correlations of fecal normalizing SARS-CoV-2 wastewater concentrations with PMMoV and F+ Coliphage have also been previously reported [14,20,21,56]. One study in California assessed the correlation from four normalization biomarkers (PMMoV, crAssphage, Bacteroides rRNA, and human 18S), and found that the biomarkers had a negative effect on the correlation with COVID-19 clinical cases [57]. A study in Wisconsin also reported a negative effect of fecal normalization on the overall correlation, similar to what we found across all of our included study sites [23]. A study from Colorado that used the F+ Coliphage for fecal normalization also reported that it did not improve results for trend analysis [28]. F+ Coliphage was subsequently dropped from the routine surveillance protocol and replaced with PMMoV in this study. Two separate studies from Ohio examined the effect of normalization factors on the correlation between SARS-CoV-2 wastewater concentrations and COVID-19 clinical cases. Nagarkar et al. reported that normalizing for flow rate or fecal indicators had no significant improvement of the overall correlation from any of the normalization factors [58]. Interestingly, the other Ohio study from Ai et al. reported a negative effect of fecal normalization on the correlation with COVID-19 clinical cases, similar to what we observed in our study [56]. The negative correlation values on the fecal normalized SARS-CoV-2 wastewater concentrations reported in ours and other studies, support the conclusion that fecal normalization may not provide a strong positive effect on disease trend analysis for WBE.

thumbnail
Table 4. T-Test analysis of the difference of the correlation coefficients observed among each of the normalization categories.

https://doi.org/10.1371/journal.pone.0284370.t004

The overall results in our study showed that while flow normalized wastewater concentrations produced the strongest correlation with cases, there were instances within our study where the fecal normalized concentrations had the strongest correlation with COVID-19 cases. One example is in North Carolina, where the PMMoV normalized wastewater concentrations were higher than the flow normalized correlations, but the fecal and flow normalized correlations in North Carolina were the highest (S2 Table). This result in North Carolina suggests that, while flow normalized was not the strongest, it still improved the correlation in addition to fecal normalization. Similar to our observation, the potential enhancement of using fecal indicators in addition to flow normalized SARS-CoV-2 wastewater concentrations was previously reported by Langeveld et al. [25]. Additionally, a study from Duvallet et al. analyzing nationwide data in the U.S. also reported that fecal normalization with PMMoV improved the correlation with COVID-19 cases in some study sites but it was lower than the correlation in other study sites when compared to the raw wastewater concentration [59]. Additionally, in our study the overall correlation values of the raw SARS-CoV-2 wastewater concentration and reported COVID-19 cases was not significantly different than the fecal normalized correlation values, the raw concentration had a smaller range that did not go as far into the negative correlation values. If flow rate is not available, it may be preferable to use the raw SARS-CoV-2 wastewater concentration rather than pursue a fecal normalization approach [47]. Our results show that flow normalized SARS-CoV-2 wastewater concentrations generate the strongest correlation with COVID-19 cases.

Molecular analysis method influence on the correlation with COVID-19 cases

The optimal molecular analysis tool to be used for WBE is a topic of growing importance that has warranted further investigation on the effects of the different tools on results generated when processing wastewater samples [54,6062]. This dataset allowed us to study the effect of laboratory methods and stratify the correlations generated from all the normalization categories by the molecular analysis approach used, i.e., RT-ddPCR and rRT-qPCR. Wastewater samples analyzed by RT-ddPCR generated significantly higher correlation values (Mean difference = 0.21, P-value = 0.008) than wastewater samples analyzed by rRT-qPCR (Fig 4). Our results suggest that molecular analysis by RT-ddPCR is more precise than rRT-qPCR, and that wastewater samples analyzed by RT-ddPCR will generate the best trends of COVID-19 cases within a community. Previous studies have also suggested RT-ddPCR as the preferred molecular analysis tool for wastewater surveillance due to its ability to produce more precise wastewater concentration results [6062]. While RT-ddPCR is more expensive than rRT-qPCR, it is the optimal molecular analysis option, and it should become the standard approach used globally as the cost becomes more affordable to laboratories conducting WBE. Our assessment results conclude that utilizing RT-ddPCR and the flow normalization approach will produce the strongest COVID-19 community disease trend results which can be used to improve pandemic response across the globe. Consistent inter-laboratory processing procedures for WBE are important and can greatly improve generalization and interpretation of results [41]. We believe that a national standard operating procedure for processing wastewater samples should be prioritized in the future.

thumbnail
Fig 4. Correlation coefficients of the SARS-CoV-2 wastewater concentrations and the sewershed-level COVID-19 cases for each study site by each molecular analysis method.

https://doi.org/10.1371/journal.pone.0284370.g004

Conclusions

Our study has provided the first multistate assessment of population normalization factors for WBE of SARS-CoV-2 using the CDC NWSS dataset. The dataset of 12,445 wastewater surveillance observations across 182 communities located throughout six U.S. states provided depth, breadth, and robustness to our study. With this dataset we assessed the CDC NWSS recommended normalization factors and determined which factors were accurate population biomarkers and the effect these normalization factors have on the correlation of SARS-CoV-2 wastewater concentration trends with reported COVID-19 cases. We found that the flow rate was the best population biomarker, having the strongest correlation with the estimated population served across all study sites. We also found that normalization of the SARS-CoV-2 wastewater concentration by flow rate produced the strongest correlation with reported COVID-19 cases. Lastly, our study revealed that wastewater samples analyzed using RT-ddPCR produced a stronger correlation with COVID-19 cases than samples that were analyzed using rRT-qPCR. Overall, our assessment has demonstrated that WBE of SARS-CoV-2 is an effective approach for monitoring trends of disease within a community, and that generated results can be enhanced by analyzing wastewater samples with RT-ddPCR and normalizing the wastewater concentration by the flow rate.

Supporting information

S1 Table. Influent wastewater processing methods used by each study site concentration, extraction, and molecular analysis of SARS-CoV-2 RNA.

https://doi.org/10.1371/journal.pone.0284370.s001

(DOCX)

S2 Table. Spearman correlation coefficient analysis of the fecal indicator raw wastewater concentration (Log10GC/L), fecal indicator flow normalized wastewater concentration (Log10GC/Day), and flow rate (L/Day) with the estimated population served across each study site.

https://doi.org/10.1371/journal.pone.0284370.s002

(DOCX)

S3 Table. Spearman correlation coefficients (P-Value) of each normalization category for the SARS-CoV-2 wastewater concentrations and the sewershed-level COVID-19 cases for each study site.

https://doi.org/10.1371/journal.pone.0284370.s003

(DOCX)

Acknowledgments

We would like to thank the CDC NWSS team for their generous help in processing our data request and answering technical questions about the primary data input process. Centers for Disease Control and Prevention/Agency for Toxic Substances and Drug Registry, National Wastewater Surveillance System Restricted Data Set, 2021, as compiled from data provided through National Wastewater Surveillance System in the Waterborne Disease Prevention Branch.

References

  1. 1. Rasmussen SA, Khoury MJ, del Rio C. Precision Public Health as a Key Tool in the COVID-19 Response. JAMA. 2020;324(10):933–4. pmid:32805001
  2. 2. Dean N. Tracking COVID-19 infections: time for change. Nature. 2022;602(7896):185. pmid:35136224
  3. 3. Ahmed W, Angel N, Edson J, Bibby K, Bivins A, O’Brien J, et al. First confirmed detection of SARS-CoV-2 in untreated wastewater in Australia: A proof of concept for the wastewater surveillance of COVID-19 in the community. Science of The Total Environment. 2020;728:138764. pmid:32387778
  4. 4. La Rosa G, Iaconelli M, Mancini P, Bonanno Ferraro G, Veneri C, Bonadonna L, et al. First detection of SARS-CoV-2 in untreated wastewaters in Italy. Science of The Total Environment. 2020;736:139652. pmid:32464333
  5. 5. Sherchan SP, Shahin S, Ward LM, Tandukar S, Aw TG, Schmitz B, et al. First detection of SARS-CoV-2 RNA in wastewater in North America: A study in Louisiana, USA. Sci Total Environ. 2020;743:140621. pmid:32758821
  6. 6. Kirby AE, Walters MS, Jennings WC, Fugitt R, LaCross N, Mattioli M, et al. Using Wastewater Surveillance Data to Support the COVID-19 Response—United States, 2020–2021. MMWR Morb Mortal Wkly Rep. 2021;70(36):1242–4. pmid:34499630
  7. 7. Lamers MM, Beumer J, van der Vaart J, Knoops K, Puschhof J, Breugem TI, et al. SARS-CoV-2 productively infects human gut enterocytes. Science. 2020;369(6499):50–4. pmid:32358202
  8. 8. Lescure F-X, Bouadma L, Nguyen D, Parisey M, Wicky P-H, Behillil S, et al. Clinical and virological data of the first cases of COVID-19 in Europe: a case series. The Lancet Infectious diseases. 2020;20(6):697–706. pmid:32224310
  9. 9. Wölfel R, Corman VM, Guggemos W, Seilmaier M, Zange S, Müller MA, et al. Virological assessment of hospitalized patients with COVID-2019. Nature. 2020;581(7809):465–9. pmid:32235945
  10. 10. Peccia J, Zulli A, Brackney DE, Grubaugh ND, Kaplan EH, Casanovas-Massana A, et al. Measurement of SARS-CoV-2 RNA in wastewater tracks community infection dynamics. Nat Biotechnol. 2020;38(10):1164–7. pmid:32948856
  11. 11. Wu F, Xiao A, Zhang J, Moniz K, Endo N, Armas F, et al. Wastewater surveillance of SARS-CoV-2 across 40 U.S. states from February to June 2020. Water Res. 2021;202:117400. pmid:34274898
  12. 12. Weidhaas J, Aanderud ZT, Roper DK, VanDerslice J, Gaddis EB, Ostermiller J, et al. Correlation of SARS-CoV-2 RNA in wastewater with COVID-19 disease burden in sewersheds. The Science of the total environment. 2021;775:145790. pmid:33618308
  13. 13. Medema G, Heijnen L, Elsinga G, Italiaander R, Brouwer A. Presence of SARS-Coronavirus-2 RNA in sewage and correlation with reported COVID-19 prevalence in the early stage of the epidemic in the Netherlands. Environmental Science & Technology Letters. 2020;7(7):511–6.
  14. 14. Graham KE, Loeb SK, Wolfe MK, Catoe D, Sinnott-Armstrong N, Kim S, et al. SARS-CoV-2 RNA in Wastewater Settled Solids Is Associated with COVID-19 Cases in a Large Urban Sewershed. Environ Sci Technol. 2021;55(1):488–98. pmid:33283515
  15. 15. Street R, Mathee A, Mangwana N, Dias S, Sharma JR, Ramharack P, et al. Spatial and Temporal Trends of SARS-CoV-2 RNA from Wastewater Treatment Plants over 6 Weeks in Cape Town, South Africa. Int J Environ Res Public Health. 2021;18(22). pmid:34831841
  16. 16. Polo D, Quintela-Baluja M, Corbishley A, Jones DL, Singer AC, Graham DW, et al. Making waves: Wastewater-based epidemiology for COVID-19 –approaches and challenges for surveillance and prediction. Water Research. 2020;186:116404. pmid:32942178
  17. 17. Daughton CG. Monitoring wastewater for assessing community health: Sewage Chemical-Information Mining (SCIM). Science of The Total Environment. 2018;619–620:748–64. pmid:29161600
  18. 18. Daughton CG. Wastewater surveillance for population-wide Covid-19: The present and future. Sci Total Environ. 2020;736:139631. pmid:32474280
  19. 19. Chen C, Kostakis C, Gerber JP, Tscharke BJ, Irvine RJ, White JM. Towards finding a population biomarker for wastewater epidemiology studies. Science of The Total Environment. 2014;487:621–8. pmid:24300482
  20. 20. Sakarovitch C, Schlosser O, Courtois S, Proust-Lima C, Couallier J, Pétrau A, et al. Monitoring of SARS-CoV-2 in wastewater: what normalisation for improved understanding of epidemic trends? J Water Health. 2022;20(4):712–26. pmid:35482387
  21. 21. Hsu SY, Bayati M., Li C., Hsieh H. Y., Belenchia A., Klutts J., et al. Biomarkers selection for population normalization in SARS-CoV-2 wastewater-based epidemiology. Water research. 2022;223:118985. pmid:36030667
  22. 22. Holm RH, Nagarkar M, Yeager RA, Talley D, Chaney AC, Rai JP, et al. Surveillance of RNase P, PMMoV, and CrAssphage in wastewater as indicators of human fecal concentration across urban sewer neighborhoods, Kentucky. FEMS Microbes. 2022;3.
  23. 23. Feng S, Roguet A, McClary-Gutierrez JS, Newton RJ, Kloczko N, Meiman JG, et al. Evaluation of Sampling, Analysis, and Normalization Methods for SARS-CoV-2 Concentrations in Wastewater to Assess COVID-19 Burdens in Wisconsin Communities. ACS ES&T Water. 2021;1(8):1955–65.
  24. 24. Sweetapple C, Melville-Shreeve P, Chen AS, Grimsley JMS, Bunce JT, Gaze W, et al. Building knowledge of university campus population dynamics to enhance near-to-source sewage surveillance for SARS-CoV-2 detection. Sci Total Environ. 2022;806(Pt 1):150406. pmid:34571237
  25. 25. Langeveld J, Schilperoort R, Heijnen L, Elsinga G, Schapendonk CEM, Fanoy E, et al. Normalisation of SARS-CoV-2 concentrations in wastewater: The use of flow, electrical conductivity and crAssphage. Sci Total Environ. 2022;865:161196. pmid:36581271
  26. 26. Centers for Disease Control and Prevention. Wastewater Surveillance Data Reporting and Analytics 2022 [updated April 8, 2022. https://www.cdc.gov/coronavirus/2019-ncov/cases-updates/wastewater-surveillance/data-reporting-analytics.html.
  27. 27. Melvin RG, Hendrickson EN, Chaudhry N, Georgewill O, Freese R, Schacker TW, et al. A novel wastewater-based epidemiology indexing method predicts SARS-CoV-2 disease prevalence across treatment facilities in metropolitan and regional populations. Sci Rep. 2021;11(1):21368. pmid:34725394
  28. 28. Reeves K, Liebig J, Feula A, Saldi T, Lasda E, Johnson W, et al. High-resolution within-sewer SARS-CoV-2 surveillance facilitates informed intervention. Water Res. 2021;204:117613. pmid:34500183
  29. 29. Wilder ML, Middleton F, Larsen DA, Du Q, Fenty A, Zeng T, et al. Co-quantification of crAssphage increases confidence in wastewater-based epidemiology for SARS-CoV-2 in low prevalence areas. Water Res X. 2021;11:100100. pmid:33842875
  30. 30. Crank K, Li X, North D, Ferraro GB, Iaconelli M, Mancini P, et al. CrAssphage abundance and correlation with molecular viral markers in Italian wastewater. Water Research. 2020;184:116161. pmid:32810770
  31. 31. Centers for Disease Control and Prevention. COVID-19 Data Tracker: Wastewater Surveillance 2022 [https://covid.cdc.gov/covid-data-tracker/#wastewater-surveillance.
  32. 32. Centers for Disease Control and Prevention. Coronavirus Disease 2019 (COVID-19) 2021 Case Definition 2021 [https://ndc.services.cdc.gov/case-definitions/coronavirus-disease-2019-2021/.
  33. 33. Whitney ON, Kennedy LC, Fan VB, Hinkle A, Kantor R, Greenwald H, et al. Sewage, Salt, Silica, and SARS-CoV-2 (4S): An Economical Kit-Free Method for Direct Capture of SARS-CoV-2 RNA from Wastewater. Environmental Science & Technology. 2021;55(8):4880–8.
  34. 34. Centers for Disease Control and Prevention. 2019-Novel Coronavirus (2019-nCoV) Real-time rRT-PCR Panel Primers and Probes 2019 [https://www.cdc.gov/coronavirus/2019-ncov/downloads/rt-pcr-panel-primer-probes.pdf.
  35. 35. Gonzalez R, Larson A, Thompson H, Carter E, Cassi XF. Redesigning SARS-CoV-2 clinical RT-qPCR assays for wastewater RT-ddPCR. medRxiv. 2022:2021.03.02.21252754.
  36. 36. R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2021.
  37. 37. RStudio Team. RStudio: Integrated Development for R. Boston, MA: RStudio, PBC; 2020.
  38. 38. Wickham H. ggplot2: Elegant Graphics for Data Analysis: Springer-Verlag New York; 2016.
  39. 39. Centers for Disease Control and Prevention. Omicron Variant: What You Need to Know 2022 [https://www.cdc.gov/coronavirus/2019-ncov/variants/omicron-variant.html.
  40. 40. Centers for Disease Control and Prevention. Wastewater Surveillance Testing Methods 2021 [updated June 23, 2021. https://www.cdc.gov/healthywater/surveillance/wastewater-surveillance/testing-methods.html.
  41. 41. Pecson BM, Darby E, Haas CN, Amha YM, Bartolo M, Danielson R, et al. Reproducibility and sensitivity of 36 methods to quantify the SARS-CoV-2 genetic signal in raw wastewater: findings from an interlaboratory methods evaluation in the U.S. Environmental Science: Water Research & Technology. 2021;7(3):504–20. pmid:34017594
  42. 42. Sangsanont J, Rattanakul S, Kongprajug A, Chyerochana N, Sresung M, Sriporatana N, et al. SARS-CoV-2 RNA surveillance in large to small centralized wastewater treatment plants preceding the third COVID-19 resurgence in Bangkok, Thailand. Science of The Total Environment. 2022;809:151169. pmid:34699826
  43. 43. Fahrenfeld NL, Morales Medina WR, D’Elia S, Modica M, Ruiz A, McLane M. Comparison of residential dormitory COVID-19 monitoring via weekly saliva testing and sewage monitoring. Sci Total Environ. 2021:151947. pmid:34838560
  44. 44. Scott LC, Aubee A, Babahaji L, Vigil K, Tims S, Aw TG. Targeted wastewater surveillance of SARS-CoV-2 on a university campus for COVID-19 outbreak detection and mitigation. Environ Res. 2021;200:111374. pmid:34058182
  45. 45. Gerrity D, Papp K, Stoker M, Sims A, Frehner W. Early-pandemic wastewater surveillance of SARS-CoV-2 in Southern Nevada: Methodology, occurrence, and incidence/prevalence considerations. Water Research X. 2021;10:100086. pmid:33398255
  46. 46. Sanjuán R, Domingo-Calap P. Reliability of Wastewater Analysis for Monitoring COVID-19 Incidence Revealed by a Long-Term Follow-Up Study. Frontiers in Virology. 2021;1.
  47. 47. Maal-Bared R, Qiu Y, Li Q, Gao T, Hrudey SE, Bhavanam S, et al. Does normalization of SARS-CoV-2 concentrations by Pepper Mild Mottle Virus improve correlations and lead time between wastewater surveillance and clinical data in Alberta (Canada) comparing twelve SARS-CoV-2 normalization approaches. Sci Total Environ. 2022;856:158964. pmid:36167131
  48. 48. Symonds EM, Rosario K, Breitbart M. Pepper mild mottle virus: Agricultural menace turned effective tool for microbial water quality monitoring and assessing (waste)water treatment technologies. PLOS Pathogens. 2019;15(4):e1007639. pmid:30998781
  49. 49. Haramoto E, Kitajima M, Kishida N, Konno Y, Katayama H, Asami M, et al. Occurrence of Pepper Mild Mottle Virus in Drinking Water Sources in Japan. Applied and Environmental Microbiology. 2013;79(23):7413–8. pmid:24056461
  50. 50. Kitajima M, Sassi HP, Torrey JR. Pepper mild mottle virus as a water quality indicator. npj Clean Water. 2018;1(1):19.
  51. 51. Isaksson F, Lundy L, Hedström A, Székely AJ, Mohamed N. Evaluating the Use of Alternative Normalization Approaches on SARS-CoV-2 Concentrations in Wastewater: Experiences from Two Catchments in Northern Sweden. Environments. 2022;9(3):39.
  52. 52. Martin BS, Wheeler G, Burke D. Self-Assessment for Wastewater Treatment Plant Optimization: Partnership for Clean Water: American Water Works Association; 2017.
  53. 53. Acosta N, Bautista MA, Waddell BJ, McCalder J, Beaudet AB, Man L, et al. Longitudinal SARS-CoV-2 RNA wastewater monitoring across a range of scales correlates with total and regional COVID-19 burden in a well-defined urban population. Water Research. 2022;220:118611. pmid:35661506
  54. 54. Zhan Q, Babler KM, Sharkey ME, Amirali A, Beaver CC, Boone MM, et al. Relationships between SARS-CoV-2 in Wastewater and COVID-19 Clinical Cases and Hospitalizations, with and without Normalization against Indicators of Human Waste. ACS ES&T Water. 2022.
  55. 55. Hutchison JM, Li Z, Chang CN, Hiripitiyage Y, Wittman M, Sturm BSM. Improving correlation of wastewater SARS-CoV-2 gene copy numbers with COVID-19 public health cases using readily available biomarkers. FEMS Microbes. 2022;3. pmid:36118159
  56. 56. Ai Y, Davis A, Jones D, Lemeshow S, Tu H, He F, et al. Wastewater SARS-CoV-2 monitoring as a community-level COVID-19 trend tracker and variants in Ohio, United States. Sci Total Environ. 2021;801:149757. pmid:34467932
  57. 57. Greenwald HD, Kennedy LC, Hinkle A, Whitney ON, Fan VB, Crits-Christoph A, et al. Tools for interpretation of wastewater SARS-CoV-2 temporal and spatial trends demonstrated with data collected in the San Francisco Bay Area. Water Research X. 2021;12:100111. pmid:34373850
  58. 58. Nagarkar M, Keely SP, Jahne M, Wheaton E, Hart C, Smith B, et al. SARS-CoV-2 monitoring at three sewersheds of different scales and complexity demonstrates distinctive relationships between wastewater measurements and COVID-19 case data. Sci Total Environ. 2022;816:151534. pmid:34780821
  59. 59. Duvallet C, Wu F, McElroy KA, Imakaev M, Endo N, Xiao A, et al. Nationwide Trends in COVID-19 Cases and SARS-CoV-2 RNA Wastewater Concentrations in the United States. ACS ES&T Water. 2022;2(11):1899–909. pmid:36380771
  60. 60. Ahmed W, Smith WJM, Metcalfe S, Jackson G, Choi PM, Morrison M, et al. Comparison of RT-qPCR and RT-dPCR Platforms for the Trace Detection of SARS-CoV-2 RNA in Wastewater. ACS ES&T Water. 2022. pmid:36380768
  61. 61. Ciesielski M, Blackwood D, Clerkin T, Gonzalez R, Thompson H, Larson A, et al. Assessing sensitivity and reproducibility of RT-ddPCR and RT-qPCR for the quantification of SARS-CoV-2 in wastewater. J Virol Methods. 2021;297:114230. pmid:34252511
  62. 62. Ahmed W, Smith WJM, Metcalfe S, Jackson G, Choi PM, Morrison M, et al. Comparison of RT-qPCR and RT-dPCR Platforms for the Trace Detection of SARS-CoV-2 RNA in Wastewater. ACS ES&T Water. 2022;2(11):1871–80. pmid:36380768