Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Evaluation of stream visual assessment protocol with measured water quality parameters in urban streams

  • Caleb McMurray,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Biological Sciences, NC State University, Raleigh, North Carolina, United States of America

  • Abigail C. Finch,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Biological Sciences, NC State University, Raleigh, North Carolina, United States of America

  • Kennedy Jones,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Biological Sciences, NC State University, Raleigh, North Carolina, United States of America

  • Eli Keaton,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Biological Sciences, NC State University, Raleigh, North Carolina, United States of America

  • Hyde Parkinson,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Writing – original draft, Writing – review & editing

    Affiliation Department of Biological Sciences, NC State University, Raleigh, North Carolina, United States of America

  • Norah Patterson,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Department of Biological Sciences, NC State University, Raleigh, North Carolina, United States of America

  • Jennifer James,

    Roles Resources, Writing – review & editing, Investigation

    Affiliations Department of Applied Ecology, NC State University, Raleigh, North Carolina, United States of America, Center for Applied Aquatic Ecology, North Carolina State University, Raleigh, North Carolina, United States of America

  • JoAnn Burkholder,

    Roles Resources, Visualization, Writing – review & editing

    Affiliations Department of Applied Ecology, NC State University, Raleigh, North Carolina, United States of America, Center for Applied Aquatic Ecology, North Carolina State University, Raleigh, North Carolina, United States of America

  • Ana Meza-Salazar,

    Roles Conceptualization, Project administration, Resources, Software, Supervision, Writing – review & editing

    Affiliation Center for Applied Aquatic Ecology, North Carolina State University, Raleigh, North Carolina, United States of America

  • Erin A. McKenney

    Roles Conceptualization, Data curation, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing

    eamckenn@ncsu.edu

    Affiliation Center for Applied Aquatic Ecology, North Carolina State University, Raleigh, North Carolina, United States of America

Abstract

Accurate assessment of stream health is important due to the numerous known influences of habitat, including water quality, on aquatic ecosystems as well as human health. The Stream Visual Assessment Protocol (SVAP) of the Natural Resources Conservation Service is an accessible resource for resource managers and the citizenry that provides a rapid “snapshot” assessment of general stream health, based on visual physical characteristics. This study evaluated whether SVAP scores can be used to infer water quality conditions. We assigned SVAP scores for four urban streams in the southeastern U.S. Piedmont region using ten metrics, and assessed whether the scores were strongly correlated with measured data for four physical features (depth, flow rate, canopy cover, water temperature) and seven water quality parameters (pH, dissolved oxygen concentration and percent saturation, conductivity, total dissolved solids, turbidity, and Enterococcus). The SVAP scores were strongly correlated with measured physical characteristics, but there were few significant correlations between SVAP scores and water quality data. The findings suggest that the SVAP should not be used to infer water quality conditions, which are critically important to stream habitat health.

Introduction

Water quality has important implications for aquatic life and human use [1]. Poor water quality may prevent potable use of a freshwater source, limit recreation, and decrease aquatic biodiversity [2,3]. Water quality in freshwaters has been historically assessed using various metrics such as pH, conductivity, turbidity, total dissolved solids, dissolved oxygen, nutrient concentrations, algal biomass as the indicator pigment chlorophyll a, and pathogenic bacteria or their indicators [3,4]. Features such as terrestrial canopy cover [5], temperature, flow rate [3], and water depth [6] can provide insights about physical characteristics that affect stream biodiversity.

The United States Department of Agriculture (USDA) Stream Visual Assessment Protocol (SVAP) was developed as an initial screening technique for the general condition of wadeable streams based on visible physical features, without actual water quality measurements [7,8]. The SVAP protocol includes written instructions to assign scores from 10 (excellent) to 1 (poor) for up to 15 elements, using a rubric of narrative descriptions. As such, the SVAP does not require expensive materials or specialized training, and it has been implemented widely across the U.S. [2,9,10] and in other nations (e.g., [1113]).

The SVAP has mostly been compared to macroinvertebrate metrics indicative of stream health [2,10,13]. Previous field researchers have reported that SVAP scores were weakly and inconsistently correlated with macroinvertebrate indices in various geographic locations [2], and suggestions have been made for strengthening the utility of the SVAP to more closely parallel inferences from metrics for general macroinvertebrate community health [10,14]. In the SVAP, general water quality is inferred by appearance (color and turbidity) and nutrient enrichment is inferred from obvious algal growth. However, the SVAP has not been compared to actual water quality data for parameters such as dissolved oxygen, conductivity, or total dissolved solids, so its utility for indicating general water quality conditions is unknown. Correlation to water quality is important to complement conventional macroinvertebrate bioindicators, especially in urban streams where conditions are generally poor for sensitive macroinvertebrate taxa [15,16].

Given the altered state characteristic of urban streams [17] and often-rapid urbanization rates [18], it is increasingly important to identify accurate and accessible alternative protocols to monitor the biological and chemical health of urban streams [19]. We therefore assessed the potential of the Natural Resources Conservation Service (NRCS) SVAP for rapid assessment of general water quality of four urban streams by comparing the scores to measurements for several physical characteristics and water quality parameters. We expected that visual stream characteristics would correlate well with the general conditions indicated by the water quality data.

Methods

Study area and streams

The four streams were in the Piedmont region of North Carolina, USA, within the greater Raleigh urban area, which has sustained the second highest growth of any urban area in the United States in the last decade. The City of Raleigh grew from 467,911 people in 2020 to 499,825 people in 2025, a 6.8% increase [20]. Urbanization is rapidly transforming watersheds across the Piedmont in central North Carolina, with implications for urban watershed hydrology and water quality (e.g., [21,22]). Compared to fully forested watersheds, urbanized Piedmont watersheds discharge 75% more stormflow per precipitation event and perform 19% lower evapotranspiration rates [23], slowing recovery of urban watersheds after storm events. A comparison of Bolin Creek to two reference streams in Chapel Hill, NC suggests that urban runoff from impervious surfaces drives water quality degradation as measured by conductivity, turbidity, and nutrient concentration [24].

We assessed the four urban streams during a four-week period (Table 1, Fig 1) from 24 October to 14 November 2024. We received permission from Rachel Woods (NC Museum of Art) to access House Creek and from Laxmi Parajuli (Schenck Forest) to access Richland Creek; Walnut Creek and Rocky Branch Creek were accessed on NC State University campus. Permits were not required to collect the data for this study because no specimens were removed and the stream assessment was not disruptive. Each stream was analyzed at three different 5-m-length sites, spaced at least 100 m apart. All locations at each stream were assessed twice on randomized dates in an attempt to avoid weather as a confounding variable. Data were collected from Rocky Branch (RB) and Walnut Creek (WC) on 24 October, Rocky Branch and House Creek (HC) on 31 October, Richland Creek (RC) and Walnut Creek on 7 November, and Richland Creek and House Creek on 14 November.

thumbnail
Table 1. Stream locations and brief description of areas sampled.

https://doi.org/10.1371/journal.pone.0351972.t001

thumbnail
Fig 1. Map showing the study area and sample sites on Richland Creek, House Creek, Rocky Branch Creek, and Walnut Creek in the upper Neuse River watershed, Raleigh, NC.

Lakes Johnson and Raleigh are run-of-river impoundments along Walnut Creek; also note that the apparent breaks in Walnut Creek are locations where the stream went under a roadway or culvert. Maps were created using the maps, osmdata, leaflet, and ggplot2 packages in R. See Table 1 for specific site locations.

https://doi.org/10.1371/journal.pone.0351972.g001

House Creek originates from a small reservoir southwest of the intersection of Interstate 440 and Wade Avenue in western Raleigh, North Carolina. The stream flows north for ~1.9 km before joining another first-order tributary from a reservoir near the east border of UNC Rex Hospital. The second-order House Creek tributary then parallels Interstate 440 for approximately 3.0 km before discharging into Crabtree Creek. Despite its position within a heavily urbanized corridor and its repeated crossings beneath the interstate, House Creek maintains a relatively intact riparian zone. This vegetation contributes canopy cover and woody debris inputs, providing important ecological functions and supporting in-stream habitat.

Richland Creek arises from a pond located on the North Carolina State Fairgrounds south of Carter–Finley Stadium. The stream flows north through Schenck Forest and along the southern boundary of William B. Umstead State Park before joining Crabtree Creek. With the confluence of two unnamed tributaries along its course, Richland Creek is classified as a second-order tributary. In May 2023, sections of the streambank near the sampling sites were reinforced to mitigate stormwater-induced erosion caused by runoff from adjacent Wade Avenue [25]. While the stream originates in what is now a highly developed area, much of its length flows through protected forested land, offering ecological benefits comparable to those of House Creek.

Rocky Branch Creek originates near the southern end of Meredith College campus, which forms the upper extent of the watershed by elevation. Stormwater from the campus is conveyed via a system of ponds and open channels to a set of culverts beneath Hillsborough Street and the railroad, where it is joined by stormwater flow from a small area west of I-440 and transitions to a natural stream channel east of Beryl Road and flows southeast into North Carolina State University’s Central Campus at the intersection of Gorman Street and Sullivan Drive [26]. The stream continues through campus before exiting near the southeastern edge and following Western Boulevard until joining Walnut Creek northwest of the Interstate 40 and Hammond Drive intersection, where it functions as a first-order tributary. Along its course, Rocky Branch traverses extensive culverts and stormwater infrastructure, with an estimated ~97 km of stormwater pipes present within its watershed (~27 km of which are maintained by the city of Raleigh). In addition, the Rocky Branch Creek Greenway parallels much of the stream length through five Raleigh city parks. Together, these factors have contributed to a highly urbanized stream corridor characterized by limited riparian zones and reduced floodplain connectivity.

Walnut Creek, a fourth-order stream [27], originates from Maynard Pond in a residential neighborhood of Cary, North Carolina, and flows eastward through southern Raleigh before joining the Neuse River near the intersection of Poole Road and Barwell Road. Along its course, Walnut Creek traverses several impoundments including Lakes Cramer, Johnson, and Raleigh, and it receives inflow from multiple smaller tributaries. Because of its length and catchment size, Walnut Creek traverses a range of land-use settings including residential areas, public conservation lands, and the Centennial Campus of North Carolina State University. Consequently, its ecological condition reflects a composite of both beneficial and detrimental characteristics as observed in the other streams.

SVAP application

Each stream was assessed following the SVAP [7], and was assigned a score ranging from 1 to 10 (Fig 2). Three researchers scored each stream site based on ten factors (channel condition, hydrologic condition, riparian zone, bank stability, water appearance, nutrient enrichment, barriers to fish movement, instream fish cover, pools, invertebrate habitat) using SVAP guidelines. The team used the SVAP worksheet to score each factor from 1–10 for evaluation, and then discussed their individual assessments to arrive at a consensus score for each factor at each site. A short description of the SVAP guidelines, including an explanation of our interpretation of each of the scores, is provided in Supplementary Table 1. We randomized which three researchers completed the SVAP at each site on each day to avoid scoring bias. We averaged the scores across all ten factors to calculate an overall health score for each stream site, per SVAP guidelines.

thumbnail
Fig 2. Representation of stream characteristics with maximum (10) and minimum (1) scores for each of ten factors on the stream visual assessment protocol (SVAP).

The spherical densiometer, water probe, and Enterococcus represent physical characteristics and water quality parameters. Created in BioRender. Jones, K. (2026) https://BioRender.com/c4y8r1i.

https://doi.org/10.1371/journal.pone.0351972.g002

Measured physical characteristics

Air temperature (°C) and relative humidity (%) were measured at each site using a Kestrel 3000 Weather Meter (Kestrel Instruments, Boothwyn, PA, USA). Water temperature (°C) was measured using a YSI ProSolo ODO Optical Dissolved Oxygen Meter (Xylem Inc., Washington DC, USA). Water depth (cm) was measured with a meter stick at three points (near left bank, mid-stream, and near right bank) and averaged for each site. Flow rate (m/s) was measured using a meter stick, a ping pong ball, and a stopwatch (sensu [28]). Canopy cover by terrestrial vegetation was measured with spherical crown densiometers (model 43887, Forestry Suppliers, Jackson, MS, USA).

Measured water quality parameters

We also collected water quality data at each stream site. Dissolved oxygen (DO, mg/L and percent saturation, %) was measured using a YSI ProSolo ODO Optical Dissolved Oxygen Meter (Xylem Inc., Washington DC, USA). Conductivity (μS/cm), total dissolved solids (TDS, mg/L), and pH were measured with an Apera PC60 pocket water probe (Apera Instruments, Columbus, OH, USA). Turbidity (NTU) was measured with a Hatch 2100P portable turbidimeter (Hatch, Loveland, CO, USA).

We quantified Enterococcus bacterial densities in each stream using composite samples collected from each of the three sites and pooled. One vial of Enterolert reagent was mixed into each 100-mL sample; samples were sealed in a 49-well Quanti-tray/2000 (IDEXX Laboratories, Westbrook, Maine, USA), and trays were incubated at 41.0 °C for ~24 hr (Fisherbrand Isotemp Microbiological Incubator, Hampton, NH, USA). The Quanti-trays were then placed into a Spectroline model CM-10 fluorescence analysis cabinet (Spectronics Corporation, Westbury, NY, USA). Glowing cells indicating the presence of Enterococcus were marked, and an IDEXX Quanti-Tray*/2000 most probable number (MPN) table was used to estimate the MPN 100 mL-1.

Hypothesized relationships between SVAP and water quality metrics

We considered ten SVAP metrics, four measured physical environmental features, and seven water quality parameters in this assessment. Prior to the analysis, we hypothesized positive or negative relationships suggested by significant correlations between SVAP metrics and measured physical environmental characteristics or water quality parameters (Table 2). Since many of the factors are known to interact [2830], the predicted (expected) effects in various comparisons were both positive and negative depending on the parameter levels.

thumbnail
Table 2. Hypothesized relationships between SVAP factors and water quality metrics, and rationale for these predictions (concepts taken from [2831]).

https://doi.org/10.1371/journal.pone.0351972.t002

Statistical analysis

Because we measured Enterococcus from pooled samples for each stream, we first averaged the SVAP scores and water quality measurements across the three sites in each stream, to compare a single composite value for each measure. Spearman’s Rank Correlation Test was used to quantify the correlation and its strength between each of the averaged SVAP scores and each mean measurement for the water quality parameters for each visit (n = 2), across streams (n = 4). Spearman’s correlation converts raw data into ranks and then calculates the correlation coefficient to quantify the strength (0–1) and direction (positive or negative) of the relationship (Sokal and Rohlf 2012). Importantly, Spearman’s correlation is a non-parametric test, making it robust to outliers and data that are not normally distributed. We analyzed data and created graphs in R Studio (R version 4.3.3, R Project for Statistical Computing, Vienna, Austria) using the packages “tidyverse,” “ggcorrplot,” “corrplot,” and “Hmisc.” The data and Rscript are available in the Dryad data repository (https://doi.org/10.5061/dryad.7m0cfxq89).

Results

SVAP metrics

Overall SVAP scores per site were highest for House Creek, ranging from 7.2 to 8.1 among the three sites, indicating good stream habitat (Fig 3). Walnut Creek sites were also fairly consistent, with overall scores among sites ranging from 6.0 to 6.7. The other two streams were characterized by highly variable overall SVAP scores: Rocky Branch scores ranged from 4.6 to 6.8, with high variability in scores between the two sampling dates for the first and third sites. Low hydrologic alteration drove the higher overall score at RB_B compared to RB_A and RB_C. The high variability at RB_A and RB_C likely reflects variation in SVAP scoring. Only 0.25 cm of rain fell between October 24–31, so it is unlikely that differences in channel condition, hydrologic alteration, bank stability, and invertebrate cover were driven by storm runoff from Pullen Road and Morrill Drive, respectively.

thumbnail
Fig 3. Overall SVAP score per site.

Each stream site (4 streams: HC, House Creek; RB, Rocky Branch; RC, Richland Creek; WC, Walnut Creek; n = 3 sites per stream) was visited twice during 24 October through 14 November 2024. Overall scores for each site within a stream were calculated by averaging the scores for all 10 SVAP factors. Note that the overall score for HC site C was the same for both visits.

https://doi.org/10.1371/journal.pone.0351972.g003

Richland Creek overall scores ranged from 4.1 to 7.4 per site. While individual site scores were consistent across sample dates, sites were highly variable (≤ 4.5 for RC_A and RC_C, compared to 7–7.4 for RC_B). Site RC_A receives extensive surface runoff as well as inflow from a culvert from Wade Avenue during storm events, and the bank was reinforced in 2023 after a cave-in. These anthropogenic impacts drove low scores for riparian zone, hydrologic alteration, channel condition, bank stability, pools, and instream fish cover. Similarly, RC_C is immediately downstream of the northern egress of an extensive paved tunnel beneath Wade Avenue, which introduces substantial stormwater input and drives low scores for the same SVAP factors.

Measured physical and water quality parameters

The four streams averaged 22–40 cm in depth and differed substantially in both flow rate (means 0.01 m/s in Rocky Branch to 0.23 m/s in Walnut Creek) and canopy cover (means 45% over Walnut Creek to 86% over House Creek) (Table 3). Mean temperatures among the streams varied from 13.6 to 19.1oC, with House Creek being coolest and Walnut Creek warmest.

thumbnail
Table 3. Measured physical and water quality parameters for the four urban streams (means ± standard error, ranges; data rounded to nearest significant decimal; satn. = saturation). Asterisks (*) denote values that exceed evaluation levels.

https://doi.org/10.1371/journal.pone.0351972.t003

Walnut Creek was substantially more acidic than the other streams, with a mean pH (6.84) ~0.4 to 0.6 units below the mean pH of the others. Stream turbidity was low when sampled in the absence of storm events. While DO concentrations, as measured during late morning, indicated adequate oxygen for beneficial fauna such as fish, the percent saturation suggests that biota in these streams sustain unhealthy conditions of low-oxygen stress during diel cycles [33]. Enterococcus densities ranged from 91 to 479 CFU 100 mL-1, except that samples collected on 7 November from Richland Creek and Walnut Creek measured 1120 and 1553 CFU 100 mL-1, respectively. The data suggest fecal contamination, as Enterococcus densities were well in excess of North Carolina water quality standard for freshwater human contact based on fecal coliform bacteria (200 CFU100 mL-1 as a geometric mean; single sample maximum of 400 CFU 100 mL-1) [32].

Spearman’s Correlations (ρ): SVAP scores versus measured physical or water quality parameters

The measured physical environmental characteristics correlated strongly with several SVAP metrics (Fig 4, Table 4). Average depth correlated negatively with riparian zone (ρ = –0.715, p = 0.046), instream fish cover (ρ = –0.778, p = 0.023), pools (ρ = –0.747, p = 0.033), invertebrate habitat (ρ = –0.881, p = 0.004), and overall score (ρ = –0.738, p = 0.037). Flow rate correlated positively with pools (ρ = 0.723, p = 0.043) and invertebrate habitat (ρ = 0.714, p = 0.047). Average canopy cover correlated positively with hydrologic alteration (ρ = 0.723, p = 0.043).

thumbnail
Table 4. Significant Spearman correlations (ρ) between SVAP metrics and measured average physical or water quality parameters. Correlations in bold were predicted (Table 2). Asterisks (*) indicate that the direction of the correlation (positive or negative ρ value) supports the prediction.

https://doi.org/10.1371/journal.pone.0351972.t004

thumbnail
Fig 4. Spearman’s correlations (ρ) between visual metrics from SVAP metrics (horizontal axis) and measured physical (Phys.) characteristics or water quality (WQ) parameters (vertical axis), collected from the four urban streams.

The size of each circle reflects the ρ value. Color indicates positive (red) or negative (blue) correlation; asterisks denote statistical significance (p < 0.05).

https://doi.org/10.1371/journal.pone.0351972.g004

In contrast, few strong correlations were found between measured water quality parameters and SVAP metrics. Turbidity was negatively correlated with hydrologic alteration (ρ = –0.723, p = 0.043) and nutrient enrichment (ρ = –0.805, p = 0.016). Conductivity (ρ = 0.771, p = 0.025) and TDS (ρ = 0.771, p = 0.025) were positively correlated with water appearance.

Discussion

This study represents, to our knowledge, the first attempt to compare SVAP scores to measured physical and water quality data. The analyses yielded strong and significant SVAP correlations between both physical and water quality parameters (Table 4, Fig 4). However, among 121 potential correlations (11 SVAP scores x 11 water quality metrics), we detected only 12 significant relationships (9.9% of total potential utility). While our hypothesis was generally supported, physical characteristics are more robust predictors of SVAP metrics compared to water quality parameters (Table 4).

Average depth was the strongest predictor of SVAP scores, correlating negatively with riparian zone, instream fish cover, pools, and invertebrate habitat (Fig 4). This robust relationship likely reflects the ecological consequences of channelization and flashiness in urban streams. Interestingly, flow rate correlated positively with pools and invertebrate habitat, suggesting that water speed and depth incur distinct impacts on stream ecology. Canopy cover only correlated significantly with hydrologic alteration, similar to previous findings, confirming that it does not always correlate with greater stream health [34]. While TDS and conductivity correlated positively with water appearance, turbidity correlated negatively with hydrologic alteration and nutrient enrichment. Our results suggest that deeply incised channels and prevention of natural flooding events (that result in low hydrologic alteration) may increase the cloudiness of water but not its conductivity.

While riparian zones are crucial for filtering pollutants in runoff [35], we found no significant correlation between riparian zone and any physical or water quality scores except average depth – nor did Enterococcus measurements correlate with any SVAP scores (Fig 4). Enterococcus fecal bacteria are considered an important and reliable predictor of health risk associated with polluted recreational waters [36,37]. Enterococcus are used as fecal indicator bacteria because they originate from the guts of warm-blooded animals [38]; and increased levels of Enterococcus are associated with anthropogenic activity [39,40]. While we predicted that Enterococcus would correlate negatively with riparian zone, bank stability, water appearance, and positively with nutrient enrichment (Table 2), we detected no significant correlations between Enterococcus levels and any of the SVAP scores (Fig 4). Additional research is needed to increase sampling across time points, seasons, and additional streams to verify whether Enterococcus might correlate with SVAP scores.

Our findings underscore a fundamental need for water quality data as well as physical habitat data in assessments of stream health. Bjorkland et al. [2] found poor agreement between SVAP and NH4-N, NO3-N, and PO4-P for 9 sites assessed in Georgia. Carrie et al. [13] previously found that SVAP correlates strongly and positively with canopy cover across stream sites in Belize; but Principal Coordinate analysis relationships with depth, turbidity, pH, temperature, and DO were more ambiguous. Some major consulting firms currently use only habitat scores (the foundation of the SVAP) to assert that water quality is acceptable – despite the fact that physical appearance commonly does not translate to good water quality. For example, “water appearance” (color/murkiness) may not convey visible information about water quality except for relatively extreme physical conditions. Similarly, “nutrient enrichment” based on noticeable algal/plant growth does not distinguish whether the algal/plant growth is healthy or noxious and over-stimulated by nutrient pollution; benthic algae in particular can appear “overly abundant” when it is in fact healthy growth of beneficial taxa [41].

Limitations

The few significant correlations between physical and water quality measures and SVAP scores in the current study could be attributed to several confounding variables, including limited sample size and variation due to weather events and SVAP observer subjectivity. Many pollutants enter streams shortly after a rainstorm begins, resulting in short-lived “spikes”. It often takes concerted, repeated sampling to catch these spikes, whereas storm-driven physical changes may be short-lived (e.g., water appearance) or persist longer (e.g., channel condition, bank stability) in the landscape. In addition, chemical stressors such as conductivity, bacterial contamination, and diel dissolved oxygen fluctuations are visibly imperceptible. We also noticed variation in overall SVAP scores between visits to each site (Fig 3), which may have resulted from weather events between visits or from inter-individual score variation. Researchers within randomized teams assigned different individual SVAP scores at each visit, and required extensive discussion to reach consensus scores for each site. As such, our limited sampling effort (2 dates at 4 streams in 1 season) may have prevented detection of genuine relationships.

Overall, we found that the SVAP alone is not a sufficient measure of stream health in urban streams, and is mostly useful as an introduction to water quality analysis or as an educational tool [2]. Because SVAP scoring involves subjective visual estimates, some variability among observers was expected. This underscores the importance of validation and calibration to ensure that the protocol can be applied reliably by students or citizen scientists.

Future directions

The SVAP could be used together with one or more available water quality indices for stream assessment. There is a rich literature on the utility of various indices as composite indicators of river water quality that can be easily communicated and used as assessment, management, and predictive tools [42]. These water quality indices vary from inclusion of many to only a few parameters such as dissolved oxygen, conductivity, and turbidity [43].

Future studies with increased sample size across seasons could also measure score variability to assess observer bias and the reproducibility of SVAP scores across a diverse range of users. Additionally, we suggest an expansion and further integration of the glossary of the SVAP, as some technical terms were left undefined (e.g., “scarp”), adding complexity to vocabulary that potentially renders stream ecology less accessible to the public. We propose providing a definition at the first occurrence of each technical term in the SVAP, as well as visual training examples to help users score more accurately. While the SVAP2 includes clearer instructions with some pictures and tables [8], both protocols could be revised to include scores for each SVAP factor for the example pictures provided for each element, to ensure more consistent scoring between individuals in informal settings and across sites. In the meantime, water quality studies to inform the development or modification of regulations should continue to use traditional water quality measurements.

Conclusions

The NRCS SVAP, based on physical features, is widely used as an initial screening technique to assess the general condition of wadeable streams, and mostly has been compared to macroinvertebrate indicators of stream health. General water quality has been inferred in the SVAP by the general physical attributes of color, turbidity, and obvious algal growth. We compared SVAP scores to actual water quality data and found that while correlations with measured physical characteristics were strong as expected (8 significant correlations, between 6 SVAP metrics and 3 physical parameters), only 3 water quality parameters correlated significantly with 3 SVAP scores. Notably, while Enterococcus and DO (mg/L) values exceeded evaluation standards, neither of these water quality parameters correlated with SVAP scores (Fig 5). Countering our initial expectation, the findings suggest that the SVAP should not be used to infer water quality conditions.

thumbnail
Fig 5. SVAP scores did not predict water quality, particularly Enterococcus (CFUs/100mL) levels.

Here we feature Richland Creek site A (credit: N. Patterson) and House Creek site C (credit: C. McMurray), representative of relatively low and high SVAP scores, respectively (S1 Table).

https://doi.org/10.1371/journal.pone.0351972.g005

As suggested improvements to the SVAP, future studies with increased sample size could track score variability to improve assessment of observer bias and the reproducibility of SVAP scores across a diverse range of users (e.g., age groups, landowners, recreationists). The SVAP glossary could be amended to include definitions of some technical terms to strengthen general understanding about SVAP application. It would also be helpful to provide a definition at the first occurrence of each technical term in the SVAP, and visual training examples to help users score more accurately. SVAP2 includes clearer instructions with some pictures and tables [8], but protocols could be further revised to include scores for each SVAP factor for the example pictures of each element, to promote more consistent scoring between individuals in informal settings and across sites. These improvements would not change our central conclusion: The SVAP alone should not be used to infer water quality; inferences about water quality should be based on traditional water quality measurements.

Supporting information

S1 Table. Explanation of SVAP guidelines [7] and examples of assigned scores, as interpreted in the current study.

https://doi.org/10.1371/journal.pone.0351972.s001

(DOCX)

Acknowledgments

We are thankful for support from The Data Science Consulting Program at NC State University, a joint effort between the Libraries’ Department of Data & Visualization Services and the Data Science & AI Academy. We are also grateful to Barbara Moranta (Engineering Services, Raleigh Stormwater Section) for helping to describe the Rocky Branch Creek watershed, and to Garrett Sumner (NC State College of Natural Resources, Forest Assets) for verifying the date of the Richland Creek bank reinforcement.

References

  1. 1. Barnhart B, Flinders C, Ragsdale R, Johnson G, Wiegand P. Deriving Human Health and Aquatic Life Water Quality Criteria in the United States for Bioaccumulative Substances: A Historical Review and Future Perspective. Environ Toxicol Chem. 2021;40(9):2394–405. pmid:34062012
  2. 2. Bjorkland R, Pringle CM, Newton B. A stream visual assessment protocol (SVAP) for riparian landowners. Environ Monit Assess. 2001;68(2):99–125.
  3. 3. Environmental Protection Agency US. Chapter 3: Water quality criteria. Water quality standards handbook. US Environmental Protection Agency, Office of Water Regulations and Standards. 2023.
  4. 4. Krismastuti FSH, Hamim N, Hindayani A. Indonesian proficiency testing for electrolytic conductivity measurement of synthetic wastewater: a comparison of performance evaluation based on four standardized performance statistics. Accred Qual Assur. 2023;28(1):1–9.
  5. 5. Rutherford JC, Davies-Colley RJ, Meleason MA. Modelling stream shade: 1. Verifying numerical simulations with measurements on simple physical models. Ecol Eng. 2018;120:441–8.
  6. 6. Rossi GJ, Mierau DW, Carah JK. Hydraulic Properties of the Riffle Crest and Applications for Stream Ecosystem Management. J American Water Resour Assoc. 2021;57(6):923–40.
  7. 7. Natural Resources Conservation Service (NRCS). Stream Virtual Assessment Protocol. Portland, OR: NRCS, USDA, National Water and Climate Center. 1998.
  8. 8. Natural Resources Conservation Service. Stream Visual Assessment Protocol Version 2. Portland, OR: NRCS, USDA, National Water and Climate Center. 2009.
  9. 9. Ward TA, Tate KW, Atwill ER, Lile DF, Lancaster DL, McDougald N, et al. A comparison of three visual assessments for riparian and stream health. Journal of Soil and Water Conservation. 2003;58(2):83–8.
  10. 10. Doll B, Jennings G, Spooner J, Penrose D, Usset J, Blackwell J. Can rapid assessments predict the biotic condition of restored streams?. Water. 2016;8(4):143.
  11. 11. Iakovoglou V, Koutsoumis A, Zaimes GN, Emmanouloudis D. Using the Stream Visual Assessment Protocol (SVAP) to Evaluate the Streams and Their Riparian Areas of Lake Volvi in Greece. 2013. 1139–46.
  12. 12. Moraa GZ. Effects of human activities on water quality and macroinvertebrates along Nyangores Stream, Mara River Basin, Kenya. Eldoret, Kenya: University of Eldoret. 2013.
  13. 13. Carrie R, Dobson M, Barlow J. The influence of geology and season on macroinvertebrates in Belizean streams: implications for tropical bioassessment. Freshw Sci. 2015;34(2):648–62.
  14. 14. Carlson J, Sheley C, Sidhu R, Case S, David O. Microservices for the Stream Visual Assessment Protocol (SVAP). Int Congr Environ Model Softw. 2018.
  15. 15. Paul MJ, Meyer JL. Streams in the Urban Landscape. Annu Rev Ecol Syst. 2001;32(1):333–65.
  16. 16. Coles JF, McMahon G, Bell AH, Brow LR, Fitzpatrick FA, Eikenberry BCS, et al. Effects of Urban Development on Stream Ecosystems in Nine Metropolitan Study Areas Across the United States. Reston, VA: United States Geological Survey. 2012. https://pubs.usgs.gov/circ/1373/
  17. 17. Francis RA. Urban rivers: novel ecosystems, new challenges. WIREs Water. 2013;1(1):19–29.
  18. 18. Capps KA, Bentsen CN, Ramírez A. Poverty, urbanization, and environmental degradation: urban streams in the developing world. Freshw Sci. 2016;35(1):429–35.
  19. 19. Graves G. Freshwater Stream Monitoring Process Improvements for Fecal Indicator Impairment Designation. University of Oklahoma. 2023. https://shareok.org/handle/11244/337499
  20. 20. North Carolina’s municipalities among fastest growing in the nation. NC OSBM Blog. 2025. https://www.osbm.nc.gov/blog/2025/05/16/north-carolinas-municipalities-among-fastest-growing-nation
  21. 21. Burkholder JM, Kinder CA, Dickey DA, Reed RE, Arellano C, James JL, et al. Classic indicators and diel dissolved oxygen versus trend analysis in assessing eutrophication of potable-water reservoirs. Ecol Appl. 2022;32(4):e2541. pmid:35072953
  22. 22. Burkholder JM, Kinder CA, Allen EH. Watershed Development and Eutrophying Potable Source-Water Reservoirs in a Warming Temperate/Subtropical Region. Water. 2023;15(22):4007.
  23. 23. Boggs JL, Sun G. Urbanization alters watershed hydrology in the Piedmont of North Carolina. Ecohydrology. 2011;4(2):256–64.
  24. 24. Ackall YP, Lopez KM, Onuoha PC, van Praag ME. Effects of Urbanization on a North Carolina Piedmont Stream. IJHSR. 2022;4(5):126–36.
  25. 25. Sumner G. Forest Manager, College of Natural Resources- Forest Assets, NC State University. 2025.
  26. 26. Rocky Branch & Central Walnut Creek Watershed. https://raleighnc.gov/stormwater/services/find-your-watershed/rocky-branch-central-walnut-creek-watershed
  27. 27. Strahler AN. Quantitative geomorphology of drainage basin and channel networks. Handbook of Applied Hydrology. New York: McGraw Hill. 1964.
  28. 28. Wetzel RG, Likens G. Limnological Analyses. Springer Science & Business Media. 2000.
  29. 29. Whitton BA. River Ecology. University of California Press. 1975.
  30. 30. Burkholder JM, Glibert PM. Eutrophication and Oligotrophication. Encyclopedia of Biodiversity. Elsevier. 2013. 347–71.
  31. 31. Mallin MA, Cahoon LB. The Hidden Impacts of Phosphorus Pollution to Streams and Rivers. BioScience. 2020;70(4):315–29.
  32. 32. NC DEQ. Classifications and water quality standards applicable to surface waters of North Carolina. Sections 15A NCAC2-B.0100 and 15A NCAC2B.0200. Raleigh, NC, USA. 2016. http://reports.oah.state.nc.us/ncac/title%2015a%20-%20environmental%20quality/chapter%2002%20-%20environmental%20management/subchapter%20b/subchapter%20b%20rules.pdf
  33. 33. Ali B, Mishra A. Effects of dissolved oxygen concentration on freshwater fish: A review. Int J Fish Aquat Stud. 2022;10(4):113–27.
  34. 34. Alberts JM, Beaulieu JJ, Buffam I. Watershed Land Use and Seasonal Variation Constrain the Influence of Riparian Canopy Cover on Stream Ecosystem Metabolism. Ecosystems. 2017;20(3):553–67. pmid:30416371
  35. 35. Pusey BJ, Arthington AH. Importance of the riparian zone to the conservation and management of freshwater fish: a review. Mar Freshw Res. 2003;54(1):1–16.
  36. 36. Cabelli VJ, Dufour AP, McCabe LJ, Levin MA. Swimming-associated gastroenteritis and water quality. Am J Epidemiol. 1982;115(4):606–16. pmid:7072706
  37. 37. Scott TM, Rose JB, Jenkins TM, Farrah SR, Lukasik J. Microbial source tracking: current methodology and future directions. Applied and Environmental Microbiology. 2002;68(12):5796–803.
  38. 38. Surbeck CQ, Jiang SC, Grant SB. Ecological control of fecal indicator bacteria in an urban stream. Environ Sci Technol. 2010;44(2):631–7. pmid:20028091
  39. 39. Byappanahalli MN, Nevers MB, Korajkic A, Staley ZR, Harwood VJ. Enterococci in the environment. Microbiol Mol Biol Rev. 2012;76(4):685–706. pmid:23204362
  40. 40. Ibekwe AM, Obayiuwana AC, Murinda SE. Enterococcus Species and Their Antimicrobial Resistance in an Urban Watershed Affected by Different Anthropogenic Sources. Water. 2023;16(1):116.
  41. 41. Stancheva R, Sheath RG. Benthic soft-bodied algae as bioindicators of stream water quality. Knowl Manag Aquat Ecosyst. 2016;(417):15.
  42. 42. Gitau MW, Chen J, Zhao M. Water quality indices as tools for decision making and management. Resour Manage. 2016;30:2591–610.
  43. 43. Pesce SF, Wunderlin DA. Reply to comment on “Use of water quality indices to verify the impact of Cordoba city (Argentina) on Suquia River”. Water Res. 2002;36(19):4940–1. pmid:12448539