https://orcid.org/0000-0003-2541-1829
Figures
Abstract
Progressively more community initiatives have been undertaken over last decades to monitor water quality. Biological data collected by volunteers has been used for biodiversity and water quality studies. Despite the many citizen science projects collecting and using macroinvertebrates, the number of scientific peer-reviewed publications that use this data, remains limited. In 2018, a citizen science project on biological water quality assessment was launched in the Netherlands. In this project, volunteers collect macroinvertebrates from a nearby waterbody, identify and count the number of specimens, and register the catch through a web portal to instantaneously receive a water quality score based on their data. Water quality monitoring in the Netherlands is traditionally the field of professionals working at water authorities. Here, we compare the data from the citizen science project with the data gathered by professionals. We evaluate information regarding type and distribution of sampled waterbodies and sampling period, and compare general patterns in both datasets with respect to collected animals and calculated water quality scores. The results show that volunteers and professionals seldomly sample the same waterbody, that there is some overlap in sampling period, and that volunteers more frequently sampled urban waters and smaller waterbodies. The citizen science project is thus yielding data about understudied waters and this spatial and temporal complementarity is useful. The character and thoroughness of the assessments by volunteers and professionals are likely to differentiate. Volunteers collected significantly lower numbers of animals per sample and fewer animals from soft sediments like worms and more mobile individuals from the open water column such as boatsmen and beetles. Due to the lack of simultaneous observations at various locations by volunteers and professionals, a direct comparison of water quality scores is impossible. However, the obtained patterns from both datasets show that the water quality scores between volunteers and professionals are dissimilar for the different water types. To bridge these differences, new tools and processes need to be further developed to increase the value of monitoring biological water quality by volunteers for professionals.
Citation: Peeters ETHM, Gerritsen AAM, Seelen LMS, Begheyn M, Rienks F, Teurlincx S (2022) Monitoring biological water quality by volunteers complements professional assessments. PLoS ONE 17(2): e0263899. https://doi.org/10.1371/journal.pone.0263899
Editor: Emmanuel S. Boss, University of Maine, UNITED STATES
Received: July 27, 2021; Accepted: January 30, 2022; Published: February 25, 2022
Copyright: © 2022 Peeters et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: all relevant data are available from the Dryad database (https://doi.org/10.5061/dryad.ghx3ffbpf).
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Although there are various levels of involvement of volunteers in science projects [1, 2], most citizen science projects focus on generating data and information about the quality of their surrounding environment. As such, volunteers can contribute to the more traditional way of environmental monitoring by professionals resulting in a combined database of greater temporal and spatial scale [3, 4]. According to the UN, citizen science will be crucial for monitoring the progress of a number of the Sustainable Development Goals (SDG) [5, 6]. Furthermore, the collected data through volunteers will also become essential in the UN Sustainable Development Goals reporting [7]. Among others, SDG 6 (clean water and sanitation) is expected to greatly benefit from volunteer participation [8, 9]. Additionally, the European Water Framework Directive encourages the involvement of interested parties in the implementation of the Directive [10, 11] and among the EU citizens there are many that want to provide input, expertise, time and even money to help protect fresh waters [12].
Observations on the natural environment have been recorded by amateurs already for a very long time [13, 14]. The attention for this kind of observations has increased enormously in the last decades as a result of technical developments that facilitated communication among involved partners and lowered the costs of required equipment for data collection [15]. Within the field of ecology, observations by non-trained volunteers on e.g. distribution and phenology of animals and plants have been performed for centuries [13]. Most biological observations by volunteers contribute to research related to biodiversity and species richness [4]. While volunteers can contribute valuable data, trained observers are required for identifying specimens to the species or genus level [16], a level that is needed for most biodiversity investigations. Interestingly, several examples show that biodiversity inventories made by volunteers can impact policy and decision making [17].
In the field of water quality, multiple citizen science projects have been set up and carried out. Several projects were developed to monitor abiotic conditions in waterbodies such as nutrients in urban waterways [18] or in agricultural streams [19], oxygen in streams [20], hydrology [21], colour of water [22], bacteriological water quality [23] and microplastics [24] or a combination of different abiotic variables [25–27]. The first use of aquatic macroinvertebrates in a volunteer monitoring program probably dates back to the mid 1970s [28]. Anglo-Saxon countries in particular, regularly include macroinvertebrates in volunteer monitoring programs for example, approximately 50% of the 1700 volunteer water monitoring programs in the USA (http://volunteermonitoring.org/) (personal comment K. Stepenuck), in the British Anglers’ Riverfly Monitoring Initiative [29], and in the New-Zealand Wai Care program [30]. Although scientific publications exist that make use of data collected by volunteers [e.g. [29, 31–33], their number is still limited.
More than a century ago Kolkwitz & Marsson [34, 35] developed the concept of bioindicators for assessing the quality of water. Macroinvertebrates have been regarded as good bioindicators among others because they occur worldwide in different water systems, are rich in species with much variation in their response to environmental conditions, integrate effects of multiple stressors and integrate effects of stressors over time [36–38]. Several biotic indices have been developed in which the presence of bioindicators was used to assess water quality with and without combination of a measure of species richness such as the Trent Biotic Index (TBI) [39], the Biological Monitoring Working Party (BMWP) [40], the Hilsenhoff biotic index [41], the Belgian Biotic Index (BBI) [42], or the South African Scoring System (SASS) [43]. However, changes in environmental conditions are reflected in a changed composition of the whole macroinvertebrate community and not only in the presence or absence of the bioindicators [44]. The use of the relative abundance of macroinvertebrates is, therefore, considered more sensitive to subtle changes in water quality. As a result, other assessment tools have been developed that included the relative amount or abundance of indicators e.g. [44–47]. The use of macroinvertebrates as a tool for the assessment of water quality has been much more applied in running waters than in standing waters (lakes & ponds) where phytoplankton has been the most important biological group to evaluate the biological quality. Macroinvertebrate assessment tools that can be applied to multiple freshwater types are very scarce.
In many countries, monitoring biological or ecological water quality is legally tasked to water authorities. In the Netherlands, regional water authorities have a long tradition in collecting data on plant and animal life and abiotic conditions in waterbodies. The Dutch water authorities are responsible for the surface water quality in their respective management areas and are responsible to determine, maintain and improve the water quality in regards to the European Water Framework Directive (WFD) [11]. A nationally determined and accepted methodology is used to classify a water system from excellent to very bad upon macroinvertebrate species and abundances, tailored to water type (e.g. river, small lake or ditch). For this WFD mandated monitoring, locations are chosen to represent larger watersheds and timing of sampling is in accordance with the guidelines. Accredited labs that supply the water authorities with these data implement the national quality assurance protocol to assure high quality of data. These data are then used for assessment and reporting of water quality to the EU in accordance with the EU Water Framework Directive guidelines [48]. The collected information is stored in large databases and made publicly available.
In 2018, a citizen science project on biological water quality assessment by means of macroinvertebrates was launched in the Netherlands. The purpose of this project was to engage citizens in water quality and to obtain a nationwide overview of the water quality in the various water types based on data provided by volunteers. Identifying water animals at the species level is not easy and therefore, a biological assessment tool for the general public cannot rely on the level of identification as applied by experts. To involve volunteers in biological water quality assessment, the level of identification should be limited [31, 49] as is, for example, the case with the British Freshwater name trail [50]. This name trail lists more than 40 taxa on a chart together with clues to identify them and is highly suitable for untrained persons. In the Dutch project, volunteers or school classes may collect macroinvertebrates in a nearby surface water, identify and count the number of specimens, and register the catch at the website ‘Waterdiertjes.nl’. It is suggested to collect minimally 50 individuals. To receive as much contributions from volunteers as possible no strict guidelines or regulations regarding sampling have been provided but a very general description is available. Once a volunteer has uploaded the list of species with associated counts, the web application calculates a water quality score based on the information provided and sends this back to the volunteer as a reward. Furthermore, new assessments are together with all available assessments immediately displayed on a map covering the whole country. A small team of experts regularly evaluates the provided data by checking geographical positions, provided written texts, and listed counts of collected animals. In case a sampling is considered strange, it receives a flag and is no longer displayed on the map. Since the project has been running for 3 years now, a considerable amount of data is available for a comparison with data from professionals. Such comparative analyses have been performed previously for, among others, mosquitos in Germany [51], marine debris [52], attributes of vegetation [53], corals [54] and chemical water quality [18, 55, 56], but are relatively scarce for biological water quality monitoring [31]. Here, we compare data collected by volunteers in an unstructured way with those collected according to quality protocols by professionals employed at regional water authorities by focussing on (1) the spatial and temporal distribution of the samplings, (2) the investigated water types and patterns in both datasets with respect to (3) calculated water quality scores and (4) the sampled macroinvertebrate communities. Such a comparison might on the one hand show complementarity and the benefit for professionals of using volunteer data and on the other hand might provide clues to improve the quality of the volunteer data which may thereafter become beneficial for the monitoring by the volunteers. We also present the tool that volunteers use for assessing the biological water quality.
Material and methods
Data selection for present study
The data collected by volunteers by scooping and sorting in the period 2018–2020 was retrieved from the website Waterdiertjes.nl and included at least the geographical position of the sampling, date, user-ID, counts of the macroinvertebrate taxa, and water type. The list of included macroinvertebrate taxa is presented in Table 1.
Data from professionals is stored on the freely available website ‘waterkwaliteitsportaal.nl’ and included the geographical position of the sampling, date, abundance of macroinvertebrates, and a description of water type. Only macroinvertebrate recordings from the period 2013–2019 were retrieved that were collected following the multihabitat approach [57] with a standardized sampling length of 5 m. Furthermore, the geographical information from 2011–2019 was also retrieved. Since the classification of water types used by the professionals was more detailed, this typology was adjusted to the one from the citizen science project (Table 2). Also, the taxonomic level of identification by the professionals was adjusted to the one used in the citizen science project (see Table 1).
Data analyses
General characteristics of professional and citizen science data.
The mean yearly number of observations was determined for both datasets to compare the efforts of both volunteers and professionals. The degree of participation in the citizen science project was determined by counting the number of unique user-IDs. Since season may be important for water quality assessment, the number of samples per month were calculated and compared between professionals and volunteers.
Available coordinates of the locations from both the professionals and the volunteers were used to calculate the distances between a citizen science location and all professional locations and the shortest distance was determined. For this analysis, all citizen science locations were used and all locations visited by the professionals between 2011 and 2019 because various authorities have a 3 years cycling monitoring program. A frequency distribution of these shortest distances was made.
To investigate whether volunteers sample different water types than professionals, the number of samples per water type were counted and compared between professionals and volunteers. Fisher’s Exact Test [58] was used to test whether differences in observed frequencies were significant.
Characteristics of collected macroinvertebrates.
Mean number of individuals per sample caught was calculated for both datasets. A Generalized Linear Model (GLM) [59] with total number of individuals per sample as dependent variable and collector, professional or volunteers, as independent variable and with a Poisson distribution and log link was used to evaluate the significance of this difference.
For each taxon, the main habitat of occurrence (soft sediment, solid substrate, open water column, water surface) was determined using [60] and taxa were classified after their mobility in classes (slow, moderate, fast) using [61] (Table 1). Total number of individuals per habitat and per mobility class were determined as well as the relative distribution. Fisher’s Exact Tests [58] were used to evaluate whether the distribution over the habitat and mobility classes were significantly different between the citizen science and professional data.
Biological water quality assessment by volunteers.
Based on the macroinvertebrate taxa present on the British Macrofauna name trail [50], a biological assessment system has been developed that should be applicable in all kinds of freshwaters in the Netherlands. Therefore, each macroinvertebrate taxon was assigned a water quality score (Table 1). These scores and the counts are used to calculate the overall (weighted average) Citizen Science Water Quality (WQcs) sample score:
With ni = number of individuals belonging to water quality class i
i = water quality indication with 1 = very bad; 2 = poor; 3 = moderate, 4 = good; 5 = excellent
The WQcs score ranges between 1 and 5 and this range is divided in five quality classes, being very bad (score 1–1.8), poor (1.8–2.6), moderate (2.6–3.4), good (3.4–4.2) and excellent (4.2–5.0).
A web application was developed in which both the taxa from the British Freshwater name trail [50] and the score for water quality were included (https://waterdiertjes.nl). Each macroinvertebrate taxon is represented by a drawing in the WebApp and counts of the collected animals can be registered per taxon. When all collected animals have been entered, the total list of recordings can be uploaded together with additional information like geographical location and water type. Immediately thereafter, the WQsc will appear on the screen. Data is stored in a database which is freely accessible and available.
The WQsc was also calculated for the data obtained by the professionals for the period 2013–2019. In order to find out whether the frequency distributions over the quality classes were significantly different, Fisher’s Exact Tests [58] were applied per water type.
All analyses were performed in IBM SPSS Statistics 25.
Results
General characteristics of professional and citizen science data
In the period 2018–2020, volunteers collected macroinvertebrates in 1646 occasions (on average 550 per year). In total 1339 unique locations were sampled. Based on unique user-IDs, a maximum number of 300, 322 and 586 volunteers participated in 2018, 2019 and 2020 respectively. A total of 1150 unique user-IDs (individuals and/or small groups) supplied data over the three years. Professionals from regional water authorities collected 6103 samples in freshwater ecosystems in the period 2013–2019 with more than 1000 samples per year in the last four years.
The majority of the locations sampled by volunteers was within 1 km distance from locations sampled by professionals (Fig 1) and the maximum distance was 5.5 km. Only a tiny fraction (n = 32) of the volunteers’ locations was in real close vicinity (< 50 m) of locations sampled by professionals.
The total number of samples per month varied largely throughout the year and this pattern was quite stable for the professionals with the majority of samples taken in April and May (Fig 2). Volunteers collected most samples in May and June but also in September and October in 2020 (Fig 2).
Since the pattern for the professionals was quite stable only the last three years (2017–2019) were plotted.
Volunteers took their samples primarily in ditches, ponds & lakes and urban waters while flowing waters and canals were underrepresented (Fig 3). In contrast, professionals sampled mostly in streams, ditches and canals. Observations by professionals in the urban environment were very limited. City and garden ponds were hardly sampled by professionals while volunteers sampled these relatively small systems much more frequently. The distribution of the samples over the different water types is significantly different between professionals and volunteers. A Fisher’s Exact Test showed that for all water types the number of observations differed significantly (Chi-Square = 443.955, df = 8, p ≤ 0.001) between professionals and volunteers except for lakes (SI Appendix in S1 File).
Information on water type was missing for roughly 12% of the professional locations.
Characteristics of collected macroinvertebrates
Volunteers collected less individuals from the included taxa per sample than professionals (on average 61 and 1145 respectively) and this difference was significant (GLM: Wald Chi-Square = 851816.23, d.f. = 1, p<0.001).
Professionals caught more animals that inhabit soft sediments than volunteers who reported much more animals from the open water column or surface of the waterbodies in their samples (Fig 4A). A Fisher’s Exact Test based on the percentage distribution over the habitats showed that all differences between professionals and volunteers were significant except for solid substrate (Chi-square 27.495; df = 3; p<0.001). Volunteers also had relatively more mobile specimens in their samples than professionals (Fig 4B). A Fisher’s Exact Test based on the distribution over the mobility classes showed that especially the differences between the proportion of fast-moving animals was significant (Chi-squared 6.063; df = 2; p = 0.049).
An * indicates that the difference is significant.
Biological water quality assessment by volunteers
According to the WQcs scores, a relatively small proportion of the samples had a very bad or excellent water quality both for the citizen science dataset as well as for the professional dataset (Fig 5). In comparison to the professionals, the citizen science dataset contained locations with a good quality more frequently while professionals had larger fractions of moderate or poor quality. Approximately 30 to 60% of the samples collected by volunteers indicated a good or excellent quality while this was between 5 and 30% for the professionals (depending on the water type). In general, the proportion of waterbodies sampled by volunteers that had an excellent quality was below 10% except for running waters (19%) and city canals (13%). WQcs scores from garden ponds and city canals showed to have both a relatively large amount of good and excellent quality as well as poor and very bad quality. The number of samples with a moderate quality is limited.
The Fisher’s Exact Test indicates that volunteers had more observations than expected in particularly the good water quality class and to a lower extend in the excellent quality class compared to professionals. Additionally, volunteers had fewer observations than expected for the poor and moderate quality class while this was completely the reverse for the professionals (SII Appendix in S1 File).
Discussion
The present study clearly indicates that only a very small fraction of the locations sampled by volunteers were in close vicinity of a location where professionals took samples in the last 10 years. Since the water system in the Netherlands is highly complex and branched, a distance of less than 50m between sampling points may still indicate physically separated waterbodies. Therefore, the comparisons show that volunteers indeed gather information on water quality at other geographical locations than professionals. Furthermore, volunteers more frequently investigated waters that are usually understudied by regional water authorities such as urban waters [62]. This study also shows that both professionals and volunteers collected animals mostly in spring, however, professionals started collecting data nearly two months earlier than volunteers. The peaks in number of samples in June in the volunteers data, are probably due to a yearly campaign of an NGO that invites children, parents and grandparents to collect water animals. Thus, both on the spatial and the temporal scale, the citizen science project yielded new data compared to the existing monitoring network carried out by professionals. This added value of citizen science has also been recognized in some previous studies like the monitoring of mosquitos in Germany [51], coastal mud crab in Finland [63], chemical water quality in England [64], and chemical water quality in combination with fish in temperate biomes [3]. Furthermore, monitoring by volunteers increases the number of observations [63] and is often regarded as a very cost-efficient way of gathering data for scientists [65–67]. Even though the monitoring by volunteers might seem cost-efficient, other hidden costs may add-up. For example, recruiting volunteers and keeping them interested in the long term requires staff with a dedicated amount of time and a specialization in marketing, education and communication [68, 69]. A citizen science platform like Waterdiertjes.nl cannot survive without sustained funding in the long run and this is a requirement to build up a long time series of data.
In 2020, twice as many observations were uploaded to the database than in previous years. Citizen science projects like the birdwatching project in South Africa [70] and City Nature Challenge in Tokyo [71] faced a lower degree of participation in 2020 due to covid-19. On the other hand, a European birdwatch project concluded that volunteers kept reporting birds but now more from home resulting in more observations in urban environments in the European countries UK, Italy and Spain and less in more remote areas [72]. The peak in the number of observations in June and autumn suggests that the covid-19 pandemic with many restrictions to minimize the spreading of the virus had a positive effect on people to explore their nearby environment and to participate in the project. Sampling waters in their own environment was still allowed as an activity for volunteers leading to a different use and experience of the blue-green space [73].
This study clearly shows that the monitoring by volunteers frequently include other water types than those routinely visited by professionals. Where professionals put a lot of effort in monitoring macroinvertebrates in streams, ditches and canals and to a lesser extend ponds, lakes and urban waters, volunteers focused their efforts more towards ditches, ponds, and especially to the urban environment. The focus on specific water types during special campaigns by NGOs may have led to more observations in these water types in the citizen database. It is well-known that macroinvertebrate community composition differs between water types [60] and thus sampling other water types by volunteers will generate more information about the regional quality of the aquatic environment for professionals.
Volunteers collected significantly less animals per sample than professionals. While professionals follow standard protocols (5m multihabitat sampling see e.g. [57]), it is very unlikely to expect volunteers will do the same since there are no instructions given to them with respect to sample size. Furthermore, equipment used by volunteers is frequently less sophisticated and presumably volunteers spent less time on the collecting process itself. Therefore, differences in tools, methods, available time and skills will contribute to the lower catches by volunteers. Furthermore, volunteers collected relatively more animals that were actively moving, probably because these animals attract their attention faster than those staying motionless or moving slowly. Professionals collected much more animals that live in and on (muddy) sediments while volunteers, on the other hand, caught more animals from the open water column and water surface. It seems, therefore, that volunteers incompletely sample the aquatic ecosystem and that they have little interest in sampling the soft sediments. As a result, this may hamper the added value of the data collected by volunteers to the professionals. Several studies have shown that training of volunteers may increase the accuracy and precision of citizen science phenological data [74, 75] and also specifically for aquatic macroinvertebrates [31]. However, a compulsory training usually comes at the cost of a lower degree of participation.
Many biological water quality assessment systems have been developed for specific water types like the BMWP for streams and rivers [40], and EcoFrame for lakes [45]. These systems require identification of macroinvertebrates down to the genus or species level, which is not realistic for untrained volunteers. The number of biological assessment systems that may be applied to all freshwater surface waters is still very limited. Here, a system is presented that can be used to assess the quality in a variety of aquatic ecosystems based on an identification level that doesn’t require trained amateurs or professionals but can be done by members of the general public. The quality of citizen science data is frequently questioned [76–79] and this is also relevant for the present citizen science project. Data provided on day of sampling and geographical coordinates is less prone to bias than collecting and identifying macroinvertebrates. Identification of the animals to higher taxonomic units, as is done in this project, certainly reduces possible faults and mistakes and this will contribute to a greater reliability of the data generated by the volunteers. Nevertheless, mistakes in identification are always possible and unavoidable, both for volunteers as well as for professionals. However, some taxa that might be difficult to distinguish from each other by unexperienced people like a swimming mayfly larva and a young damselfly larva, will not have a large impact on the calculated water quality score because both have the same indicator value. In addition, the reliability of the water quality outcome may also be increased when the total number of collected animals is taken into account. The higher the number of individuals included in the water quality calculation, the smaller the effect of minor errors in identification will be on the water quality score. Collecting a minimum number of animals by volunteers as is done in e.g. a Californian bio-survey [80] may increase the reliability of the quality score to a level comparable to professionals. Citizen science projects from other fields [31, 81, 82] show that such a professional level can be achieved. Volunteers in this project collected macroinvertebrates without strict protocols and this is frequently regarded as problematic for the quality of citizen science. However, lack of standardised sampling protocols and insufficient sample size is not unique to citizen science and is also problematic in regular sciences [83]. Despite these omissions, the information gathered by volunteers can still be very valuable for water managers. The volunteers’ observation that a species is present is more valuable than the notion of the absence a species since the latter is not a guarantee that the species is really absent. In the various biotic indices [39–42], the presence of listed key species is essential for the water quality assessment and not their absence. Thus, the volunteers’ registration of indicators of good or bad water quality can be valuable information for professionals.
The Dutch national Environmental Data Compendium classified the waters from the professionals based on macroinvertebrates and the professional assessment tool as 31% being excellent or good, 46% moderate, 21% poor and 1% very bad (PBL: https://www.clo.nl/en/indicators/en1438-quality-surface-water). This roughly corresponds with the general pattern in the citizen dataset (46% excellent or good, 37% moderate, 12% poor, 5% very bad). Interestingly, the water quality score (WQcs) for the data of the professionals, was in general lower than the water quality score based on the data collected by volunteers. A possible explanation for this pattern could be that volunteers more frequently sampled smaller waterbodies that usually are richer in species [84] and have a higher water quality. Another reason could be that this apparently overestimated quality by the volunteers correlates with the much lower amount of soft sediment inhabiting organisms collected by the volunteers. Those animals, like worms and midges, are usually indicators of bad water quality. If they are not recorded, this obviously results in a higher water quality score. So the observed discrepancy in collected taxa between volunteers and professionals coincides with the differences in quality scores. Soft sediment inhabiting animals are part of the WQsc scores and, therefore, sampling protocols or the animals’ indicator values should be reconsidered for a better match between the volunteer and professional data and water quality scores.
Volunteers sampled a really different set of waterbodies than professionals. Until present, the information gathered by the volunteers is not used by the professionals, partially due to the discrepancy in methodology between volunteers and professionals. Professionals identify organisms preferably to the species level, while volunteers identify on a much higher taxonomic level. The associated water quality assessment systems used by professionals and volunteers, therefore, also differ. It seems that the information gathered by volunteers is not in the required format for immediate use by professionals. If this mismatch can be bridged in the future, the data gathered by the volunteers will be of much more value to the professionals. A possible approach could be to develop a quality assurance plan that describes defined methods to collect the data and that needs to be approved by the water authorities, as is the case in several citizen science projects in the USA [85]. This bridging is of utmost importance since citizen science is regarded essential for monitoring UN sustainable development goals [5–9] as well as for the implementation of the EU water framework directive [10–12].
In conclusion, information gathered via citizen science on biological water quality in the Netherland potentially adds to the information gathered by regional water authorities as volunteers collect data on other spatial and temporal scales. Volunteers however collect data in a different way and their inventory is less complete. New tools and processes need to be developed to make the gathered information more useful to professional water managers.
Acknowledgments
We like to thank all volunteers who contributed to this citizen science project, as well as all partners from the consortium Waterdiertjes.nl. Furthermore, we greatly appreciated the contribution of K. Stepenuck, the efforts of the anonymous reviewers and the linguistic correction by J. Grehan.
References
- 1. Shirk JJL, Ballard HHL, Wilderman CC, Phillips T, Wiggins A, Jordan R, et al. Public participation in scientific research: a framework for intentional design. Ecol Soc. 2012;17: 29.
- 2.
Senabre Hidalgo E, Perelló J, Becker F, Bonhoure I, Legris M, Cigarini A. Participation and Co-creation in Citizen Science. The Science of Citizen Science. Springer International Publishing; 2021. pp. 199–218.
- 3. Thornhill I, Chautard A, Loiselle S. Monitoring biological and chemical trends in temperate stillwaters using citizen science. Water (Switzerland). 2018;10.
- 4. Chandler M, See L, Copas K, Bonde AMZ, López BC, Danielsen F, et al. Contribution of citizen science towards international biodiversity monitoring. Biol Conserv. 2017;213: 280–294.
- 5.
UN. 70/1. Transforming our world: the 2030 Agenda for Sustainable Development. 2010.
- 6. Bishop IJ, Warner S, van Noordwijk TCGE, Nyoni FC, Loiselle S. Citizen science monitoring for sustainable development goal indicator 6.3.2 in England and Zambia. Sustain. 2020;12: 1–15.
- 7. Fritz S, See L, Carlson T, Haklay M (Muki), Oliver JL, Fraisl D, et al. Citizen science and the United Nations Sustainable Development Goals. Nat Sustain. 2019;2: 922–930.
- 8. Fraisl D, Campbell J, See L, Wehn U, Wardlaw J, Gold M, et al. Mapping citizen science contributions to the UN sustainable development goals. Sustain Sci. 2020;15: 1735–1751.
- 9. San Llorente Capdevila A, Kokimova A, Sinha Ray S, Avellán T, Kim J, Kirschke S. Success factors for citizen science projects in water quality monitoring. Sci Total Environ. 2020;728. pmid:32570323
- 10. Van der Heijden J, Ten Heuvelhof E. The Mechanics of Virtue: Lessons on Public Participation from Implementing the Water Framework Directive in the Netherlands. Environ Policy Gov. 2012;22: 177–188.
- 11.
EC. Common Implementation Strategy for the Water Framework Directive (2000/60/EC). Public Participation in relation to the Water Framework Directive. Guidance Document no. 8. Public Participation in Relation to the Water Framework Directive. Working group 2.9. Public Participation. 2003. http://europa.eu.int
- 12. Seelen LMS, Flaim G, Jennings E, De Senerpont Domis LN. Saving water for the future: Public awareness of water usage and water quality. J Environ Manage. 2019;242: 246–257. pmid:31048230
- 13.
Miller-Rushing A, Primack R, Bonney R. The history of public participation in ecological research. Frontiers in Ecology and the Environment. Wiley-Blackwell; 2012. pp. 285–290.
- 14. Dickinson JL, Zuckerberg B, Bonter DN. Citizen Science as an Ecological Research Tool: Challenges and Benefits. Annu Rev Ecol Evol Syst. 2010;41: 149–172.
- 15.
Frigerio D, Pipek P, Kimmig S, Winter S, Melzheimer J, Diblíková L, et al. Citizen science and wildlife biology: Synergies and challenges. Bshary R, editor. Ethology. John Wiley & Sons, Ltd (10.1111); 2018. pp. 365–377.
- 16.
Chandler M, See L, Buesching CD, Cousins JA, Gillies C, Kays RW, et al. Involving Citizen Scientists in Biodiversity Observation. The GEO Handbook on Biodiversity Observation Networks. Springer International Publishing; 2017. pp. 211–237.
- 17. Barnard P, Altwegg R, Ebrahim I, Underhill LG. Early warning systems for biodiversity in southern Africa—How much can citizen science mitigate imperfect data? Biol Conserv. 2017;208: 183–188.
- 18. McGoff E, Dunn F, Cachazo LM, Williams P, Biggs J, Nicolet P, et al. Finding clean water habitats in urban landscapes: professional researcher vs citizen science approaches. Sci Total Environ. 2017;581–582: 105–116. pmid:28069307
- 19. Abbott BW, Moatar F, Gauthier O, Fovet O, Antoine V, Ragueneau O. Trends and seasonality of river nutrients in agricultural catchments: 18 years of weekly citizen science in France. Sci Total Environ. 2018;624: 845–858. pmid:29274609
- 20. Safford H, Peters CA. Citizen science for dissolved oxygen monitoring: Case studies from Georgia and Rhode Island. Environ Eng Sci. 2018;35: 362–372.
- 21. Weeser B, Stenfert Kroese J, Jacobs SR, Njue N, Kemboi Z, Ran A, et al. Citizen science pioneers in Kenya—A crowdsourced approach for hydrological monitoring. Sci Total Environ. 2018;631–632: 1590–1599. pmid:29727983
- 22. Garaba SP, Friedrichs A, Voß D, Zielinski O. Classifying natural waters with the forel-ule colour index system: Results, applications, correlations and crowdsourcing. Int J Environ Res Public Health. 2015;12: 16096–16109. pmid:26694444
- 23. Farnham DJ, Gibson RA, Hsueh DY, McGillis WR, Culligan PJ, Zain N, et al. Citizen science-based water quality monitoring: Constructing a large database to characterize the impacts of combined sewer overflow in New York City. Sci Total Environ. 2017;580: 168–177. pmid:28024746
- 24. Barrows APW, Christiansen KS, Bode ET, Hoellein TJ. A watershed-scale, citizen science approach to quantifying microplastic concentration in a mixed land-use river. Water Res. 2018;147: 382–392. pmid:30336341
- 25. Sakai N, Mohamad ZF, Nasaruddin A, Abd Kadir SN, Mohd Salleh MSA, Sulaiman AH. Eco-Heart Index as a tool for community-based water quality monitoring and assessment. Ecol Indic. 2018;91: 38–46.
- 26. Shupe SM. High resolution stream water quality assessment in the Vancouver, British Columbia region: a citizen science study. Sci Total Environ. 2017;603–604: 745–759. pmid:28411868
- 27. Loperfido J V., Beyer P, Just CL, Schnoor JL. Uses and biases of volunteer water quality data. Environ Sci Technol. 2010;44: 7193–7199. pmid:20540530
- 28. Firehock K, West J. A Brief History of Volunteer Biological Water Monitoring Using Macroinvertebrates. Source J North Am Benthol Soc. 1995;14: 197–202. Available: https://www.jstor.org/stable/1467734
- 29. Moolna A, Duddy M, Fitch B, White K. Citizen science and aquatic macroinvertebrates: Public engagement for catchment-scale pollution vigilance. Ecoscience. 2020;27: 303–317.
- 30. Valois A, Davies-Colley R, Storey R, Wright-Stow A, Stott R, Kin E, et al. Volunteer monitoring as a focus for community engagement in water management in Aotearoa-New Zealand: review and prospects. 2019.
- 31. Fore LS, Paulsen K, O’Laughlin K. Assessing the performance of volunteers in monitoring streams. Freshw Biol. 2001;46: 109–123.
- 32. Everall NC, Johnson MF, Wood P, Farmer A, Wilby RL, Measham N. Comparability of macroinvertebrate biomonitoring indices of river health derived from semi-quantitative and quantitative methodologies. Ecol Indic. 2017;78: 437–448.
- 33. Pinto P, Oliveira-Junior JMB, Leitão F, Morais MM, Chícharo L, Vaz P, et al. Development of a metric of aquatic invertebrates for volunteers (MAIV): A simple and friendly biotic metric to assess ecological quality of streams. Water (Switzerland). 2020;12: 654.
- 34. Kolkwitz R, Marsson M. Okologie der pflanzlichen Saprobien. Ber Dtsch Bot Ges. 1908;26a: 505–509. Available: https://www.worldcat.org/title/okologie-der-pflanzlichen-saprobien/oclc/247865309
- 35. Kolkwitz R, Marsson M. Ökologie der tierischen Saprobien. Beiträge zur Lehre von der biologischen Gewässerbeurteilung. Int Rev der gesamten Hydrobiol und Hydrogr. 1909;2: 126–152.
- 36. Hellawell JM. Biological Indicators of Freshwater Pollution and Environmental Management. Biol Indic Freshw Pollut Environ Manag. 1986.
- 37.
Rosenberg DM, Resh VH. Freshwater biomonitoring and benthic macroinvertebrates. Chapman & Hall; 1993.
- 38.
Barbour MT, Gerritsen J, Snyder BD, Stribling JB. Rapid bioassessment protocols for use in streams and wadeable rivers: periphyton, benthic macroinvertebrates and fish. 1999. http://www.epa.gov/OWOW/monitoring/techmon.html
- 39. Woodiwiss F. The biological system of stream classification used by the Trent River Board. Chem Ind. 1964;14: 443. Available: http://fu7gm9zv7t.scholar.serialssolutions.com/?sid=google&auinit=FS&aulast=Woodiwiss&atitle=The+biological+system+of+stream+classification+used+by+the+Trent+River+Board&title=Chemistry+and+industry+(London)&volume=14&date=1964&spage=443&issn=0009-3068
- 40. Hawkes HA. Origin and development of the biological monitoring working party score system. Water Res. 1998;32: 964–968.
- 41. Hilsenhoff WL. Rapid Field Assessment of Organic Pollution with a Family-Level Biotic Index. J North Am Benthol Soc. 1988;7: 65–68.
- 42. De Pauw N, Vanhooren G. Method for biological quality assessment of watercourses in Belgium. Hydrobiol 1983 1001. 1983;100: 153–168.
- 43. Dickens CWS, Graham PM. The south african scoring system (SASS) version 5 rapid bioassessment method for rivers. African J Aquat Sci. 2002;27: 1–10.
- 44. Peeters ETHM, Gardeniers JJP, Tolkmap HH. New methods to assess the ecological status of surface waters in The Netherlands. Part 1: Running waters. Verhandlungen der Int Vereinigung für Theor und Angew Limnol. 1994;25: 1914–1916.
- 45. Moss B, Stephen D, Alvarez C, Becares E, Van De Bund W, Collings SE, et al. The determination of ecological status in shallow lakes—A tested system (ECOFRAME) for implementation of the European Water Framework Directive. Aquat Conserv Mar Freshw Ecosyst. 2003;13: 507–549.
- 46. Klemm DJ, Blocksom KA, Fulk FA, Herlihy AT, Hughes RM, Kaufmann PR, et al. Development and evaluation of a Macroinvertebrate Biotic Integrity Index (MBII) for regionally assessing Mid-Atlantic Highlands streams. Environ Manage. 2003;31: 656–669. pmid:12719895
- 47. Weigel BM, Henne LJ, Martínez-Rivera LM. Macroinvertebrate-based index of biotic integrity for protection of streams in west-central Mexico. J North Am Benthol Soc. 2002;21: 686–700.
- 48.
Pot R. QBWat, programma voor beoordeling van de biologische waterkwaliteit volgens de Nederlandse maatlatten voor de Kaderrichtlijn Water. Versie 7 β. http://www.roelfpot.nl/qbwat. 2021.
- 49. Rae M, Miró A, Hall J, O’Brien K, O’Brien D. Evaluating the validity of a simple citizen science index for assessing the ecological status of urban drainage ponds. Ecol Indic. 2019;98: 1–8.
- 50.
Orton R, Bebbington A, Bebbingon J. The freshwater name trail. Field Studies Council Publications, Telford, UK.; 1996.
- 51. Pernat N, Kampen H, Jeschke JM, Werner D. Citizen science versus professional data collection: Comparison of approaches to mosquito monitoring in Germany. Wiersma Y, editor. J Appl Ecol. 2021;58: 214–223.
- 52. van der Velde T, Milton DA, Lawson TJ, Wilcox C, Lansdell M, Davis G, et al. Comparison of marine debris data collected by researchers and citizen scientists: Is citizen science data worth the effort? Biol Conserv. 2017;208: 127–138.
- 53. Gollan J, De Bruyn LL, Reid N, Wilkie L. Can volunteers collect data that are comparable to professional scientists? a study of variables used in monitoring the outcomes of ecosystem rehabilitation. Environ Manage. 2012;50: 969–978. pmid:22875540
- 54. Forrester G, Baily P, Conetta D, Forrester L, Kintzing E, Jarecki L. Comparing monitoring data collected by volunteers and professionals shows that citizen scientists can detect long-term change on coral reefs. J Nat Conserv. 2015;24: 1–9.
- 55. Jollymore A, Haines MJ, Satterfield T, Johnson MS. Citizen science for water quality monitoring: Data implications of citizen perspectives. J Environ Manage. 2017;200: 456–467. pmid:28618317
- 56. Hoyer M V., Canfield DE. Volunteer-collected water quality data can be used for science and management. Lake Reserv Manag. 2021.
- 57. Barbour MT, Stribling JB, Verdonschot PFM. The multihabitat approach of USEPA’s rapid bioassessment protocols: Benthic macroinvertebrates. Limnetica. 2006;25: 839–850.
- 58.
Field A. Discovering Statistics Using IBM SPSS Statistics. 4th editio. London, England: SAGE Publications; 2013.
- 59. Nelder J., Wedderburn RW. Generalized Linear Models. J R Stat Soc Ser A. 1972;135: 370–384.
- 60.
Verdonschot PFM. Ecological characterization of surface waters in the province of Overijssel (The Netherlands). Wageningen University. 1990.
- 61. Usseglio-Polatera P, Bournaud M, Richoux P, Tachet H. Biological and ecological traits of benthic freshwater macroinvertebrates: Relationships and definition of groups with similar traits. Freshw Biol. 2000;43: 175–205.
- 62.
Teurlincx S, Kuiper JJ, Hoevenaar EC, Lurling M, Brederveld RJ, Veraart AJ, et al. Towards restoring urban waters: understanding the main pressures. Current Opinion in Environmental Sustainability. Elsevier B.V.; 2019. pp. 49–58.
- 63. Lehtiniemi M, Outinen O, Puntila-Dodd R. Citizen science provides added value in the monitoring for coastal non-indigenous species. J Environ Manage. 2020;267: 110608. pmid:32349951
- 64. Hadj-Hammou J, Loiselle S, Ophof D, Thornhill I. Getting the full picture: Assessing the complementarity of citizen science and agency monitoring data. Humbert J-F, editor. PLoS One. 2017;12: e0188507. pmid:29211752
- 65. Raitsos DE, Beaugrand G, Georgopoulos D, Zenetos A, Pancucci-Papadopoulou AM, Theocharis A, et al. Global climate change amplifies the entry of tropical species into the eastern Mediterranean Sea. Limnol Oceanogr. 2010;55: 1478–1484.
- 66. Léopold M, Cakacaka A, Meo S, Sikolia J, Lecchini D. Evaluation of the effectiveness of three underwater reef fish monitoring methods in Fiji. Biodivers Conserv. 2009;18: 3367–3382.
- 67. Bodilis P, Louisy P, Draman M, Arceo HO, Francour P. Can citizen science survey non-indigenous fish species in the eastern mediterranean sea? Environ Manage. 2014;53: 172–180. pmid:24071728
- 68. Florisson JH, Tweedley JR, Walker THE, Chaplin JA. Reef vision: A citizen science program for monitoring the fish faunas of artificial reefs. Fish Res. 2018;206: 296–308.
- 69. McKinley DC, Miller-Rushing AJ, Ballard HL, Bonney R, Brown H, Cook-Patton SC, et al. Citizen science can improve conservation science, natural resource management, and environmental protection. Biol Conserv. 2017;208: 15–28.
- 70.
Rose S, Suri J, Brooks M, Ryan PG. COVID-19 and citizen science: lessons learned from southern Africa. Ostrich. Taylor and Francis Ltd.; 2020. pp. 188–191.
- 71. Kishimoto K, Kobori H. COVID-19 pandemic drives changes in participation in citizen science project “City Nature Challenge” in Tokyo. Biol Conserv. 2021;255: 109001. pmid:34565806
- 72. Basile M, Russo LF, Russo VG, Senese A, Bernardo N. Birds seen and not seen during the COVID-19 pandemic: The impact of lockdown measures on citizen science bird observations. Biol Conserv. 2021;256: 109079. pmid:34580546
- 73.
de Senerpont Domis LN, Teurlincx S. Changing human–ecosystem interactions during COVID-19 pandemic: reflections from an urban aquatic ecology perspective. Current Opinion in Environmental Sustainability. Elsevier B.V.; 2020. pp. 32–34. https://doi.org/10.1016/j.cosust.2020.10.008 pmid:33101550
- 74. Feldman RE, Žemaitė I, Miller-Rushing AJ. How training citizen scientists affects the accuracy and precision of phenological data. Int J Biometeorol. 2018;62: 1421–1435. pmid:29732472
- 75. Fuccillo KK, Crimmins TM, de Rivera CE, Elder TS. Assessing accuracy in citizen science-based plant phenology monitoring. Int J Biometeorol. 2015;59: 917–926. pmid:25179528
- 76.
Hunter J, Alabri A, Van Ingen C. Assessing the quality and trustworthiness of citizen science data. Concurrency Computation Practice and Experience. Wiley-Blackwell; 2013. pp. 454–466.
- 77. Ratnieks FLW, Schrell F, Sheppard RC, Brown E, Bristow OE, Garbuzov M. Data reliability in citizen science: learning curve and the effects of training method, volunteer background and experience on identification accuracy of insects visiting ivy flowers. Methods Ecol Evol. 2016;7: 1226–1235.
- 78.
Balázs B, Mooney P, Nováková E, Bastin L, Jokar Arsanjani J. Data Quality in Citizen Science. The Science of Citizen Science. Springer International Publishing; 2021. pp. 139–157.
- 79. Moffett E, Neale M. Volunteer and professional macroinvertebrate monitoring provide concordant assessments of stream health. http://dx.doi.org.ezproxy.library.wur.nl/101080/0028833020151018913. 2015;49: 366–375.
- 80.
Herbst DB, Feng AY, Gregorio DE. The Carlifornia Streamside Biosurvey: An Introduction to Using Aquatic Invertebrates as Water Quality Indicators. Scaramento; 2001.
- 81. Kosmala M, Wiggins A, Swanson A, Simmons B. Assessing data quality in citizen science. Front Ecol Environ. 2016;14: 551–560.
- 82. Swanson A, Kosmala M, Lintott C, Packer C. A generalized approach for producing, quantifying, and validating citizen science data from wildlife images. Conserv Biol. 2016;30: 520–531. pmid:27111678
- 83. M B. 1,500 scientists lift the lid on reproducibility. Nature. 2016;533: 452–454. pmid:27225100
- 84.
Scheffer M, Van Geest GJ, Zimmer K, Jeppesen E, Søndergaard M, Butler MG, et al. Small habitat size and isolation can promote species richness: Second-order effects on biodiversity in shallow lakes and ponds. Oikos. John Wiley & Sons, Ltd; 2006. pp. 227–231.
- 85. Stepenuck KF, Genskow KD. Characterizing the Breadth and Depth of Volunteer Water Monitoring Programs in the United States. Environ Manage. 2018;61: 46–57. pmid:29159482