Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A comprehensive but practical methodology for selecting biological indicators for long-term monitoring

  • Roger Puig-Gironès ,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    rogerpuiggirones@gmail.com

    Affiliations Equip de Biologia de la Conservació, Departament de Biologia Evolutiva, Ecologia i Ciències Ambientals & Institut de la Recerca de la Biodiversitat (IRBIO), Universitat de Barcelona, Barcelona, Catalonia, Spain, Departament de Ciències Ambientals, University of Girona, Girona, Catalonia, Spain

  • Joan Real

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation Equip de Biologia de la Conservació, Departament de Biologia Evolutiva, Ecologia i Ciències Ambientals & Institut de la Recerca de la Biodiversitat (IRBIO), Universitat de Barcelona, Barcelona, Catalonia, Spain

Abstract

The selection of the many biological indicators described in scientific literature is rarely based on systematic or clear-cut processes, and often takes into account only a single or very few taxa, or even disregards the complex interactions that exist between the components of biodiversity. In certain cases, the particular context of a site–for example in the Mediterranean Basin–makes it difficult to apply the choice of indicators to other regions proposed in the literature. Therefore, the selection of appropriate methodologies for generating relevant indicators for a particular site is of crucial importance. Here, we present a simple quantitative methodology capable of incorporating multidisciplinary information for assessing and selecting appropriate methods and indicators for monitoring local biodiversity. The methodology combines several ecological levels (species, habitats, processes, and ecosystem disturbances), and embraces biological interactions and common functional guilds (detritivores, producers, herbivores, and carnivores). We followed an iterative selection procedure consisting of five phases: 1) collection focal area useful information; 2) classification of this information into interrelated datasets; 3) assessment and selection of the relevant components using a quantitative relevance index; 4) the adding of taxonomic, physiognomic and functional similarities to the relevant components; and 5) the quantitative selection of the priority indicators in the study area. To demonstrate the potential of this methodology, we took as a case study the biodiversity components and their ecological interactions present in a protected area. We show that our methodology can help select appropriate local and long-term indicators, reduce the number of components required for thorough biodiversity monitoring, and underline the importance of ecological processes.

1. Introduction

Ecosystems have many different biological components, a fact that hinders any attempt to attain knowledge of the entirety of the elements that constitute our natural biodiversity [1]. At the ecological level, the elements of biodiversity are organized into complex networks that interact with biotic and abiotic components in ecosystem processes and produce ecosystem services for use by human societies [2]. Therefore, understanding the causes and consequences of the current loss of biological components is fundamental [3, 4]. The availability of useful information regarding the state and trends operating in our biodiversity is a crucial step in the construction of biological indicators [5]. These indicators interact with the ecosystem and reflect the changes occurring in a habitat, community, or ecosystem; they provide information about complex ecological processes, act as early warning signals, help diagnose the cause of ecological problems, and are important tools for use in conservation planning and management [610].

Understanding the trends and drivers of biodiversity change is vital when attempting to decide on appropriate conservation measures [11, 12]; nevertheless, to do so requires robust and comprehensive information obtained from biodiversity monitoring programs [13]. Despite the enormous challenges facing global biodiversity conservation [14], it is essential to quantify and predict local and regional variations to be able to address and protect all aspects of biodiversity. The Group on Earth Observations Biodiversity Observation Network (GEO BON) has developed the concept of Essential Biodiversity Variables (EBVs) [15], which can be used to link local and global needs and aims [16]. Conceptually, EBVs are located between primary data observation and indicators [15, 17], and have been developed to help prioritize a minimum set of essential measures for the consistent study, reporting, and management of all the major elements of biodiversity change. GEO BON has proposed 22 candidate variables belonging to six EBV classes: genetic composition, species populations, species traits, community composition, ecosystem functioning, and ecosystem structure [16]. Some EBVs such as population abundance–a continuous variable for all taxa–may be difficult to obtain due to the large number of taxa found at a single site. Thus, it may be more advantageous in a particular region to select just a few local biodiversity components as candidates for monitoring and it follows that standardised local sampling at fine resolutions and the datasets it generates will become a necessary and useful part of the development of global biodiversity indicators [14]. These specific monitoring systems will provide accurate information for creating local indicators for decision-making that, at the same time, can be incorporated into global EBVs [16].

Despite the extensive scientific literature that exists on the selection of indicators, this process is often neither systematic nor methodical [1, 1822]. The selection criteria for indicators may be related to the distribution, abundance, richness, functional importance, or sensitivity of taxa to environmental change [15, 20, 2328]. However, the choice of indicators is usually based on previously cited research, the conservation status of taxa, and/or the ease with which data can be sampled, sorted, and identified [29]. Furthermore, choices may even be based on subjective criteria unrelated to ecological criteria [20, 30, 31] or be driven by the availability of data [32]. Consequently, given the huge number of taxa that meet these requirements [33], a multitude of indicators have been described in the literature [29]; thus, when selecting appropriate indicators their relation to the local context and ecosystems must be taken into account. Accordingly, the knowledge of experts or specialists in local taxa is essential since one aspect of biodiversity (species, habitats, ecological processes, and biotic, abiotic, and anthropic problems) may affect a focal region differently and so require its indicator [6]. It is also important to assess which indicators are valid and informative for a region and which are redundant, overvalued, or unnecessary.

The Mediterranean Basin is a biodiversity hotspot that, due to the unique ecological processes and heterogeneous climatic conditions that drive its ecosystems, harbours numerous endemic plant and animal species [3437]. Moreover, this region is experiencing a multitude of environmental impacts related to the great anthropic presence (e.g. urbanisation, infrastructures, resource overexploitation, or frequent wildfires) that complicate the study, monitoring, and biodiversity predictions of its vast number of multidirectional ecological relationships. Hence, a suitable selection of indicators is as essential as is the correct design of monitoring protocols with specific objectives. In Mediterranean ecosystems, objective methods for selecting an appropriate set of biodiversity indicators are lacking, or are limited to just one or a few groups [38, 39], and assessments often cannot be contrasted or are difficult to put into practice [40]. In other regions protocols and selection methods already exist and these methodologies generate a large variety of context-specific indicators [20, 28, 4146].

Our overall aim was thus to develop a simple quantitative methodology capable of incorporating multidisciplinary information for assessing and selecting appropriate methods and indicators for monitoring local biodiversity. This methodology combines several ecological levels (species, habitats, processes, and ecosystem disturbances [1]), and embraces biological interactions and common functional guilds (producers, herbivores, carnivores, and detritivores [47]). We applied our methodology to Sant Llorenç del Munt i l’Obac Natural Park (NE Spain), a protected area possessing an important and representative range of Mediterranean ecosystems. Despite focussing on Mediterranean areas, our approach is relevant to other regions, landscapes and ecosystems in which there are similar challenges to biodiversity conservation.

2. Materials and methods

2.1. Methodology approach

We developed a multi-criteria [48] methodology to select relevant biodiversity components (species, habitats, ecological processes, and ecosystem disturbances), and then used these components to create biodiversity indicators for monitoring biodiversity in particular sites. We followed a hierarchical selection procedure (1) so that the resulting indicators combining trends in diversity, reproductive success, and growth rates would be effective in detecting ecological changes and useful for assessing management impacts [29, 49, 50]. The process of selection of priority indicators to implement in long-term monitoring biodiversity following five steps: 1) the collection of published and unpublished information on the species, habitats, and biological communities present in the action scope; (2) the classification of the components of biodiversity in candidates of species, habitats, and ecosystem disturbances; (3) the establishment of the relevant components of species, habitats, ecological processes, and ecosystem disturbances employing the assessment with an Index of Relevance focusing on ecological networks; (4) the creation of a Monitoring Catalogue of relevant components grouped by similarity; and (5) the establishment of the Priority indicators by a quantitative Priority index.

thumbnail
Fig 1. The work schedule for select priority indicators.

The work schedule carried out for the selection of Priority indicators and its long-term monitoring program respects the following states: (1) search of published or unpublished information on the species, habitats, and biological communities present in the action scope; (2) classification of the components of biodiversity in candidates of species, habitats, and ecosystem disturbances; (3) establishment of and Relevant components catalogue of species, habitats, ecological processes and ecosystem disturbances employing the assessment with an Index of relevance, and make an ecological network to determine the Relevant components of the local ecological process; (4) creation of a Monitoring Catalogue of candidates; and (5) establishment of the Priority indicators by a quantitative Priority index.

https://doi.org/10.1371/journal.pone.0265246.g001

2.1.1. State 1: Collection of available information.

The primary components of the biodiversity (i.e. species and habitats) cited in the focal area were identified and collated. Subsequently, information regarding the stressors and drivers–i.e. the specific functional, compositional, and structural components or ecosystem disturbances such as natural and anthropogenic stressors [51]–of these biodiversity components was compiled (Fig 1).

2.1.2. State 2: Classification of the components of biodiversity in datasets of candidates of species, habitats, and ecosystem disturbances.

Based on a literature review, the collected information was classified into different datasets (Fig 1). To ensure a precise and rigorous selection, we divided the initial components of biodiversity into three ecological levels: species, habitats, and ecosystem disturbances. These datasets incorporate different variables affecting the stressors and drivers of the elements used to assess and select the relevant components. An effective collection of prior information on the area to be applied, especially not published reports, is essential. If relevant prior information is not available, you need to back to State 1 to search for or generate relevant information.

2.1.3. State 3: The establishment of the relevant components of monitoring biodiversity.

2.1.3.1. Quantitative method. To select the relevant components from the datasets we developed a quantitative Relevance Index focusing on different variables specified and related to species, habitats, and ecological processes (Table 1), that in turn each one was subdivided into different levels and criteria (Table 2).

  • For species, the quantitative Relevance Index value lies in the range 0 to 8 (Table 1) and selects all values with a threshold of ≥ 4. The species’ assessment parameters are related to the degree of threat [52], their ecological interest [53, 54], and the expert criterion [6] for each taxonomic group (Table 2). The ecological interest parameter gives priority to species that occupy a wide-ranging habitat, have rich habitat requirements (patch size, structure, and configuration), and depend on particular ecological processes (Table 2), given that species restricted to fewer habitat types are more susceptible to local impacts [55].
  • At habitat level, the quantitative Relevance Index value is established from 0 to 8 (Table 1) and selects values with a threshold of ≥ 4. For each habitat catalogued, the parameters are the degree of threat, ecological interest, the representativeness of preselected species that depend on each one of the assessed habitats, and the expert criterion (Table 2).
  • In the case of ecosystem disturbances, the Relevance Index runs from 0 to 6 (Table 1), and, once assessed, values with a threshold of ≥ 3 are selected. In this case, the parameters used were related to the species and habitats potentially affected by each ecosystem disturbances, and to expert criteria (Table 2).
thumbnail
Table 1. The quantitative scoring ranges and the relevance index formula used in our multi-criteria analysis for the relevant candidates of species, habitats, and ecosystem disturbances.

https://doi.org/10.1371/journal.pone.0265246.t001

thumbnail
Table 2. Summary of the assessment parameters used to select the relevant candidates, the ecological level (species, habitat, or ecosystem disturbances), the valuation for the calculation of the relevance index, the parameter’s description, and the specific criterion to assess each of the parameters.

https://doi.org/10.1371/journal.pone.0265246.t002

Once the species, habitats, and ecosystem disturbances have been assessed, those that reach the threshold value of the Relevance Index are selected. Because the threshold value needs to be sufficiently robust but at the same time to include potential under-detected components, we established as a criterion to maintain the components with a Relevance index equal to or above half of the maximum global potential value that included valuable ecosystem components, as we have verified in our previous tests (see Table 1).

For the component assessment for species, habitats, and ecosystem disturbances accurate knowledge of ecological requirements and responses to environmental changes in the candidates is required when choosing the elements that reflect our ultimate aim. Here, the bibliography and expert criteria are essential (Table 2), and will help highlight species or habitats that are not present or not evaluated as threatened. The ecological interest contribute to minimize the weight of these threatened and singular component, which do not necessarily reflect the spatial and temporal trends of biodiversity [23, 56] but, rather, respond to the local conservation status [57].

2.1.3.2. Construct an interrelated diagram to determine the ecological processes. Ecological processes were qualitatively assessed strictly on preselected relevant candidates (species, habitats, and ecosystem disturbances) and their diversity of interactions in the focal area, i.e. the diversity and structure of multi-trophic interactions between organisms and habitat types. These processes can be complex to define and elucidate and their monitoring is often difficult to perform. Thus, basic processes such as trophic relationships and mutualism interactions are required to select the processes [46]. Here, based on the previously relevant candidates, a diagram is established that depicts all possible direct and indirect trophic relationships, as well as the interactions between species, habitats, and external ecosystem disturbances (abiotic and anthropic). From here, the main ecological processes in the study area are defined as the water cycle, nutrient cycle, ecological succession, trophic networks, mutualisms, and other local relevant processes (Fig 2). This exercise forces to define the biological and geographical limits (monitor scale) and, then, make practical decisions about how much can be done. In addition, it emphasises that to monitor any ecosystem you must have a great deal of background data [46].

thumbnail
Fig 2. Interactions between the monitoring candidates to elucidate ecological processes.

Diagram of the possible interactions that are established between the monitoring candidates, where highlight five main groups of organisms in the trophic network, the detritivores (green box), the primary producers, the primary and secondary consumers, and the predators. However, within these groups, interactions occur, even within the same species communities. On the other hand, this entire complex trophic network is conditioned by abiotic and anthropogenic external ecosystem disturbances (ecosystem disturbances; red box), such as climatology, perturbations, pollution, forest management, etc. Continuous lines denote direct relationships, while discontinuous lines describe diffused relationships often characteristic of opportunistic species.

https://doi.org/10.1371/journal.pone.0265246.g002

2.1.4. State 4: Monitoring catalogue.

Once the different relevant components have been assessed and selected, a Monitoring Catalogue (Fig 1) can be established to act as a strategic guide, facilitate understanding, and identify which variables need to be sampled and measured to generate the biological indicators in an ecological sense and to avoid redundancies. To attain the list of relevant components, (1) we grouped components by taxonomic, physiognomic, and functional similarities (e.g. common birds, freshwater invertebrates, decomposers). Then, (2) classified the grouped relevant components in four ecological levels: species, habitat, ecological process, and ecosystem disturbances (see the case study below as a practical example). (3) For each group of relevant components we selected the adequate variables to be sampled, e.g., species presence and abundance, reproductive and survival taxes, habitat preferences, soil structure, and composition. Lastly, (4) incorporated into each level all the monitoring components whilst bearing in mind that each can be part of one or more levels depending on their role and interactions within the ecosystem (see State 3). For example, species abundance and richness of butterflies provide information about the species level and their community respectively, so in the latter case indicate the variation on ecosystem functional capabilities (e.g. as primary consumers), climate change or afforestation effects.

2.1.5. State 5: Priority indicators.

Priority Indicators are useful for acquiring knowledge of biological and ecological changes in a given area and indispensable to optimize the efforts in monitoring. In our scheme, they were selected using a quantitative Priority Index, which awards importance from 0 to 5 based on the criteria of specificity (key species or habitats, etc.), generality (abundant species, representative and common processes, etc.), importance (endemic species, determining ecosystem disturbances, etc.), interactions between organisms, and usefulness for management and decision-making (Table 3). In this case, only those Monitoring Components that reach maximum importance (Priority Index ≥ 4) are chosen as Priority Indicators in the study area.

thumbnail
Table 3. Summary of the assessment parameters used to select the priority indicators by a quantitative priority index using five parameters with its specific criterion.

https://doi.org/10.1371/journal.pone.0265246.t003

Priority Indicators were divided into four interrelated ecological levels:

  1. Species. The indicators of the state of species, in general, are designed to identify the population and conservation status of the most characteristic species in ecosystems, whose presence or abundance indicates population trends and the state of the habitats and ecosystems in which they live.
  2. Habitats. The indicators of the state of habitats are based on knowledge of the condition of plant communities (floristically and functionally) and land use, and, in particular, of the evolution of their structural, spatial, and temporal evolution and distribution.
  3. Ecological processes. The indicators highlight the relationships that link organisms or groups of organisms with each other and with the environment (habitat or ecosystem) that hosts them and the specific interactions between them.
  4. Ecosystem disturbances. These indicators reveal the effects of the ecosystem disturbances that affect and alter the natural functioning of ecosystems and their constituent organisms. Disturbances in ecosystems may be the product of natural cycles or anthropogenic activity.

2.2. Pilot study area

To apply our quantitative and qualitative methodology for selecting biodiversity indicators at the local scale, Sant Llorenç del Munt i l’Obac Natural Park (henceforth PNSLL; Fig 3) was chosen as the focal region. This mountainous area forms part of the Catalan Prelitoral Mountain Range and has an altitudinal range of 280–1,100 m a.s.l. and a typical mid-altitude Mediterranean montane climate. Its orography and geographical situation afford it great climatic variability, with an annual mean rainfall of 500–800 mm and a mean annual temperature of 15 C°. Its lithology consists of permeable conglomerates with an argillaceous and calcareous matrix [58]. It is characterized by rocky outcrops and cliffs [59], whose forested crags and ridges are covered chiefly by holm oak (Quercus ilex L.) forests and, in the more humid valleys, patches of deciduous pubescent (Quercus pubescens Willd.) and sessile (Quercus petraea (Matt.) Liebl) oak forests. Lower areas are dominated by Aleppo pine (Pinus halepensis Mill.) woodland with an evergreen oak understory [60], while black (Pinus nigra subsp. salzmannii (Dunal) Franco) and Scots (Pinus sylvestris L.) pine forests cover smaller areas of terrain. Shrubland is also present mainly as a result of the wildfires that occurred during the 2000s. Currently, this 13,694-ha protected area is subject to intense human pressure (e.g. wildfires, human frequentation, and forest exploitation) since is located near the Barcelona conurbation (4 million inhabitants), one of the largest metropolitan areas in southern Europe.

thumbnail
Fig 3. Location of the pilot study area.

The geographic location of the Sant Lorenç del Munt i l’Obac Natural Park (white ring) in the nearby of the metropolitan area of Barcelona (black ring) in Catalonia (NE Iberian Peninsula) and its perimeter. Squares correspond to 100×100m Permanent Monitoring Plots, where COD correspond to Rocky areas habitat, MAT: Shrublands; PMD: Mediterranean pine forests, PHD: Wet pine forests; BMX: Mixed forests, AMY: Mountain holm oak forests, and BCF: Deciduous forests.

https://doi.org/10.1371/journal.pone.0265246.g003

3. Results

3.1. Information collection and classification into datasets

In all, 387 literature sources were consulted (S1 Appendix), including 213 publications, 66 unpublished reports, 10 technical plans, 19 datasets, and 79 reports from monitoring programs, as well as unpublished data by experts and researchers. A total of 3,226 species were catalogued and assessed for the PNSLL as candidates as indicators, including 52 algae, 159 fungi, 159 lichens, 69 bryophytes, 27 pteridophytes, 1,081 vascular plants (100 allochthones) [61], 1,404 invertebrates (1,179 insects, 53 gastropods, 139 arachnids, 30 from other groups and 7 allochthones), and 270 vertebrates (3 freshwater fish, 13 amphibians, 21 reptiles, 174 birds, 27 raptors, 51 mammals and 12 allochthones).

3.2. Relevant components selection

The relevant components were obtained through a Relevance Index which was calculated for all 3,226 assessed species (Table 4) of which 406 (12.6%) were selected as Relevant Components (S1 Table): plants contributed with 69 species (17%—of which 10 species were threatened species, 13 pteridophytes, 41 vascular plants, and five alien species), 191 species (47%) were invertebrates (of which 26 species were Odonata, 12 Gastropoda, 43 decomposers, 22 Formicidae, 30 Orthoptera; 36 Lepidoptera, ten other invertebrates of special interest, seven plague species and five were alien species), while 146 species (36%) were vertebrates (of which tree species were freshwater fish, seven amphibians, seven reptiles, 13 raptors, 70 common birds, 21 bats, seven small-mammals, two common medium-sized preys, two ungulates, five carnivores and nine were alien species).

thumbnail
Table 4. Reduction in the number and percentage of candidates to relevant components through the use of the relevance index; and reduction of the number and percentage of monitoring components to priority indicators by a quantitative priority index.

https://doi.org/10.1371/journal.pone.0265246.t004

We identified a total of 96 habitats in the PNSLL [6265], which, to simplify the assessment and selection of habitats, were grouped according to floristic, structural, and ecological similarities, thereby generating 15 habitat categories to be assessed as candidates as indicators (S2 Table). Of the total 15 assessed habitats, eleven were selected (Table 4) as relevant components (using Relevance Index value; S3 Table): caves, rocky areas, dry meadows, shrublands, Mediterranean pine forests, humid pine forests, mixed forests, mountain holm oak forests, deciduous forests, riparian forests and freshwater habitats.

To identify the relevant ecosystem disturbances affecting Mediterranean ecosystem biodiversity and, in particular, our study area, an intense literature search was conducted. From the candidates’ list of 14 ecosystem disturbances, nine were selected as Relevant Components (Table 4), corresponding to those with a Relevance Index value ≥ 3 and including disturbances related to global change (climate change, wildfires, and alien species) and local ecosystem disturbances (afforestation, fragmentation, freshwater alteration, silvicultural activities, hunting, human frequentation, and fatalities on human infrastructures) (S4 Table).

At a global level, and using our quantitative method, from 3,344 candidates including species, habitats, and ecosystem disturbances a set of 434 Relevant Components were finally obtained. The main ecological processes operating in the study area were defined first drawing a diagram that illustrates trophic relationships (S1 Fig), as well as the interactions between species, habitats, and external ecosystem disturbances (abiotic and anthropic) resulting in decomposition, plant production, consumers and predators and mutualisms (pollination and zoochory). Other relevant ecological processes such as the water cycle or ecological succession were included in the ecosystem disturbances (e.g. climate change, alteration of aquatic ecosystems, wildfires, and afforestation; Table 5). Thus, the final number of relevant components was 434, an 87% decrease from the list of initial candidates (Table 4).

thumbnail
Table 5. Priority indicators (n = 27) that quantitatively meet selection criteria on Sant Llorenç el Munt i l’Obac Natural Park.

The indicators are divided into four categories and in different attributes or pressures [1], consequently, each require different variables from monitoring candidates.

https://doi.org/10.1371/journal.pone.0265246.t005

3.3. Monitoring catalogue and priority indicators

To constitute the Monitoring catalogue, we grouped the 434 Relevant components into independent levels of species, habitats, ecological processes, and ecosystem disturbances by similarities. In the case of 408 species were grouped by taxonomic, physiognomic, and functional similarities into 17 groups of species (threatened plant species, xeric gastropods, granivorous ants, decomposers, orthoptera, butterflies, freshwater macroinvertebrates, freshwater fishes, amphibians, reptiles, common birds, raptors, bats, small mammals, common medium-size preys, ungulates and carnivores). A total of 96 habitats were grouped in 11 habitat relevant categories (Table 4). Then, the habitat category resulted in two monitoring parameters (habitat structure and composition), which will be carried out in the 11 selected relevant habitats. Moreover, it is in these habitats where the specific transversal monitoring of species, processes and disturbances will be developed. Ecological processes were grouped by ecological functions in 6, decomposition, primary production, consumers, predators, zoocory, and pollination. Ecosystem disturbances were maintained in 8 (Table 4), climatic change, wildfires, afforestation, freshwater alterations, alien species, exploitation of natural resources, forests pests, human frequentation, human infrastructures). So resulted in a total of 32 specific Monitoring Components. Finally, to obtain the Priority Indicators we used the quantitative Priority Index, and 27 of these Monitoring Components were selected to monitor the biodiversity in the PNSLL (Table 5).

4. Discussion

Our methodology was established using a systematic and transparent conceptual framework. First, we divided our set of components into four interrelated ecological levels: species, habitats, ecological processes, and ecosystem disturbances. Species and habitat indicators provide information about specific states but other ecological levels are required if they are to be correctly interpreted since, for example, different bird species respond to specific habitat structure, the availability of resources, and environmental conditions [24, 38, 66]. Therefore, a single indicator cannot reveal ecosystem dynamics on its own, as all indicators are interlinked and their impacts are connected via a web of complex relationships (Fig 2).

In the components selection process quantitative criteria were given priority over more subjective qualitative criteria, and a multi-criteria analysis [48] was used to generate a set of candidates and assess these indicators in terms of their degrees of importance to the ecosystem. The evaluation of each species, habitat, and ecosystem disturbance based on a points score using specific multi-criteria analysis allowed us to reduce the initial candidates to the final selected Priority Indicators (see State 3 in Methods). Exceptionally, we used qualitative selection in the particular case of ecological processes (see Discussion below). The use of a quantitative selection of indices also allowed us to drastically reduce the number of species and habitats to be monitored, which will thus optimise both future efforts and the use of resources. Some possible biases could arise from the exclusive use of the weight values in the Relevance Index as some potential candidates (e.g. plants and invertebrate species) would be undervalued so expert criteria could be needed and this knowledge will reinforce the selection of candidates prioritized. It is a key of the scheme and process of selection to have a good information base beforehand (literature, reports and databases). The higher and better the quality of the information, the more rigorous the selection of components will be. Experts and specialists examined each biodiversity component and judged their importance in the focal region to minimise the risk of benefiting certain charismatic taxa or a predetermined species as an indicator. Expert criteria and ecological importance require a thorough knowledge of species, habitats, ecological processes, and ecosystem disturbances, which is vital when selecting the appropriate relevant candidates for each focal region in which this methodology is to be implemented. This also allowed us to minimise the tendency to select rare species [67, 68] and helped us obtain more site-specific candidates [69]. The selection of the relevant candidates (species and habitats) to be included in a monitoring catalogue and their subsequent inclusion amongst the different priority indicators led to a third assessment of indicators via a multi-criteria analysis based on their specificity, generality, relevance, interactions with other organisms, and usefulness in management and decision-making.

Nevertheless, we placed special emphasis on the indicator selection for trophic networks and used a qualitative method strictly based on preselected indicators (species, habitats, and ecosystem disturbances) and their interrelations in the study area. All these interactions and relationships are depicted in a diagram (see State 3 of Methods, Fig 1), which provides information about the number of directly and indirectly related indicators. The integration and assessment of trophic networks–from primary production to predators–is a key component in the elaboration, selection, and monitoring of indicators [70, 71]. At the same time, an understanding of trophic networks is key for predicting trends and anticipating the conservationist or adaptive measures required in ecosystems [72]. Our method enables us to combine local results with the exploration of questions at broader geographical scales [73, 74].

This practical methodology for selecting indicators can be applied simply by conservation managers and nature stakeholders in local areas everywhere and networks such as the Barcelona Provincial Council’s Network of Natural Parks (https://parcs.diba.cat/). Nevertheless, it is also useful as a management tool since it allows for better-informed and more cost-effective decision-making in a particular site [29, 49, 50]. Therefore, besides providing information about the current situation of ecosystems, the selected indicators can be used as decision criteria and as early warning signals of change in a specific region. This is especially relevant and necessary in a constantly changing world affected by natural and anthropic impacts [75]. It also allows us to formulate and implement biodiversity conservation strategies in changing landscapes through the use of a comprehensive and structured information system. Finally, these indicators also offer metrics for ecosystem status and provide interpretable information regarding changes [76].

4.1. Practical considerations before implementing indicators

After the selection of the definitive indicators, the following logical factors should be considered before implementing any monitoring program at the local scale: (1) an appropriate selection of monitoring points with which to monitor the relevant candidates; (2) the generation of user-friendly protocols; and (3) an assessment of the ability of the protocols to obtain the required information. Indicator monitoring must be planned in the long term since complex dynamics and relationships in ecosystems may potentially affect decision quality. Long-term data can tackle questions not easily addressed in the short term [74] and are an excellent means of understanding how ecosystem disturbances impact ecosystem functioning and species dynamics. For example, Failing and Gregory [77] defend prescribed burns and replicating natural disturbance regimes to achieve long-term sustainable levels of biodiversity. Krebs [46] also highlights the need to have monitoring programs that report continuous information and data, having hundreds of years as time frame, and remarks on the importance of maintaining extended discussion of the monitoring problem, what should be monitored, and what the costs will be.

Monitoring scales should also be defined according to the sampling needs of each of the biological indicators. If a parameter cannot be adequately sampled, its usefulness for monitoring is greatly reduced [50]. Here three different scales are proposed: point-scale, plot-scale, and macro-scale (or landscape). If it is to be statistically robust, the monitoring scale has to offer the possibility of replicas, which do not suppose huge efforts, which can be used in the subsequent comparison.

  1. Point-scale monitoring is intended for site-specific indicators that require very accurate, specific, and concrete monitoring due to the scarcity or specificity of the habitat they occupy (e.g. threatened and rare flora), or to their linear distribution in space (e.g. riparian communities).
  2. Plot-scale monitoring within a homogeneous habitat with continuity at a fine-scale reveals the variations and trends occurring in different indicators. The monitoring of the selected indicators in the same plot will thus establish interactions according to each habitat (e.g. small-mammals, birds, habitat structure, trophic networks, decomposition, etc.). To obtain robust results, a minimum of four 100×100m Permanent Monitoring Plots are required in each selected habitat.
  3. Macro-scale (or landscape) monitoring corresponds to cases in which indicators require wide-ranging monitoring (a whole protected area, a mountain range, a slope, a cliff, etc.) given the high mobility, ubiquity, or impact of the indicators (e.g. afforestation, predators, etc.). This type of monitoring will follow protocols and dimensions dependent on the specific indicator to be followed; however, they have in common the fact that they will all cover considerable parts of the region.

User-friendly monitoring protocols should be standardised and adapted to the selected indicators in consensus with experts and bearing in mind the initiatives and monitoring processes that are already being carried out at local, national, and international levels. Indicators can form part of more than one level of monitoring, and some may require more than one protocol since certain species, habitat components, and ecological processes necessarily demand specific methodologies.

Supporting information

S1 Table. List and selection values of species.

List of the Individual species indicators of the Natural Park of Sant Llorenç del Munt i l’Obac following the criterion of achieving a value of the Relevance index. The list includes the taxon community or aggrupation (bold font), the accepted name of the species, the Relevance index for each species, the average for the community or aggrupation (bold font), and the four subsections to extract this index: the degree of threat (scoring ranges from 0 to 3), the monitoring programs set (0 to 1), the ecological interest (0 to 2) and the expert or taxon specialist criterion (0 to 2).

https://doi.org/10.1371/journal.pone.0265246.s002

(DOCX)

S2 Table. List of aggregated habitats.

List of the 15 aggregated habitats (by similarity and type of plant formation) that collect in them the 96 habitats present in the Natural Park of Sant Llorenç del Munt i l’Obac. This list shows, the name of the aggregated habitat, the CORINE codes that are grouped in each aggregated habitat, and the description of the aggregated habitat.

https://doi.org/10.1371/journal.pone.0265246.s003

(DOCX)

S3 Table. Selection values of habitats.

List of the valued habitats (aggregation by similarity and type of plant formation) of the Natural Park of Sant Llorenç del Munt i l’Obac following the criterion of achieving a value of the Relevance index greater than 4 points on a total of 8. The Relevance index of each selected grouping habitat corresponds to the average of the Relevance indexes of the different habitats that make up the group according to the selection criteria (relevance ≥ 4), being the sum of the four subsections to extract this index: degree of threat (scoring ranges from 0 to 2), the ecological interest (0 to 2), representativeness (0 to 2) and the expert or specialist criterion (0 to 2). Representativeness corresponds to the number of selected species that appear in the grouping habitat relativized on 2, being 380 the maximum of species assessed.

https://doi.org/10.1371/journal.pone.0265246.s004

(DOCX)

S4 Table. List and selection values of ecosystem disturbances.

List of the valued ecosystem disturbances on Natural Park of Sant Llorenç del Munt i l’Obac following the criterion of achieving a value of the Relevance index greater than 2.5 points on a total of 5 (in bold). The list includes the ecosystem disturbances, the relevance index, and the three subsections to extract this index: the representativeness (scoring ranges from 0 to 2), the affected habitat (0 to 2), and the expert or specialist criterion (0 to 1). Representativeness corresponds to the number of selected species affected by the ecosystem disturbances relativized on 2, being 380 the maximum of species assessed. Habitat grouping is affected by the ecosystem disturbances relative to 2, with 11 being the maximum number of habitats assessed.

https://doi.org/10.1371/journal.pone.0265246.s005

(DOCX)

S1 Fig. Selection of ecological processes.

The scheme used to select ecological processes in of the Natural Park of Sant Llorenç del Munt i l’Obac by a diagram of interactions between primary producers, food sources, primary consumers, secondary consumers, predators, decomposers, and abiotic and anthropogenic external ecosystem disturbances, such as climatology, perturbations, pollution, forest management, etc.

https://doi.org/10.1371/journal.pone.0265246.s006

(DOCX)

Acknowledgments

This work has been carried out through the Biodiversity Monitoring Centre of Mediterranean Mountains (CMBMM) thanks a convention of Diputació de Barcelona and Universitat de Barcelona. So we are grateful to C. Castell, J. Puigdollers, R. Espinach, J. Bellapart, M.A. Palacio, L. Saurí, J. Padrós, J. Barber, A. Miño, D. Pons, J. Elias, D. Espriu and J. Garcia for their support. We would also like to thank all the experts consulted X. Santos, T. Hernández-Matías, M. López-Roig, J. Serra-Cobo, J. Alberch, G. Llorente, E. Pujol-Buxó, E. Llop, E. Mateos, A. Serra, M. Arnedo, À. Rollán, S. Mañosa, S. Sabaté, T. Sauras-Yera, L. Sáez, P. Pons, C. Gómez, L. Brotons, J. Camprodon, D. Villero, I. Torre, C. Stefanescu, S. Herrando, L. Comas, J. Retana, A. Giménez, V. Bros, T. Mampel, P. Fernández, J. Canals, D. Carrera, A. Peris and A. Fàbrega, for their help and support during the project, both at the institutional level and at expert or taxon specialist level. We are indebted to a two anonymous referees and the academic editor Ignasi Torre that improved the manuscript.

References

  1. 1. Dale VH, Beyeler SC. Challenges in the development and use of ecological indicators. Ecological Indicators. 2001;1(1):3–10.
  2. 2. Rossberg AG. A complete analytic theory for structure and dynamics of populations and communities spanning wide ranges in body size. Advances in Ecological Research. 2012;46:427–521.
  3. 3. Tylianakis JM, Laliberté E, Nielsen A, Bascompte J. Conservation of species interaction networks. Biological Conservation. 2010;143(10):2270–9.
  4. 4. Mulder C, Boit A, Mori S, Vonk JA, Dyer SD, Faggiano L, et al. Distributional (in) congruence of biodiversity–ecosystem functioning. Advances in ecological research. 2012;46:1–88.
  5. 5. Jetz W, McGeoch MA, Guralnick R, Ferrier S, Beck J, Costello MJ, et al. Essential biodiversity variables for mapping and monitoring species populations. Nature Ecology & Evolution. 2019;3(4):539–51. Epub 2019/03/13. pmid:30858594.
  6. 6. Duelli P, Obrist MK. Biodiversity indicators: the choice of values and measures. Agriculture, ecosystems & environment. 2003;98(1):87–98.
  7. 7. Heink U, Kowarik I. What are indicators? On the definition of indicators in ecology and environmental planning. Ecological Indicators. 2010;10(3):584–93.
  8. 8. Lindenmayer DB, Franklin JF. Conserving Biodiversity: A comprehensive multiscaled approach. Washington, US: Island press; 2002.
  9. 9. McGeoch MA. Insects and bioindication: theory and progress. In: Stewart AJA, New TR, Lewis OT, editors. Insect conservation biology. Wallingford, UK: CABI International; 2007. p. 144–74.
  10. 10. Parmar TK, Rawtani D, Agrawal YK. Bioindicators: the natural indicator of environmental pollution. Frontiers in Life Science. 2016;9(2):110–8.
  11. 11. Noss RF. Indicators for monitoring biodiversity: a hierarchical approach. Conservation Biology. 1990;4(4):355–64.
  12. 12. Pereira HM, Navarro LM, Martins IS. Global Biodiversity Change: The Bad, the Good, and the Unknown. Annual Review of Environment and Resources. 2012;37(1):25–50.
  13. 13. Mihoub JB, Henle K, Titeux N, Brotons L, Brummitt NA, Schmeller DS. Setting temporal baselines for biodiversity: the limits of available monitoring data for capturing the full impact of anthropogenic pressures. Scientific Reports. 2017;7(1):41591. Epub 2017/01/31. pmid:28134310; PubMed Central PMCID: PMC5278508.
  14. 14. Kissling WD, Ahumada JA, Bowser A, Fernandez M, Fernandez N, Garcia EA, et al. Building essential biodiversity variables (EBVs) of species distribution and abundance at a global scale. Biological Reviews. 2018;93(1):600–25. Epub 2017/08/03. pmid:28766908.
  15. 15. Pereira HM, Ferrier S, Walters M, Geller GN, Jongman R, Scholes RJ, et al. Essential biodiversity variables. Science. 2013;339(6117):277–8. pmid:23329036
  16. 16. Navarro LM, Fernández N, Guerra C, Guralnick R, Kissling WD, Londoño MC, et al. Monitoring biodiversity change through effective global coordination. Current Opinion in Environmental Sustainability. 2017;29:158–69.
  17. 17. Brummitt N, Regan EC, Weatherdon LV, Martin CS, Geijzendorffer IR, Rocchini D, et al. Taking stock of nature: Essential biodiversity variables explained. Biological Conservation. 2017;213:252–5.
  18. 18. Belnap J. Environmental auditing: choosing indicators of natural resource condition: a case study in Arches National Park, Utah, USA. Environmental Management. 1998;22(4):635–42. pmid:9582399
  19. 19. Bockstaller C, Girardin P. How to validate environmental indicators. Agricultural systems. 2003;76(2):639–53.
  20. 20. Niemeijer D, de Groot RS. A conceptual framework for selecting environmental indicator sets. Ecological indicators. 2008;8(1):14–25.
  21. 21. de Olde EM, Moller H, Marchand F, McDowell RW, MacLeod CJ, Sautier M, et al. When experts disagree: the need to rethink indicator selection for assessing sustainability of agriculture. Environment, Development and Sustainability. 2017;19(4):1327–42.
  22. 22. Reid J, Rout M. Developing sustainability indicators–The need for radical transparency. Ecological Indicators. 2020;110:105941.
  23. 23. Gregory RD, Van Strien A, Vorisek P, Meyling AWG, Noble DG, Foppen RP, et al. Developing indicators for European birds. Philosophical Transactions of the Royal Society of London B: Biological Sciences. 2005;360(1454):269–88. pmid:15814345
  24. 24. Gregory RD, Willis SG, Jiguet F, Voříšek P, Klvaňová A, van Strien A, et al. An indicator of the impact of climatic change on European bird populations. PloS ONE. 2009;4(3):e4678. pmid:19259270
  25. 25. Heink U, Kowarik I. What criteria should be used to select biodiversity indicators? Biodiversity & Conservation. 2010;19(13):3769–97.
  26. 26. Biała K, Condé S, Delbaere B, Jones-Walters L, Torre-Marín A. Streamlining European biodiversity indicators 2020: Building a future on lessons learnt from the SEBI 2010 process. Copenhagen, Danmark: European Environment Agency; 2012.
  27. 27. Vačkář D, ten Brink B, Loh J, Baillie JE, Reyers B. Review of multispecies indices for monitoring human impacts on biodiversity. Ecological Indicators. 2012;17:58–67.
  28. 28. Remme RP, Hein L, van Swaay CA. Exploring spatial indicators for biodiversity accounting. Ecological indicators. 2016;70:232–48.
  29. 29. Siddig AA, Ellison AM, Ochs A, Villar-Leeman C, Lau MK. How do ecologists select and use indicator species to monitor ecological change? Insights from 14 years of publication in Ecological Indicators. Ecological Indicators. 2016;60:223–30.
  30. 30. Kurtz JC, Jackson LE, Fisher WS. Strategies for evaluating indicators based on guidelines from the Environmental Protection Agency’s Office of Research and Development. Ecological indicators. 2001;1(1):49–60.
  31. 31. Yu D, Lu N, Fu B. Establishment of a comprehensive indicator system for the assessment of biodiversity and ecosystem services. Landscape ecology. 2017;32(8):1563–79.
  32. 32. Geijzendorffer IR, Regan EC, Pereira HM, Brotons L, Brummitt N, Gavish Y, et al. Bridging the gap between biodiversity data and policy reporting needs: An Essential Biodiversity Variables perspective. Journal of Applied Ecology. 2016;53(5):1341–50.
  33. 33. Andersen AN. My bioindicator or yours? making the selection. Journal of Insect Conservation. 1999;3(2):61–4.
  34. 34. Sundseth K. Natura 2000 in the Mediterranean region. Luxembourg: European Communities; 2009.
  35. 35. Cuttelod A, García N, Malak DA, Temple HJ, Katariya V. The Mediterranean: a biodiversity hotspot under threat. In: Vié J-C, Hilton-Taylor C, Stuart SN, editors. Wildlife in a changing world: an analysis of the 2008 IUCN Red List of threatened species. Gland, Switzerland: IUCN; 2009. p. 89–101.
  36. 36. Médail F, Quézel P. Biodiversity hotspots in the Mediterranean Basin: setting global conservation priorities. Conservation Biology. 1999;13(6):1510–3.
  37. 37. Myers N, Mittermeier RA, Mittermeier CG, Da Fonseca GA, Kent J. Biodiversity hotspots for conservation priorities. Nature. 2000;403(6772):853–8. pmid:10706275
  38. 38. Herrando S, Anton M, Sardà-Palomera F, Bota G, Gregory RD, Brotons L. Indicators of the impact of land use changes using large-scale bird surveys: Land abandonment in a Mediterranean region. Ecological Indicators. 2014;45:235–44.
  39. 39. Herrando S, Brotons L, Anton M, Páramo F, Villero D, Titeux N, et al. Assessing impacts of land abandonment on Mediterranean biodiversity using indicators based on bird and butterfly monitoring data. Environmental Conservation. 2016;43(1):69–78.
  40. 40. Hess GR, Bartel RA, Leidner AK, Rosenfeld KM, Rubino MJ, Snider SB, et al. Effectiveness of biodiversity indicators varies with extent, grain, and region. Biological Conservation. 2006;132(4):448–57.
  41. 41. Coote L, Dietzsch AC, Wilson MW, Graham CT, Fuller L, Walsh AT, et al. Testing indicators of biodiversity for plantation forests. Ecological Indicators. 2013;32:107–15.
  42. 42. Lin J-y, Lin T, Cui S-h. Quantitative selection model of ecological indicators and its solving method. Ecological indicators. 2012;13(1):294–302.
  43. 43. Van Oudenhoven AP, Petz K, Alkemade R, Hein L, de Groot RS. Framework for systematic indicator selection to assess effects of land management on ecosystem services. Ecological Indicators. 2012;21:110–22.
  44. 44. Manoliadis OG. Development of ecological indicators—a methodological framework using compromise programming. Ecological indicators. 2002;2(1–2):169–76.
  45. 45. Steenberg JW, Duinker PN, Van Damme L, Zielke K. Criteria and indicators of sustainable forest management in a changing climate: an evaluation of Canada’s national framework. Journal of sustainable development. 2013;6(1):32.
  46. 46. Krebs CJ. Biodiversity monitoring in Canada’s Yukon: the community ecological monitoring program. In: Lindenmayer DB, Gibbons P, editors. Biodiversity monitoring in Australia. Melbourne, VIC, Australia: CSIRO Press; 2012. p. 151–6.
  47. 47. Carignan V, Villard M-A. Selecting indicator species to monitor ecological integrity: a review. Environmental monitoring and assessment. 2002;78(1):45–61. pmid:12197640
  48. 48. Dodgson JS, Spackman M, Pearman A, Phillips LD. Multi-criteria analysis: a manual. London, UK: Communities and Local Government; 2009.
  49. 49. Rainio J, Niemelä J. Ground beetles (Coleoptera: Carabidae) as bioindicators. Biodiversity & Conservation. 2003;12(3):487–506.
  50. 50. Geijzendorffer IR, Roche PK. Can biodiversity monitoring schemes provide indicators for ecosystem services? Ecological Indicators. 2013;33:148–57.
  51. 51. Dale VH, Mulholland PJ, Olsen LM, Feminella JW, Maloney KO, White DC, et al. Selecting a suite of ecological indicators for resource management. In: Kapustka LA, Galbraith H, Luxon M, Biddinger GR, editors. Landscape Ecology and Wildlife Habitat Evaluation: Critical Information for Ecological Risk Assessment, Land-use Management Activities, and Biodiversity Enhancement. ASTM STP 1458. West Conshohocken, USA: ASTM International; 2004. p. 3–17.
  52. 52. Caro T, O’Doherty G. On the use of surrogate species in conservation biology. Conservation Biology. 1999;13(4):805–14.
  53. 53. Landres PB, Verner J, Thomas JW. Ecological uses of vertebrate indicator species: a critique. Conservation Biology. 1988;2(4):316–28.
  54. 54. Torre I, López-Baucells A, Stefanescu C, Freixas L, Flaquer C, Bartrina C, et al. Concurrent Butterfly, Bat and Small Mammal Monitoring Programmes Using Citizen Science in Catalonia (NE Spain): A Historical Review and Future Directions. Diversity. 2021;13(9):454.
  55. 55. Hutto RL. Using landbirds as an indicator species group. In: Marzluff JM, Sallabanks R, editors. Avian Conservation: Research and Management. 1st ed. Washington, DC, US: Island Press; 1998. p. 75–92.
  56. 56. Franco A, Anderson BJ, Roy DB, Gillings S, Fox R, Moilanen A, et al. Surrogacy and persistence in reserve selection: landscape prioritization for multiple taxa in Britain. Journal of Applied Ecology. 2009;46(1):82–91.
  57. 57. Dyer RJ, Gillings S, Pywell RF, Fox R, Roy DB, Oliver TH. Developing a biodiversity-based indicator for large-scale environmental assessment: a case study of proposed shale gas extraction sites in Britain. Journal of Applied Ecology. 2017;54(3):872–82.
  58. 58. Rieradevall M, Bonada N, Prat N. Community structure and water quality in Mediterranean streams of a Natural Park (Sant Llorenç del Munt, NE Spain). Limnetica. 1999;17:45–56.
  59. 59. López-Blanco M, Marzo M, Burbank D, Vergés J, Roca E, Anadón P, et al. Tectonic and climatic controls on the development of foreland fan deltas: Montserrat and Sant Llorenç del Munt systems (Middle Eocene, Ebro Basin, NE Spain). Sedimentary Geology. 2000;138(1–4):17–39.
  60. 60. Pintó J, Panareda JM. Memòria del mapa de la vegetació de Sant Llorenç del Munt. Barcelona: Aster; 1995. 168 p.
  61. 61. Sáez L, López J, Carnicero P. Inventariació de la flora al·lòctona de caràcter invasor del Parc Natural de Sant Llorenç del Munt i Serra de l’Obac. Barcelona: Diputació de Barcelona, Àrea d’espais Naturals, 2015.
  62. 62. Carreras J, Ferré A, Vigo J. Manual dels hàbitats de Catalunya. Barcelona: Departament de Territori i Sostenibilitat; 2015.
  63. 63. Vigo J, Carreras J, Ferré A. Manual dels hàbitats de Catalunya. 1st ed. Barcelona: Departament de Medi Ambient i Habitatge, Generalitat de Catalunya; 2005.
  64. 64. Salvat A, Monje X. Pla estratègic de conservació dels hàbitats i la flora de la Xarxa de Parcs Naturals de la Diputació de Barcelona (Projecte-G018). Barcelona: Diputació de Barcelona, 2008.
  65. 65. Salvat A, Sáez L. Revisió i actualització del Pla estratègic de conservació dels hàbitats i la flora de la Xarxa de Parcs Naturals de la Diputació de Barcelona: flora vascular autòctona (PECFV). Barcelona: Diputació de Barcelona, 2016.
  66. 66. Puig-Gironès R, Brotons L, Pons P. Aridity influences the recovery of Mediterranean shrubland birds after wildfire. PLoS ONE. 2017;12(3):e0173599. pmid:28355225
  67. 67. Clarke KR. Non-parametric multivariate analyses of changes in community structure. Australian journal of ecology. 1993;18(1):117–43.
  68. 68. Vane-Wright R. Identifying priorities for the conservation of biodiversity: systematic biological criteria within a socio-political framework. In: Gaston KJ, editor. Biodiversity: a biology of numbers and difference. Oxford, UK: Blackwell Science Ltd; 1996. p. 309–44. https://doi.org/10.1016/0169-5347(96)81143-8 pmid:21237890
  69. 69. McGeoch MA, Chown SL. Scaling up the value of bioindicators. Trends in Ecology & Evolution. 1998;13(2):46–7. pmid:21238197
  70. 70. Krebs CJ, Boutin SA, Boonstra R. Ecosystem Dynamics of the Boreal Forest: the Kluane Project. 1rs ed. Oxford, UK: Oxford University Press; 2001. 544 p.
  71. 71. Krebs CJ, Boonstra R, Boutin SA, Sinclair AR, Smith JN, Gilbert BS, et al. Trophic dynamics of the boreal forests of the Kluane Region. Arctic. 2014;67:71–81.
  72. 72. Krebs CJ, Cowcill K, Boonstra R, Kenney AJ. Do changes in berry crops drive population fluctuations in small rodents in the southwestern Yukon? Journal of Mammalogy. 2010;91(2):500–9.
  73. 73. Peters DP, Groffman PM, Nadelhoffer KJ, Grimm NB, Collins SL, Michener WK, et al. Living in an increasingly connected world: a framework for continental-scale environmental science. Frontiers in Ecology and the Environment. 2008;6(5):229–37.
  74. 74. Robertson GP, Collins SL, Foster DR, Brokaw N, Ducklow HW, Gragson TL, et al. Long-term ecological research in a human-dominated world. BioScience. 2012;62(4):342–53.
  75. 75. Vitousek PM. Beyond global warming: ecology and global change. Ecology. 1994;75(7):1861–76.
  76. 76. Moriarty P, Hodgson E, Froehlich H, Hennessey S, Marshall K, Oken K, et al. The need for validation of ecological indices. Ecological Indicators. 2018;84:546–52.
  77. 77. Failing L, Gregory R. Ten common mistakes in designing biodiversity indicators for forest policy. Journal of environmental management. 2003;68(2):121–32. pmid:12781752