Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A statistically rigorous sampling design to integrate avian monitoring and management within Bird Conservation Regions

  • David C. Pavlacky Jr. ,

    Roles Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    david.pavlacky@birdconservancy.org

    Affiliation Bird Conservancy of the Rockies, Brighton, Colorado, United States of America

  • Paul M. Lukacs ,

    Contributed equally to this work with: Paul M. Lukacs, Jennifer A. Blakesley, Robert C. Skorkowsky, David S. Klute, David J. Hanni

    Roles Conceptualization, Formal analysis, Methodology, Software, Writing – review & editing

    Affiliation Wildlife Biology Program, Department of Ecosystem and Conservation Sciences, W.A. Franke College of Forestry and Conservation, University of Montana, Missoula, Montana, United States of America

  • Jennifer A. Blakesley ,

    Contributed equally to this work with: Paul M. Lukacs, Jennifer A. Blakesley, Robert C. Skorkowsky, David S. Klute, David J. Hanni

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Writing – review & editing

    Affiliation Bird Conservancy of the Rockies, Brighton, Colorado, United States of America

  • Robert C. Skorkowsky ,

    Contributed equally to this work with: Paul M. Lukacs, Jennifer A. Blakesley, Robert C. Skorkowsky, David S. Klute, David J. Hanni

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Writing – review & editing

    Affiliation Chugach National Forest, Cordova Ranger District, United States Forest Service, Cordova, Alaska, United States of America

  • David S. Klute ,

    Contributed equally to this work with: Paul M. Lukacs, Jennifer A. Blakesley, Robert C. Skorkowsky, David S. Klute, David J. Hanni

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Writing – review & editing

    Affiliation Colorado Parks and Wildlife, Denver, Colorado, United States of America

  • Beth A. Hahn ,

    Roles Funding acquisition, Project administration, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Aldo Leopold Wilderness Research Institute, Missoula, Montana, United States of America

  • Victoria J. Dreitz ,

    Roles Investigation, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Avian Science Center and Wildlife Biology Program, Department of Ecosystem and Conservation Sciences, W.A. Franke College of Forestry and Conservation, University of Montana, Missoula, Montana, United States of America

  • T. Luke George ,

    Roles Data curation, Funding acquisition, Investigation, Project administration, Writing – review & editing

    ‡ These authors also contributed equally to this work.

    Affiliation Bird Conservancy of the Rockies, Brighton, Colorado, United States of America

  • David J. Hanni

    Contributed equally to this work with: Paul M. Lukacs, Jennifer A. Blakesley, Robert C. Skorkowsky, David S. Klute, David J. Hanni

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Writing – review & editing

    Current address: Tennessee Wildlife Resources Agency, Nashville, Tennessee, United States of America.

    Affiliation Bird Conservancy of the Rockies, Brighton, Colorado, United States of America

Abstract

Monitoring is an essential component of wildlife management and conservation. However, the usefulness of monitoring data is often undermined by the lack of 1) coordination across organizations and regions, 2) meaningful management and conservation objectives, and 3) rigorous sampling designs. Although many improvements to avian monitoring have been discussed, the recommendations have been slow to emerge in large-scale programs. We introduce the Integrated Monitoring in Bird Conservation Regions (IMBCR) program designed to overcome the above limitations. Our objectives are to outline the development of a statistically defensible sampling design to increase the value of large-scale monitoring data and provide example applications to demonstrate the ability of the design to meet multiple conservation and management objectives. We outline the sampling process for the IMBCR program with a focus on the Badlands and Prairies Bird Conservation Region (BCR 17). We provide two examples for the Brewer’s sparrow (Spizella breweri) in BCR 17 demonstrating the ability of the design to 1) determine hierarchical population responses to landscape change and 2) estimate hierarchical habitat relationships to predict the response of the Brewer’s sparrow to conservation efforts at multiple spatial scales. The collaboration across organizations and regions provided economy of scale by leveraging a common data platform over large spatial scales to promote the efficient use of monitoring resources. We designed the IMBCR program to address the information needs and core conservation and management objectives of the participating partner organizations. Although it has been argued that probabilistic sampling designs are not practical for large-scale monitoring, the IMBCR program provides a precedent for implementing a statistically defensible sampling design from local to bioregional scales. We demonstrate that integrating conservation and management objectives with rigorous statistical design and analyses ensures reliable knowledge about bird populations that is relevant and integral to bird conservation at multiple scales.

Introduction

Over the past two decades, conservation biologists have shifted emphasis from monitoring bird populations at small spatial and temporal scales to considering population responses at eco-regional and decadal scales [13]. Monitoring over large spatial extents is necessary for evaluating regional processes of landscape change such as habitat loss, fragmentation, degradation and succession, as well as climate change [1, 4]. Continental programs such as the North American Breeding Bird Survey (BBS; [5, 6]) and Pan-European Common Bird Monitoring Scheme (CBMS; [7, 8]) have contributed much to our understanding of avian population processes operating over large spatial and temporal scales. In addition, adopting a hierarchical frame of reference at local and eco-regional scales is fundamental to interpreting local environmental effects in the context of processes operating at broader temporal and spatial scales [911]. For example, monitoring over multiple scales is important for establishing the linkage between small-scale, short-term conservation efforts and large-scale, long-term population trajectories [12, 13]. The cross-scale linkages foster a mechanistic understanding of the interaction between local and regional processes necessary to manage populations [14, 15].

The usefulness of long-term monitoring to large-scale bird conservation depends upon the extent to which monitoring is integrated within a larger framework of management and conservation [2, 10, 16]. Quality monitoring data is essential for conservation science where hypothesis-based predictions are compared to observed population responses to inform management [2, 16]. Statistically defensible monitoring designs for estimating population state variables are needed to address uncertainties for the conservation of bird populations [4, 17, 18]. In addition, monitoring data are essential for the application of adaptive management, with sampling designs integrated within the management and decision making process [4, 19, 20]. The effective conservation and management of bird populations requires a foundation of a priori monitoring objectives [2, 10], such as to 1) determine the status and trends of populations at various spatial scales, 2) inform management and policies to achieve conservation, 3) determine causes of population change, 4) evaluate conservation actions, 5) set population objectives and management priorities and 6) inform conservation planning [21].

Although monitoring is an essential component of wildlife management and conservation [1, 22], the lack of regional coordination often undermines its usefulness over large spatial scales [14, 23]. Historically, avian monitoring to address conservation objectives has entailed the creation of a large number of independent monitoring programs at the scale of local management units [10, 24]. However, even when local monitoring programs are co-located within a region of interest, limited spatial representation, inconsistent designs and disparate protocols often preclude reliable inferences about bird populations at larger spatial scales [14, 24, 25]. Limited coordination across disparate monitoring programs, and different organizations and regions results in the inefficient use of monitoring resources and underrepresentation of important regions such as private lands [23].

The lack of rigorous sampling designs is a pervasive problem in many large-scale monitoring programs [2, 25]. Design-based theory for large-scale monitoring programs is well-developed with advantages such as statistically defensible population state variables, minimum estimates of precision and strong inference to regions of interest [2628]. However, it is often argued that probabilistic sampling is not practical for large scale monitoring [25]. The development of contiguous sampling frames over large regions is often compromised by the incomplete availability of sampling units related to unsafe terrain or landowner permission, and simple random probability sampling is not valid under these frame imperfections [29]. Nevertheless, subjective or convenience samples from atypical areas such as protected reserves or roadways often result in unrepresentative inference and biased population state variables for the region of interest [25, 30]. Sampling solutions are available to address practical difficulties involved with large-scale monitoring designs [29, 31] and these represent preferred alternatives to inferential problems associated with convenience sampling and population indices [25, 27, 32].

Growing concerns about the sustainability of ecosystems, desire from agencies to collaborate across boundaries, and recognition of inherent methodological problems have fostered renewed efforts to improve large-scale monitoring toward a strong science-based foundation for the conservation of birds [2, 21, 23]. In 2008, we designed the Integrated Monitoring in Bird Conservation Regions (IMBCR) Program to overcome many of the historical problems associated with monitoring bird populations at large spatial and temporal scales. The collaboration across organizations and regions focused on leveraging a common data platform over large spatial scales to promote the efficient use of monitoring resources [10, 24]. We designed the IMBCR program using sampling theory to provide a statistical foundation for reliable knowledge about bird populations with the ability to address management and conservation objectives at multiple spatial scales [2628]. The IMBCR program developed within the context of the U. S. North American Bird Conservation Initiative (NABCI) Monitoring Subcommittee recommendations [21] to 1) integrate monitoring into bird management and conservation, 2) coordinate monitoring programs among organizations and integrate them across spatial scales, 3) increase the value of monitoring information by improving statistical design and 4) maintain bird population monitoring data in modern data management systems.

The IMBCR partnership represents a collaboration between federal and state agencies, Native American Nations, non-governmental organizations and universities working together to develop a strong scientific foundation for achieving bird conservation. The collaboration fits under the umbrella of large-scale conservation programs such as the NABCI [33, 34], Partners in Flight [35], Landscape Conservation Cooperatives [36] and North American Bird Habitat Joint Ventures [37].

Our objectives are to 1) outline the development of a statistically defensible sampling design to increase the value of large-scale monitoring data and 2) provide example applications to demonstrate the ability of the design to meet multiple conservation and management objectives. First, we provide a general outline of the sampling design for the entire IMBCR program from 2010–2015, with a narrowed focus on the Badlands and Prairies Bird Conservation Region (BCR 17) to outline the sampling process within a single BCR. Second, we present two example conservation applications in BCR 17: the first demonstrates hierarchical population estimation to evaluate landscape change for the Brewer’s sparrow (Spizella breweri), a species of conservation concern; and the second illustrates multi-scale habitat relationships and distribution modelling to predict the response of the Brewer’s sparrow to conservation practices.

Materials and methods

Sampling frame

We defined the target population [28, 38] as all adult individuals of a bird population occupying a BCR [39, 40] during the breeding season for a particular year. We defined the Primary Sampling Unit (PSU) as a 1-km2 grid cell and developed the sampling frame for the population by imposing a spatially referenced 1-km × 1-km grid over the BCR [41]. All PSUs in the sampling frame are available to be sampled thus the IMBCR sampling design is able to make valid inference to the entire population in the BCR [28].

The 2010 sampling frame of the IMBCR program included Colorado, Wyoming, most of Montana and the entire BCR 17 (1,160,324 km2). In 2011, the sampling frame extended to the entire state of Montana (1,165,265 km2) with modest changes between 2012 and 2015. The 2015 sampling frame for the IMBCR program encompassed 1,166,973 km2, spanning the entire BCR 17 and portions of the Great Basin, Northern Rockies, Prairie Potholes, Southern Rockies/Colorado Plateau, Shortgrass Prairie, Central Mixed-grass Prairie and Sierra Madre Occidental BCRs (Fig 1). The 2015 sampling frame included the states of Colorado, Montana and Wyoming, and portions of Arizona, Idaho, Kansas, Nebraska, New Mexico, North Dakota, Oklahoma, South Dakota, Texas and Utah (Fig 1). We presented the sampling frame for the entire IMBCR program in 2015 as an example of the spatial extent of the Program, with a narrowed focus on BCR 17 to outline the sampling process for a single BCR. We sampled the entire BCR 17 continually between 2010 and 2015, and the area of inference for BCR 17 encompassed 364,497 km2 in 2015 (S1 Table).

thumbnail
Fig 1. The spatial extent of the 2015 Integrated Monitoring in Bird Conservation Regions Program.

The hatched region represents the area of inference and the round symbols represent the locations of Primary Sampling Units (1-km2 grid cells) within the 9) Great Basin, 10) Northern Rockies, 11) Prairie Potholes, 16) Southern Rockies, 17) Badlands and Prairies, 18) Shortgrass Prairie, 19) Central Mixed-grass Prairie and 34) Sierra Madre Occidental Bird Conservation Regions.

https://doi.org/10.1371/journal.pone.0185924.g001

Stratification

We developed a hierarchical stratification scheme [42] to provide a basis for estimating population state variables at multiple spatial scales (Fig 2). At the first-level, we stratified the sampling frame by the intersection of BCRs and states (e.g., Wyoming portion of BCR 17). At the second-level, we stratified each BCR-by-state region according to the areas of interest, local needs and conservation objectives of the partners. The smallest-order stratification within each BCR-by-state region was based on fixed attributes such as land ownership or management boundaries, latitudinal zones, elevation zones, or major river systems. We included a stratum composed primarily of private land within each BCR-by-state region, which was important for making inference to the entire biological population in the BCR. The flexible stratification scheme allowed each agency or state to stratify their portion of a BCR differently to meet their needs. In addition to providing inference at the level of individual management units, the hierarchical framework allowed strata to be aggregated-up to make inferences at higher-order levels such as BCRs, states and sub-regions, such as agency or private land designations [42].

thumbnail
Fig 2. The hierarchical design of the Integrated Monitoring in Bird Conservation Regions Program.

The figure illustrates distance intervals nested within Secondary Sampling Units (SSU, point count plots), SSUs nested within Primary Sampling Units (PSU, 1-km2 grid cells), PSUs nested within the Thunder Basin National Grassland stratum, and the Thunder Basin National Grassland, Bureau of Land Management and State strata nested within the Badlands and Prairies Bird Conservation Region (BCR 17).

https://doi.org/10.1371/journal.pone.0185924.g002

Here we present year 2015 stratification as an example of the stratification scheme for the IMBCR program, with greater detail for stratification in BCR 17. During 2015 we coordinated with program partners to delineate 171 strata within all or portions of eight BCRs and 13 states (Fig 1). The mean area of the strata for the entire IMBCR program in 2015 was 6,824 km2 (SD = 14,367). The stratification scheme for BCR 17 in 2015 included 37 strata (S1 Table), and the mean area of the strata was 9,851 km2 (SD = 23,793).

Sampling design

We developed a two-stage stratified random sampling design [28], in which the first-stage of the design corresponded to the selection of PSUs from the sampling frame of each stratum, and the second-stage represented Secondary Sampling Units (SSU, point count locations) within the selected PSUs. We used a systematic design to locate 16 SSUs within each PSU (Fig 2; [41]). The SSUs were separated by 250 m and located ≥ 125 m from the PSU boundary (Fig 2). The 250 m spacing of the SSUs provides an effective soundscape of 125 m with adequate audible coverage of the PSU for many species. In addition, the 125 m-radius point count plot (4.9 ha) is relevant to the territory sizes of many landbird species and is expected to contain all but the largest territories of most songbird (Passeriformes) species [43, 44]. Because the SSUs within PSUs are dependent by definition [25], we recommend estimation approaches, such as those discussed below, that account for the non-independence of SSUs and avoid double counting of strong singing species. The decision to cluster a relatively large number of SSU subsamples within the selected PSUs was based on increasing sampling efficiency for situations where travel time between widely spaced PSUs is considerable [25]. We require a minimum sample of 4 SSUs per PSU (25%) when private landowners deny permission to survey the SSUs.

Within each stratum, we selected the PSUs using generalized random-tessellation stratification (GRTS; [29]) and thus all PSUs in the sampling frame were ordered such that any set of consecutively numbered units was a spatially balanced sample [29]. We ensured all strata received a minimum of two PSUs to estimate strata-specific variance estimates [28]. We did not specify a minimum sampling fraction for strata because sample allocation was largely determined by partner objectives. Although a minimum sample size of 2 PSUs per stratum was occasionally justified by partner objectives to achieve regional population estimates, inference to an individual stratum requires consideration of the size and variability of a stratum [28, 38], with recommended sample sizes ≥10 PSUs per stratum. Except for cases involving re-stratification, we sampled the same set of PSUs in successive years. However, IMBCR partners can adjust annual sampling intensity within a stratum without compromising the spatially-balanced design, which is particularly useful when budgets or sampling priorities change over time. A clear advantage of GRTS over simple random sampling is the spatially-balanced property of the sample is maintained when access to a PSU is not possible, such as when private landowners deny access permission or dangerous terrain exists [29]. Within the IMBCR sampling design, all areas and vegetation types, including urban and suburban areas, within the sampling frame have a non-zero probability of being included in the sample [28, 45]. Population estimation from a stratified random design requires calculating the probability a sample unit will be selected such that inclusion probabilities are equal for all sampling units in a stratum [38, 46].

Here we present the sampling intensity for year 2015 as an example of sample allocation for the IMBCR program. In year 2015, we sampled 1,225 PSUs in 171 strata throughout the entire IMBCR program. The mean sample size for strata weighted by the number of PSUs in the strata was 9.6 (SD = 7.3), and the mean inclusion probability for the strata weighted by stratum area was 0.0010 (SD = 0.0062). During 2015, we sampled 13,896 SSUs in the second stage of the design throughout the entire IMBCR program, resulting in a mean of 11.3 SSUs per PSU (SD = 2.3). The reasons for incomplete sampling of the SSUs are listed below. During 2015, we sampled 242 PSUs in 37 strata throughout BCR 17 (S1 Table). The mean sample size of PSUs for BCR 17 strata weighted by the number of PSUs in the strata was 9.5 (SD = 7.1), and the mean inclusion probability for the strata weighted by stratum area was 0.0007 (SD = 0.0076). During 2017, we sampled 2,668 SSUs in the second stage of the design throughout BCR 17, resulting in a mean of 11.0 SSUs per PSU (SD = 1.9).

Data collection protocol

The field observers attended two training programs each year to ensure full understanding of the field protocol, bird and plant identification, and distance estimation using laser rangefinders in a variety of vegetation types. Timing of field visits to the sampling units was structured by latitude and elevation to ensure the visits corresponded to the breeding-season phenology for most species. The observers conducted surveys beginning one half-hour before sunrise and concluding no later than five hours after sunrise. Reasons for observers not surveying all 16 SSUs per grid included running out of time from difficult terrain, wet or windy weather, landowner permission and unsafe terrain. At each SSU, observers conducted six-minute point counts [47]. The observers recorded all non-independent detections of birds (i.e., flocks or pairs of conspecifics in close proximity) as part of a cluster. In addition, observers collected ocular vegetation data within a 50 m-radius of the point count location, including dominant vegetation type, percent cover and mean height of the tree and shrub layers, relative composition of trees and shrubs by species, and height and composition of ground cover types. More detailed information about the data collection protocols can be found at the Rocky Mountain Avian Data Center [48].

Because counts at survey locations do not include all species or individuals present at the sampled locations, we developed data collection protocols at the point locations to accommodate a variety of methods for estimating incomplete detection [45, 49, 50]. The data collection protocol included point-transect distance sampling with distances to independent clusters of individuals measured using a laser rangefinder [49]. The data were recorded separately for each minute interval of the point count, which allowed removal-in-time methods for estimating incomplete detection [45, 50]. In addition, the hierarchical structure of the sampling design (Fig 2) is well suited for estimating detection and availability in hierarchical models of abundance [51], site occupancy [52] and species richness [23]; with distance and minute intervals nested within SSUs, SSUs nested within PSUs, PSUs nested within strata, and strata nested within BCRs (Fig 2).

Ethics statement

Avian monitoring on U. S. National Park Service (NPS) lands was conducted in accordance with the NPS Institutional Animal Care and Use Committee. Between 2010 and 2015 the Bird Conservancy of the Rockies obtained 170 permits to conduct bird monitoring on 40 parks administered by the NPS, and all permits were archived within NPS Research Permit and Reporting System [53]. Avian monitoring on lands administered by the U. S. Bureau of Land Management, U. S. Department of Defense, U. S. Forest Service, U. S. National Wildlife Refuge System and State Land Trusts did not require permits because of long standing working relationships and agency approval of non-invasive field protocols. Permission to access public or private lands were approved by agency representatives or landowners, respectively and a small number of protected species were detected. The field observers spend < 10 min at SSU point count locations, and the field protocols do not involve animal capture, collections or luring tactics such as call playback, resulting in minimal disturbance to breeding birds.

Statistical analyses

We estimated annual densities and population sizes for all species with ≥ 80 detections using point-transect distance sampling implemented in the mrds package [49, 54]. We estimated mean population density for PSUs in each stratum () by pooling counts among SSUs within PSUs and dividing by effort defined as the number of SSUs within each PSU [25, 55]. For species with ≥ 80 independent detections per year, we fit year-specific, half-normal and hazard-rate detection functions with 10% truncation and no series expansions using Conventional Distance Sampling (CDS). For species with < 80 detections per year, we fit global half-normal and hazard-rate CDS detection functions across years, as well as global detection functions with a factor covariate for year using multiple covariate distance sampling [49]. We evaluated the detection functions for each species using information-theoretic model selection [49, 56]), and used the most parsimonious detection function in the estimation model for each species.

We aggregated estimates of stratum-level densities and population sizes using a weighted one-stage stratified random estimator , where was the aggregated density estimate, n was the number of strata, wi was the proportion of PSUs in stratum i, and was the density estimate for stratum i [28]. We approximated the variance of the aggregated density and population size estimates using the delta method [57] and Horvitz-Thompson-like estimator [58]. We provided 90% Confidence Intervals (CI) for stratum-level estimates of population density and lognormal CIs for mean density and population size [55].

We estimated site occupancy for all species with >10 detections per year using a multi-scale occupancy model [41, 59] using the RMark [54, 60] interface for program MARK [61]. The parameters of the model included the probability of detection given presence at the SSUs and PSUs (p), probability of small-scale occupancy for SSUs given presence at the PSUs (θ), and probability of large-scale occupancy for the PSUs (ψ). We truncated the data at 125 m, which resulted in 16 independent SSUs (4.9-ha point count plots) within each PSU. We pooled the six minute intervals of the point counts into three two-minute time intervals and estimated detection probabilities using a removal design [41, 50]. We aggregated stratum-level estimates of large-scale occupancy using the above, one-stage stratified random estimator, approximated the variance of the aggregated occupancy estimates using the delta method [57] and provided 90% CIs.

Example 1: hierarchical population estimation to evaluate landscape change.

In the first example, we demonstrate the utility of the hierarchical sampling design for estimating population responses of the Brewer’s sparrow to landscape change within a management unit relative to reference regions in BCR 17. We monitored the population density of the Brewer’s sparrow in the U.S. Forest Service, Thunder Basin National Grassland, WY before and after extensive wildland fires occurred in autumn 2011 (>1,800 ha; [62]). We compared density estimates from the Thunder Basin National Grassland to density estimates in reference regions at multiple scales over time from 2010 to 2015 (Fig 2). The evaluation of a “natural experiment” within a management unit in comparison to reference regions over time allowed the separation of spatial and temporal processes similar to a before-after-control-impact (BACI) design [63]. We predicted a decline in the population density of the Brewer’s sparrow on the Thunder Basin National Grassland following the fires of 2011, but predicted the decline would not be apparent in the reference regions for the Wyoming and BLM portions of BCR 17. In addition, we estimated the population size of Brewer’s sparrows on the Thunder Basin National Grassland, Wyoming portion of the Badlands and Prairies BCR and the entire BCR to evaluate large-scale population consequences from landscape change in the Thunder Basin National Grassland (Fig 2). We estimated effect sizes for the difference between mean population density for 2010 and 2011 before the fires in the autumn of 2011, and mean population density for 2012–2015 following the fires. We estimated the standard errors of the means for the two time periods, and the standard errors of the effect sizes using the delta method [57]. We used 90% CIs with respect to zero to establish magnitude and precision of the effect sizes.

Example 2: multi-scale habitat relationships to inform management and conservation.

In the second example, we illustrate the applicability of the design for developing habitat and landscape relationships to inform habitat management and landscape conservation in BCR 17. We used presence-absence data at SSUs (4.9-ha point count plots) and PSUs (1-km2 grid cells) from 2010 and 2011 to evaluate hypotheses for Brewer’s sparrow occupancy at the local and landscape scales. Multi-scale occupancy is well suited for addressing questions of hierarchical habitat use to understand the primary drivers of a species’ geographic range at the landscape scale, with nested micro-habitat drivers at the local scale [41, 64]. For the purpose of this study, we defined the local scale as processes influencing micro-habitat conditions operating within 4.9-ha SSU plots, and the landscape scale as processes influencing the extent of vegetation operating within 1-km2 PSU grid cells [65]. At the local scale, we hypothesized Brewer’s sparrow occupancy of the SSUs would decline with increasing bare ground cover, non-sagebrush shrub cover and woodland canopy cover, and increase with increasing big sagebrush (Artemisia tridentata) shrub cover. At the landscape scale, we hypothesized Brewer’s sparrow occupancy of PSUs would increase with the land cover of big sagebrush and mountain big sagebrush (A. tridentata vaseyana).

At the local scale, we modeled the small-scale occupancy of the SSUs (θ) as a function of covariates for ground, shrub and woodland cover collected at the SSU locations. At the landscape scale, we modeled the large-scale occupancy of PSUs (ψ) as a function of covariates for the land cover of vegetation types within PSUs using the Landfire dataset [66]. The 30 m2 grain of Landfire dataset [66] was adequate for evaluating variation in land cover among the 1-km2 PSUs, and the 1-km2 grain of the resulting species distributions is relevant to all but the smallest management units. We developed a priori hypotheses for positive and negative covariate effects on Brewer’s sparrow occupancy [56], but used a data screening step to determine the functional form of the i covariates (xi) for small-scale (θ) and large-scale (ψ) occupancy. For each of the occupancy parameters, we forced non-linear [βloge(xi)] and quadratic (βxi + βxi2) forms of the covariates into the full model of main effects one at a time, and selected the functional form with the minimum Akaike Information Criterion adjusted for sample size (AICc; [56]). We used plausible combinations model selection [67] to identify reduced covariate models for small-scale and large-scale occupancy. In the first step of the plausible combination approach [67], we evaluated all-subsets of the covariates for each parameter, while holding the other parameters constant at the full model. In the first step, we evaluated 6 models for detection probability (p), 28 models for small-scale occupancy (θ) and 22 Models for large-scale occupancy (ψ). In the second step of the plausible combination approach [67], we combined all plausible sub-models for the parameters that exhibited a change in AICc (ΔAICc) < 2, resulting in a candidate set of 5 models. We created the Brewer’s sparrow distribution map by model averaging [56] the predictions of large-scale occupancy (ψ) from the candidate set of 5 plausible models using the values of the landscape-scale covariates at spatially referenced PSUs (1-km2 grid cells) in the sampling frame.

Results

We begin by presenting a summary of density and occupancy estimation for 2015 as an example of annual population estimation from the IMBCR program. During 2015, we detected 306 bird species throughout the entire IMBCR program, and estimated density and population size for 231 species, of which 156 occurred in BCR 17. We estimated large-scale occupancy for 232 species in 2015, of which 154 occurred BCR 17. The Coefficient of Variation (CV) of the density and occupancy estimates provides a diagnostic for the performance of the sampling design. S1 Fig shows the distribution of the CV for 2015 estimates of population density () and large-scale occupancy () in BCR 17. The hierarchical sampling design (Fig 2) allowed population estimates for the 231 species to be aggregated at various spatial scales as illustrated by the Brewer’s sparrow in BCR 17 (Fig 3). The general location of the bird detections at PSUs can be visualized, and the occupancy and density estimates, as well as the raw counts for SSUs and PSUs, can be retrieved from the Rocky Mountain Avian Data Center [48].

thumbnail
Fig 3. The estimated population density of the Brewer’s sparrow at multiple spatial scales, 2010–2015.

(A) U.S. Forest Service, Thunder Basin National Grassland, Wyoming. (B) U.S. Bureau of Land Management lands in the Badlands and Prairies Bird Conservation Region (BCR 17). (C) Wyoming portion of BCR 17. (D) Entire BCR 17. The filled symbols are estimates of population density (km-2), the error bars are 90% confidence intervals and the vertical dashed arrow represents the timing of wildland fires in the Thunder Basin National Grassland.

https://doi.org/10.1371/journal.pone.0185924.g003

We provided graphs of the most parsimonious detection functions for the Brewer’s sparrow between 2010 and 2015 in S2 Fig as an example of point transect distance sampling to estimate population density from the IMBCR program. Because the Brewer’s sparrow exhibited >80 detections per year, we fit year-specific detection functions for this species. Model selection provided support for hazard-rate detection functions in 2010, 2011, 2014 and 2015, and half-normal detection functions in 2012 and 2013 (S2 Fig).

Example 1: hierarchical population estimation to evaluate landscape change

In the first example, the mean population density (km-2) of the Brewer’s sparrow in 2011 and 2010 on the Thunder Basin National Grassland was 53.8 (SE = 11.7; CI = 37.8, 76.5) before the wildland fires in the autumn of 2011 and mean population density (km-2) from 2012 to 2015 was 26.3 (SE = 5.0; CI = 19.0, 35.9) after the fires (Fig 3A). The effect size for the decline in mean population density (km-2) after the wildfires was -27.7 (SE = 12.7; CI = -48.3, -6.5). Because the decline in population density (km-2) was not observed in the BLM reference (Fig 3B; effect size = 19.6; SE = 7.9; CI = 6.5, 32.7) and Wyoming (Fig 3C; effect size = 1.3; SE = 8.5; CI = -12.7, 15.4) regions in BCR 17 after the autumn of 2011, the BACI design ruled out spatial and temporal variation as a source of the decline, and provided strong evidence the decline was related to landscape change in the Thunder Basin National Grassland. The mean population size of the Brewer’s sparrow in 2010 and 2011 on the Thunder Basin National Grassland before the fires was 243,014 (SE = 52,637; CI = 170,866, 345,624) and the mean population size from 2012 to 2015 after the fires was 117,859 (SE = 22,615; CI = 86,202, 161,141). The effect size for mean population size indicated the Brewer’s sparrow in the Thunder Basin National Grassland declined by 125,155 (SE = 57,290; CI = 61,072, 256,476), a 48% (SE = 14; CI = 30, 78) reduction, after the wildland fires in the autumn of 2011. The population decline of 125,155 amounted to 6% (SE = 3; CI = 3, 15) of the mean population size for the pre-fire years in the Wyoming portion of BCR 17 () and 2% (SE = 1; CI = 0, 5) of the mean population size for the pre-fire years in BCR 17 (). Although evaluating population consequences of landscape change over time relative to reference regions is a strength of the IMBCR program, inference to population change must include the possibility that Brewer’s sparrows emigrated from the Thunder Basin National Grassland and redistributed in BCR 17 following the wildfires.

Example 2: multi-scale habitat relationships to inform management and conservation

In the second example, we confirmed the hypotheses that small-scale occupancy of the Brewer’s sparrow at the local scale declined with increasing bare ground (Fig 4A) and woodland (Fig 4D) cover, and increased with increasing big sagebrush shrub cover (Fig 4B; S2 and S3 Tables). The nonlinear effects [βloge(xi)] of bare ground (Fig 4A) and big sagebrush shrub (Fig 4B) cover suggested thresholds in the occupancy response (S2 and S3 Tables). We were unable to confirm the hypothesis that the small-scale occupancy of the Brewer’s sparrow declined with increasing non-sagebrush shrub cover (Fig 4C). Conversely, the quadratic effect (βx + βx2) of non-sagebrush shrub cover indicated Brewer’s sparrow occupancy of SSUs increased to an optimum of 11% other shrub cover and declined thereafter (Fig 4C; S2 and S3 Tables). The CIs for the effects of bare ground, big sagebrush shrub cover, quadratic term for other shrub cover and woodland canopy cover excluded zero, indicating measureable effect sizes for these covariates (S3 Table).

thumbnail
Fig 4. Local habitat relationships for the Brewer’s sparrow in the Badlands and Prairies Bird Conservation Region, 2010–2011.

(A) Bare ground cover. (B) Big sagebrush shrub cover. (C) Non-sagebrush shrub cover. (D) Woodland canopy cover. The bold trend lines are model averaged estimates of small-scale occupancy (θ) for Secondary Sampling Units (4.9-ha point count plots) at the mean values of the other covariates in the model and the bounding lines are unconditional 90% confidence intervals.

https://doi.org/10.1371/journal.pone.0185924.g004

At the landscape scale, we confirmed the hypotheses that the large-scale occupancy of the Brewer’s sparrow at the PSUs increased with increasing land cover of big sagebrush (Fig 5A) and mountain big sagebrush (Fig 5B; S2 and S3 Tables). The CIs for these effects excluded zero, and the standardized beta parameters provided evidence for a large non-linear [loge(x)] effect of big sagebrush land cover and a smaller linear effect of mountain big sagebrush land cover (S2 and S3 Tables'). The land cover of big sagebrush (Fig 5A) and mountain big sagebrush (Fig 5B) were strong drivers of the predicted occupancy distribution in BCR 17 (Fig 6; S3 Table).

thumbnail
Fig 5. Landscape relationships for the Brewer’s sparrow in the Badlands and Prairies Bird Conservation Region, 2011.

(A) Big sagebrush land cover. (B) Mountain big sagebrush land cover. The bold trend lines are model averaged estimates of large-scale occupancy (ψ) for Primary Sampling Units (1-km2 grid cells) at the mean values of the other covariates in the model and the bounding lines are unconditional 90% confidence intervals.

https://doi.org/10.1371/journal.pone.0185924.g005

thumbnail
Fig 6. The distribution of the Brewer’s sparrow from the Integrated Monitoring in Bird Conservation Regions Program, 2011.

The color ramp for the sampling frame of 1-km2 grid cells represent model averaged predictions of large-scale occupancy (ψ) for the most recent distribution in 2011. The inset shows the Brewer’s sparrow occupancy distribution within the Badlands and Prairies Bird Conservation Region at greater resolution.

https://doi.org/10.1371/journal.pone.0185924.g006

Discussion

Much has been made of improving the design and analysis of avian monitoring [27, 45, 68], yet the design recommendations have been slow to make their way into large-scale programs [30, 69, 70]. Although it is often assumed that probabilistic sampling is not practical for large-scale monitoring [25], the IMBCR program represents a precedence for implementing a statistically rigorous sampling design over large spatial scales that includes public, tribal and private land ownership [23]. The design of the program uses the principles of sampling theory to identify the target population, sampling frame and sampling unit [28, 46]. In addition, IMBCR employs a probabilistic sampling design, which is important for unbiased population estimates, valid estimates of precision and strong inference to the monitoring region [28]. The GRTS sampling design adjusts the sample selection for frame imperfections and provides a statistically defensible framework for estimating unbiased population state variables [29]. For example, the spatially balanced property of the GRTS sample is maintained when landowners deny permission to access sampling units, and when funding and sampling intensity varies between years [29].

Because avian responses to vegetation, landscape and climate change are scale-dependent [4, 71, 72], it is important to monitor bird populations at multiple spatial scales. The design of the IMBCR program (Fig 2) is well suited for monitoring bird populations at a variety of ecologically relevant scales from home ranges to eco-regions [41] and addressing biological questions within the theory of hierarchical habitat selection [64]. The hierarchical design facilitates the direct comparison of bird populations at local and regional scales, as well as among strata with different levels of human modification [11]. The comparison of population responses at local and eco-regional scales is particularly important for interpreting local environmental effects in context with processes operating at broader temporal and spatial scales [911]. For example, population responses at the local scale may not correspond to range-wide population responses for grassland bird species that regularly display nomadic movement in response to spatial weather patterns [73, 74].

The design of the IMBCR program is similar to the UK Breeding Bird Survey [70] and several national schemes within the Pan-European CBMS [8], but departs considerably from the North American BBS [6]. The IMBCR program and several programs in the CBMS [8] feature a sampling frame composed of 1-km2 sampling units, which provides sample inclusion probabilities and valid inference to regions of interest. The BBS sampling frame is composed of primary sampling units defined by 1° blocks of latitude and longitude [75, 76]. Because the BBS sampling frame and secondary routes within primary units are restricted to roadways [75, 76], inference about bird populations is limited to roaded areas.

The stratification of the IMBCR sampling frame is based on eco-region boundaries and other fixed attributes, and is useful for evaluating long-term responses of wildlife populations to landscape and climate change [11, 77]. In contrast, the CBMS recommends “habitat” stratification [8], which may not be compatible with the objectives of long-term monitoring [26]. Under stratification by vegetation type, strata boundaries often change with shifting vegetation mosaics and new samples must be drawn, resulting in changing sampling frames and inclusion probabilities over time [26]. Moreover, designs that re-sample shifting strata defined by homogenous vegetation may be incapable of detecting changes in bird populations due to landscape and climate change. The IMBCR design samples vegetation types in proportion to availability can easily accommodate post-stratification [46] by using vegetation data collected at the SSUs and inclusion probabilities for the PSUs. The BBS currently uses stratification by states and ecoregions to allocate sampling effort, but stratification was not a feature of the original design [6, 76].

The IMBCR program and several programs in the CBMS [18] employ data collection protocols that allow direct estimates of population size accounting for incomplete detection and provide valid estimates of precision [27, 45, 49]. Conversely, population estimation from the BBS requires several assumptions about the observation process without valid estimates of precision, and includes the assumption that population size along roads is identical in regions away from roads [25, 30].

Growing concerns about landscape and climate change and uncertainties about the response of bird populations to conservation and management highlight the importance of quality monitoring data over large spatial and temporal scales [1, 4, 11]. We designed the IMBCR program to address the core conservation and management objectives of the monitoring partnership, including federal and state land management agencies, and conservation programs such as NABCI [33, 34], Partners in Flight [35], Landscape Conservation Cooperatives [36] and North American Bird Habitat Joint Ventures [37]. The IMBCR program overcomes the limitations of monitoring in locally disconnected management units by seamlessly coordinating monitoring needs in adjacent strata composed of public, tribal and private landownership [23]. The IMBCR program is consistent with the principles of adaptive monitoring [78] in that the management and conservation objectives can be integrated within a conceptual hierarchical model of how bird populations are structured in space and time [4]. Adopting a hierarchical framework within an eco-regional context is necessary for establishing the linkage between local habitat management and regional bird populations [4, 14].

The example applications illustrate how the IMBCR program can inform the conservation and management of bird populations at multiple spatial scales. The first example showed how patterns of population density at management units can be compared to reference regions to evaluate temporal and spatial response to landscape change in much the same way as a BACI design [63]. The approach shows investment in a rigorous sampling design on the frontend can improve the value of the data to land managers on the backend without requiring complex statistical modelling. The design provides a statistically defensible framework for estimating population size and is able to determine the population consequences of landscape change at multiple spatial scales. The ability to link temporal trends to valid estimates population size at multiple spatial scales is a strength of the program [30]. Because the IMBCR design allows abundance estimation at a variety of spatial scales, we are able to place observed changes in a larger, regional context. For instance, we examined the impact of wildland fires on Brewer’s sparrow abundance over time in the Thunder Basin National Grassland, compared to time series in the Wyoming portion of BCR 17, BLM lands in BCR 17 and entire BCR 17. In the same way, hierarchical population estimation can be used to evaluate the contribution of local management actions to regional bird populations [4]. As bird populations continue to decline, estimates of environmental and anthropogenic impacts on population size are becoming a larger issue in bird conservation [35] and management [4].

The second example showed the IMBCR design is well suited for developing habitat and landscape relationships that can be used to predict species responses to habitat management at local and regional scales [41, 79]. At the local scale, habitat relationships are useful for predicting species responses to habitat management [80, 81]. The results suggest prescribed grazing to reduce bare ground cover (Fig 4A) and tree clearing to reduce woodland canopy cover (Fig 4D) may increase Brewer’s sparrow occupancy, whereas grazing practices that increase bare ground cover (Fig 4A) and shrub management that reduces big sagebrush canopy cover below 20% (Fig 4B) may produce declines in Brewer’s sparrow occupancy. At the landscape scale, predictive species distribution models are often used to prioritize landscapes for conservation action [82], and the results suggest landscapes with greater than 30% land cover of big sagebrush (Fig 5A) have the greatest conservation potential for maintaining high Brewer’s sparrow occupancy (Fig 6). Using the multi-scale approach, the local habitat relationships for the SSUs are nested within the predicted landscape distribution for the PSUs [41]. In this way, the hierarchical design of the IMBCR program provides a framework to go beyond simple landscape prioritization towards conservation planning to prioritize management actions in landscapes [83, 84].

In conclusion, we designed the IMBCR program to 1) integrate monitoring into bird management and conservation, 2) coordinate monitoring programs among organizations and integrate them across spatial scales and 3) increase the value of monitoring information by improving statistical design [21]. The design is well suited for addressing multiple management and conservation objectives at multiple spatial scales [2, 4]. Although adaptive management of land birds has lagged behind shorebirds [85] and waterfowl [86], we anticipate the IMBCR program will play an increasingly important role in the adaptive management [4, 19] and landscape conservation [87, 88] of land bird populations. Coordination across organizations and regions is the continuity that promotes frequent use of essential monitoring data within strong partnerships between policy-makers, land managers, conservationists and scientists [2, 10]. Because the design is based on the fundamentals of sampling theory [28, 38], the program ensures unbiased population estimates, valid estimates of precision and strong inference to bird populations in monitoring region. In addition, the hierarchical design (Fig 2) has a natural connection to hierarchical models [89] and model-based approaches for population and occupancy estimation [17, 18], trend estimation [90], landscape and habitat ecology [1, 80], species distribution modeling [79, 91] and community modeling [23, 92]. Finally, the hierarchical design of the IMBCR program provides a data platform to develop coordinated conservation strategies, prioritize management actions and geographic areas, and effectively address the “what to do” and “where to do it” questions in conservation planning [82].

Supporting information

S1 Table. Strata and sample sizes for the Badlands and Prairies Bird Conservation Region, 2015.

The strata, states, strata areas (km2), and numbers of Primary Sampling Units (PSU) and Secondary Sampling Units (SSU) in the Badlands and Prairies Bird Conservation Region (BCR 17), 2015. The agency abbreviations are BLM = Bureau of Land Management, USFWS = U. S. Fish and Wildlife Service, USFS = U. S. Forest Service and NPS = National Park Service. The state abbreviations are MT = Montana, ND = North Dakota, ND = North Dakota, NE = Nebraska and WY = Wyoming.

https://doi.org/10.1371/journal.pone.0185924.s001

(DOCX)

S2 Table. Model selection for multi-scale habitat relationships of the Brewer’s sparrow.

Model selection for detection (p), small-scale occupancy (θ) and large-scale occupancy (ψ) of the Brewer’s sparrow in the Badlands and Prairies Bird Conservation Region during 2010 and 2011. The model selection metrics are the minimized -2 log-likelihood value [], number of parameters (K), Akaike Information Criterion adjusted for sample size (AICc), difference between model and minimum AICc value (ΔAICc) and AICc weight (wi). Models with ΔAICc < 2 are shown.

https://doi.org/10.1371/journal.pone.0185924.s002

(DOCX)

S3 Table. Parameter estimates for multi-scale habitat relationships of the Brewer’s sparrow.

Standardized parameter estimates, standard errors (SE), lower and upper 90% confidence limits (LCL and UCL, respectively) for detection (p), small-scale occupancy (θ) and large-scale occupancy (ψ) of the Brewer’s sparrow in the Badlands and Prairies Bird Conservation Region, 2010–2011.

https://doi.org/10.1371/journal.pone.0185924.s003

(DOCX)

S1 Fig. Coefficient of Variation for density and occupancy in the Badlands and Prairies Bird Conservation Regions, 2015.

(A) Population density of 156 species. (B) Site occupancy of 154 species. The bar symbols represent the frequency of species within each class interval 0.138.

https://doi.org/10.1371/journal.pone.0185924.s004

(DOCX)

S2 Fig. Distance sampling detection functions for the Brewer’s sparrow, 2010–2015.

The most parsimonious distance sampling functions for the Brewer’s sparrow from the Integrated Monitoring in Bird Conservation Regions Program, 2010–2015. The vertical bars represent the frequency histograms of detections, and the curves represent year-specific hazard-rate detection functions for 2010, 2011, 2014 and 2015, and year-specific half-normal detection functions for 2012 and 2013.

https://doi.org/10.1371/journal.pone.0185924.s005

(DOCX)

Acknowledgments

The Integrated Monitoring in Bird Conservation Regions program is a collaborative partnership between policy-makers, land managers, conservationists, scientists and private landowners; with in-kind assistance provided by representatives from Colorado Parks and Wildlife, Native American Nations, United States (U. S.) Bureau of Land Management, U. S. Department of Defense, U. S. Fish and Wildlife Service, National Wildlife Refuge System, U. S. Forest Service, U. S. National Park Service, Northern Great Plains Network, Utah Division of Wildlife Resources, and Wyoming Game and Fish Department. We thank the Avian Science Center, Bird Conservancy of the Rockies, Great Basin Bird Observatory, Intermountain Bird Observatory, Montana Natural Heritage Program, U. S. Department of Defense, Utah Division of Wildlife Resources and Wyoming Natural Diversity Database for planning and implementing field work in their study areas. Special thanks to Special thanks to Anne Bartuszevige, Allison Begley, Russell Norvel, Andrea Orabona, Robert Schorr, Robin Sell, Dennis Saville, Rick Truex and Marcia Wilson for important contributions to the Program. We thank monitoring coordinators Jay Carlisle, Chris White and Matthew McLaren, and crew leaders Ian Abernethy, Jason Beason, Jeff Birek, Jora Fogg, Matt Gracey, Hannah Griscom, David Kramer, Ross Lock, Christian Meny, Jessica Pollock, Kristina Smucker, Nick Van Lanen, Zach Wallace and Bri Winter. Jeremy Halka, Rob Miller, Rob Sparks, Alex Van Boer and Brittany Woiderski provided Geographic Information Systems and sampling design support. Landowner liaison, Jenny Berven, facilitated permission to survey private land. We thank Jeff Laake, David Miller and Gary White for analysis support, and Michael Getzy and Chandman Sambuu for programming and database support. This manuscript benefited greatly from reviews by Adam Behney and Wendy Lanier. We also thank many field technicians who collected avian and vegetation data, contacted private landowners and helped establish working relationships for the future. Finally, without the effort and cooperation of numerous private landowners, we would have been unable to monitor bird populations on such a broad scale.

References

  1. 1. Jones JPG. Monitoring species abundance and distribution at the landscape scale. Journal of Applied Ecology. 2011;48(1):9–13.
  2. 2. Lindenmayer DB, Likens GE. The science and application of ecological monitoring. Biological Conservation. 2010;143(6):1317–28.
  3. 3. Baillie SR, Sutherland WJ, Freeman SN, Gregory RD, Paradis E. Consequences of large-scale processes for the conservation of bird populations. Journal of Applied Ecology. 2000;37(S1):88–102.
  4. 4. Conroy MJ, Stodola KW, Cooper RJ. Effective use of data from monitoring programs and field studies for conservation decision making: predictions, designs and models working together. Journal of Ornithology. 2012;152(S2):325–38.
  5. 5. LaDeau S, Kilpatrick AM, Marra P. West Nile virus emergence and large-scale declines of North American bird populations. Nature. 2007;447(7145):710–3. pmid:17507930
  6. 6. Bystrak D. The North American Breeding Bird Survey. In: Ralph CJ, Scott JM, editors. Estimating numbers of terrestrial birds. Lawrence, Kansas, USA: Studies in Avian Biology, Number 6, Cooper Ornithological Society; 1981. p. 34–41.
  7. 7. Donald PF, Sanderson FJ, Burfield IJ, Bierman SM, Gregory RD, Waliczky Z. International conservation policy delivers benefits for birds in Europe. Science. 2007;317(5839):810–3. pmid:17690296
  8. 8. Voříšek P., Klvaňová A., Wotton S., D. GR, editors. A best practice guide for wild bird monitoring schemes. Třeboň, Czech Republic: JAVA; 2008. Available: http://www.ebcc.info/index.php?ID=365.
  9. 9. Manley PN, Schlesinger MD, Roth JK, Van Horne B. A field-based evaluation of a presence-absence protocol for monitoring ecoregional-scale biodiversity. Journal of Wildlife Management. 2005;69(3):950–66.
  10. 10. Sauer JR, Knutson MG. Objectives and metrics for wildlife monitoring. Journal of Wildlife Management. 2008;72(8):1663–4.
  11. 11. Beever EA, Woodward A. Design of ecoregional monitoring in conservation areas of high-latitude ecosystems under contemporary climate change. Biological Conservation. 2011;144(5):1258–69.
  12. 12. Balmford A, Green RE, Jenkins M. Measuring the changing state of nature. Trends in Ecology & Evolution. 2003;18(7):326–30.
  13. 13. Magurran AE, Baillie SR, Buckland ST, Dick JM, Elston DA, Scott EM, et al. Long-term datasets in biodiversity research and monitoring: assessing change in ecological communities through time. Trends in Ecology & Evolution. 2010;25(10):574–82. pmid:20656371
  14. 14. Hewitt JE, Thrush SF, Dayton PK, Bonsdorff E. The effect of spatial and temporal heterogeneity on the design and analysis of empirical studies of scale-dependent systems. American Naturalist. 2007;169(3):398–408. pmid:17243075
  15. 15. Caughley G. Directions in conservation biology. Journal of Applied Ecology. 1994;63(2):215–44.
  16. 16. Nichols JD, Williams BK. Monitoring for conservation. Trends in Ecology & Evolution. 2006;21(12):668–73. pmid:16919361
  17. 17. Noon BR, Bailey LL, Sisk TD, McKelvey KS. Efficient species-level monitoring at the landscape scale. Conservation Biology. 2012;26(3):432–41. pmid:22594594
  18. 18. Norman D, Harris RJ, Newson SE. Producing regional estimates of population size for common and widespread breeding birds from national monitoring data. Bird Study. 2012;59(1):10–21.
  19. 19. Lyons JE, Runge MC, Laskowski HP, Kendall WL. Monitoring in the context of structured decision-making and adaptive management. Journal of Wildlife Management. 2008;72(8):1683–92.
  20. 20. McCarthy MA, Possingham HP. Active adaptive management for conservation. Conserv Biol. 2007;21(4):956–63. pmid:17650246
  21. 21. United States North American Bird Conservation Initiative Monitoring Subcommittee (US NABCI Monitoring Subcommittee). Opportunities for improving avian monitoring. US North American bird conservation initiative report. Arlington, Virginia, USA: U.S. Fish and Wildlife Service, Division of Migratory Bird Management; 2007.
  22. 22. Marsh DM, Trenham PC. Current trends in plant and animal population monitoring. Conserv Biol. 2008;22(3):647–55. pmid:18445076
  23. 23. DeWan AA, Zipkin EF. An integrated sampling and analysis approach for improved biodiversity monitoring. Environmental Management. 2010;45(5):1223–30. pmid:20237922
  24. 24. Bart J. Monitoring the abundance of bird populations. The Auk. 2005;122(1):15–25.
  25. 25. Buckland S, Marsden S, Green R. Estimating bird abundance: making methods work. Bird Conservation International. 2008;18(S1):91–108.
  26. 26. Gitzen RA, Millspaugh JJ, Cooper AB, Licht DS, editors. Design and analysis of long-term ecological monitoring studies. Cambridge, UK: Cambridge University Press; 2012.
  27. 27. Pollock KH, Nichols JD, Simons TR, Farnsworth GL, Bailey LL, Sauer JR. Large scale wildlife monitoring studies: statistical methods for design and analysis. Environmetrics. 2002;13(2):105–19.
  28. 28. Thompson WL, White GC, Gowan C. Monitoring vertebrate populations. San Diego, California, USA: Academic Press; 1998.
  29. 29. Stevens DL Jr., Olsen AR. Spatially balanced sampling of natural resources. Journal of the American Statistical Association. 2004;99(465):262–78.
  30. 30. Thogmartin WE, Howe FP, James FC, Johnson DH, Reed ET, Sauer JR, et al. A review of the population estimation approach of the North American Landbird Conservation Plan. The Auk. 2006;123(3):892–904.
  31. 31. Theobald DM, Stevens DL, White D, Urquhart NS, Olsen AR, Norman JB. Using GIS to generate spatially balanced random survey designs for natural resource applications. Environmental Management. 2007;40(1):134–46. pmid:17546523
  32. 32. Anderson DR. The need to get the basics right in wildlife field studies. Wildlife Society Bulletin. 2001;29(4):1294–7.
  33. 33. Fitzpatrick JW. The AOU and bird conservation: recommitment to the revolution. The Auk. 2002;119(4):907–13.
  34. 34. Ruth JM, Petit DR, Sauer JR, Samuel MD, Johnson FA, Fornwall MD, et al. Science for avian conservation: priorities for the new millennium. The Auk. 2003;120(1):204–11.
  35. 35. Carter MF, Hunter WC, Pashley DN, Rosenberg KV. Setting conservation priorities for landbirds in the United States: the Partners in Flight approach. The Auk. 2000;117(2):541–8.
  36. 36. Millard MJ, Czarnecki CA, Morton JM, Brandt LA, Briggs JS, Shipley FS, et al. A national geographic framework for guiding conservation on a landscape scale. Journal of Fish and Wildlife Management. 2012;3(1):175–83.
  37. 37. Brennan LA, Kuvlesky WP. North American grassland birds: An unfolding conservation crisis? Journal of Wildlife Management. 2005;69(1):1–13.
  38. 38. Cochran WG. Sampling techniques. New York, New York, USA: Wiley; 1977.
  39. 39. United States North American Bird Conservation Initiative Committee (US NABCI Committee). North American Bird Conservation Initiative: Bird Conservation Regions map. Arlington, Virginia, USA: U. S. Fish and Wildlife Service; 2000.
  40. 40. United States North American Bird Conservation Initiative Committee (US NABCI Committee). Bird Conservation Regions descriptions: a supplement to the North American Bird Conservation Initiative: Bird Conservation Regions map. Arlington, Virginia, USA: U. S. Fish and Wildlife Service; 2000.
  41. 41. Pavlacky DC Jr., Blakesley JA, White GC, Hanni DJ, Lukacs PM. Hierarchical multi-scale occupancy estimation for monitoring wildlife populations. Journal of Wildlife Management. 2012;76(1):154–62.
  42. 42. Olsen AR, Sedransk J, Edwards D, Gotway CA, Liggett W, Rathbun S, et al. Statistical issues for monitoring ecological and natural resources in the United States. Environmental Monitoring and Assessment. 1999;54(1):1–45.
  43. 43. Rodewald P, editor. The birds of North America. Ithaca, New York, USA: Cornell Lab of Ornithology, 2015. Available from: https://birdsna-org.ezproxy2.library.colostate.edu.
  44. 44. Pavlacky DC Jr., Possingham HP, Lowe AJ, Prentis PJ, Green DJ, Goldizen AW. Anthropogenic landscape change promotes asymmetric dispersal and limits regional patch occupancy in a spatially structured bird population. Journal of Animal Ecology. 2012;81(5):940–52. pmid:22489927
  45. 45. Nichols JD, Thomas L, Conn PB. Inferences about landbird abundance from count data: recent advances and future directions. In: Thomson DL, Cooch EG, Conroy MJ, editors. Modeling demographic processes in marked populations. Volume 3. New York, New York, USA: Springer; 2009. p. 201–35.
  46. 46. Thompson SK. Sampling. New York, New York, USA.: Wiley; 2002.
  47. 47. Buckland ST. Point-transect surveys for songbirds: robust methodologies. The Auk. 2006;123(2):345–57.
  48. 48. Rocky Mountain Avian Data Center (RMADC). Data collection. Brighton, Colorado, USA: Bird Conservancy of the Rockies; 2014. Available from: http://rmbo.org/v3/avian/DataCollection.aspx.
  49. 49. Thomas L, Buckland ST, Rexstad EA, Laake JL, Strindberg S, Hedley SL, et al. Distance software: design and analysis of distance sampling surveys for estimating population size. Journal of Applied Ecology. 2010;47(1):5–14. pmid:20383262
  50. 50. MacKenzie DI, Nichols JD, Royle JA, Pollock KH, Bailey LL, Hines JE. Occupancy estimation and modeling: inferring patterns and dynamics of species occurrence. Burlington, Massachusetts, USA: Elsevier; 2006.
  51. 51. Amundson CL, Royle JA, Handel CM. A hierarchical model combining distance sampling and time removal to estimate detection probability during avian point counts. The Auk. 2014;131(4):476–94.
  52. 52. Mordecai RS, Mattsson BJ, Tzilkowski CJ, Cooper RJ. Addressing challenges when studying mobile or episodic species: hierarchical Bayes estimation of occupancy and use. Journal of Applied Ecology. 2011;48(1):56–66.
  53. 53. National Park Service (NPS). National Park Service Research Permit and Reporting System. Washington, D.C., USA: United States Depratment of Interior, National Park Service; 2016. Available from: https://irma.nps.gov/rprs/.
  54. 54. R Core Team. R: a language and environment for statistical computing. Version 3.2.2. Vienna, Austria: R Foundation for Statistical Computing; 2015. Available from: www.R-project.org/.
  55. 55. Buckland ST, Anderson DR, Burnham KP, Laake JL, Borchers DL, Thomas L. Introduction to distance sampling: estimating abundance of biological populations. Oxford, UK: Oxford University Press; 2001.
  56. 56. Burnham KP, Anderson DR. Model selection and multimodel inference: a practical information-theoretic approach. New York, New York, USA: Springer-Verlag; 2002.
  57. 57. Powell LA. Approximating variance of demographic parameters using the delta method: a reference for avian biologists. The Condor. 2007;109(4):949–54.
  58. 58. Fewster RM, Buckland ST, Burnham KP, Borchers DL, Jupp PE, Laake JL, et al. Estimating the encounter rate variance in distance sampling. Biometrics. 2009;65(1):225–36. pmid:18363772
  59. 59. Nichols JD, Bailey LL, O'Connell AF, Talancy NW, Grant EHC, Gilbert AT, et al. Multi-scale occupancy estimation and modelling using multiple detection methods. Journal of Applied Ecology. 2008;45(5):1321–9.
  60. 60. Laake JL. RMark: an R Interface for analysis of capture-recapture data with MARK. Alaska Fisheries Science Center Processed Report 2013–01. Alaska Fisheries Science Center, National Oceanic and Atmospheric Administration, National Marine Fisheries Service, Seattle, Washington, USA, 2013.
  61. 61. White GC, Burnham KP. Program MARK: survival estimation from populations of marked animals. Bird Study. 1999;46(S1):120–39.
  62. 62. Casper Interagency Dispatch Center (CIDC). Intelligence. Casper, Wyoming, USA: Casper Interagency Dispatch Center; 2016. Available from: http://gacc.nifc.gov/rmcc/dispatch_centers/r2cpc/predictive/intelligence/intelligence.htm.
  63. 63. Morrison ML, Block WM, Strickland MD, Collier BA, Peterson MJ. Wildlife study design. New York, New York, USA: Springer; 2008.
  64. 64. Cody ML. Habitat selection in birds. New York, New York, USA: Academic Press; 1985.
  65. 65. Turner MG, Gardner RH, O'Neill RV. Landscape ecology in theory and practice: pattern and process. New York: Springer-Verlag; 2001.
  66. 66. United States Geological Survey (USGS). Landfire 1.1.0: existing vegetation type layer. Sioux Falls, South Dakota, USA: United States Department of the Interior, Geological Survey; 2008. Available from: http://landfire.cr.usgs.gov/viewer/.
  67. 67. Bromaghin JF, McDonald TL, Amstrup SC. Plausible combinations: an improved method to evaluate the covariate structure of Cormack-Jolly-Seber mark-recapture models. Open Journal of Ecology. 2013;3(1):11–22.
  68. 68. Schmidt JH, McIntyre CL, MacCluskie MC. Accounting for incomplete detection: what are we estimating and how might it affect long-term passerine monitoring programs? Biological Conservation. 2013;160:130–9.
  69. 69. Schmeller D. European species and habitat monitoring: where are we now? Biodivers Conserv. 2008;17(14):3321–6.
  70. 70. Freeman SN, Noble DG, Newson SE, Baillie SR. Modelling population changes using data from different surveys: the Common Birds Census and the Breeding Bird Survey. Bird Study. 2007;54(1):61–72.
  71. 71. George TL, Zack S. Spatial and temporal considerations in restoring habitat for wildlife. Restoration Ecology. 2001;9(3):272–9.
  72. 72. Block WA, Franklin AB, Ward JP, Ganey JL, White GC. Design and implementation of monitoring studies to evaluate the success of ecological restoration on wildlife. Restoration Ecology. 2001;9(3):293–303.
  73. 73. George TL, Fowler AC, Knight RL, McEwen LC. Impacts of a severe drought on grassland birds in western North Dakota. Ecological Applications. 1992;2(3):275–84. pmid:27759255
  74. 74. Niemuth ND, Solberg JW, Shaffer TL. Influence of moisture on density and distribution of grassland birds in North Dakota. The Condor. 2008;110(2):211−22.
  75. 75. Robbins CS, Van Velzen WT. The Breeding Bird Survey, 1966. Special Scientific Report: Wildlife No. 102. Washington D. C., USA: Migratory Bird Populations Station, Division of Wildlife Research, United States Fish Wildlife Service; 1967.
  76. 76. Sauer JR, Fallon JE, Johnson R. Use of North American Breeding Bird Survey data to estimate population change for bird conservation regions. Journal of Wildlife Management. 2003;67(2):372–89.
  77. 77. Metzger MJ, Brus DJ, Bunce RGH, Carey PD, Goncalves J, Honrado JP, et al. Environmental stratifications as the basis for national, European and global ecological monitoring. Ecological Indicators. 2013;33(SI):26–35.
  78. 78. Lindenmayer DB, Likens GE. Adaptive monitoring: a new paradigm for long-term research and monitoring. Trends in Ecology & Evolution. 2009;24(9):482–6.
  79. 79. Rota CT, Fletcher R. J. Jr, Evans JM, Hutto RL. Does accounting for imperfect detection improve species distribution models? Ecography. 2011;34(4):659–70.
  80. 80. Gu W, Swihart RK. Absent or undetected? Effects of non-detection of species occurrence on wildlife-habitat models. Biological Conservation. 2004;116(2):195–203.
  81. 81. Marcot BG. Habitat modeling for biodiversity conservation. Northwestern Naturalist. 2006;87(1):56–65.
  82. 82. Wilson KA, Underwood EC, Morrison SA, Klausmeyer KR, Murdoch WW, Reyers B, et al. Conserving biodiversity efficiently: what to do, where, and when. PLoS Biology. 2007;5(9):e223. pmid:17713985
  83. 83. Drum RG, Ribic CA, Koch K, Lonsdorf E, Grant E, Ahlering M, et al. Strategic grassland bird conservation throughout the annual cycle: linking policy alternatives, landowner decisions, and biological population outcomes. PLoS ONE. 2015;10(11):e0142525. pmid:26569108
  84. 84. Margules CR, Pressey RL. Systematic conservation planning. Nature. 2000;405(6783):243–53. pmid:10821285
  85. 85. Smith D, McGowan C, Daily J, Nichols J, Sweka J, Lyons J, et al. Evaluating a multispecies adaptive management framework: must uncertainty impede effective decision-making? Journal of Applied Ecology. 2013;50(6):1431–40.
  86. 86. Nichols JD, Runge MC, Johnson FA, Williams BK. Adaptive harvest management of North American waterfowl populations: a brief history and future prospects. Journal of Ornithology. 2007;148(S2):343–9.
  87. 87. Lindenmayer D, Hobbs RJ, Montague-Drake R, Alexandra J, Bennett A, Burgman M, et al. A checklist for ecological management of landscapes for conservation. Ecol Lett. 2008;11(1):78–91. pmid:17927771
  88. 88. Westphal M, Field S, Possingham H. Optimizing landscape configuration: a case study of woodland birds in the Mount Lofty Ranges, South Australia. Landscape and Urban Planning. 2007;81(1–2):56–66.
  89. 89. Royle JA, Dorazio RM. Hierarchical modeling and inference in ecology: the analysis of data from populations, metapopulations and communities. Amsterdam, Netherlands: Academic Press; 2008.
  90. 90. Kéry M, Royle JA. Hierarchical modelling and estimation of abundance and population trends in metapopulation designs. Journal of Animal Ecology. 2010;79(2):453–61. pmid:19886893
  91. 91. Rushton SP, Ormerod SJ, Kerby G. New paradigms for modelling species distributions? Journal of Applied Ecology. 2004;41(2):193–200.
  92. 92. Dreitz VJ, Stinson LT, Hahn BA, Tack JD, Lukacs PM. A large-scale perspective for managing prairie avifauna assemblages across the western US: influences of habitat, land ownership and latitude. PeerJ. 2017;5:e2879. pmid:28133567