With rapid changes taking place on coral reefs, managers and scientists are faced with prioritising interventions that might avoid undesirable losses in ecosystem health. The property of resilience captures how reefs react and respond to stressors and environmental changes. Therefore, in principle, management goals are more likely to be realised if resilience theory is used to inform decision making and help set realistic expectations for reef outcomes. Indeed, a new approach to reef management has been termed ‘resilience-based management’ (RBM). Yet, resilience concepts have often been criticised for being vague, difficult to operationalise, and beset by multiple definitions. Here, we evaluate how the advent of RBM has changed one aspect of reef management: assessment and monitoring. We compare the metrics used in conventional monitoring programs with those developed through resilience assessments and find that the latter have a stronger focus on ecological processes and exposure to environmental drivers. In contrast, monitoring tends to focus on metrics of reef state and has greater taxonomic resolution, which provides comprehensive information on the nature of changes but does not predict the future responses of reefs in part because it is difficult to extrapolate statistical trends of complex ecological systems. In addition, metrics measured by resilience studies are more diverse, owing in part to the reliance of state metrics as proxies of processes given the difficulty in quantifying key ecological processes directly. We conclude by describing practical ways of improving resilience assessments, and avenues for future research.
Citation: Lam VYY, Doropoulos C, Mumby PJ (2017) The influence of resilience-based management on coral reef monitoring: A systematic review. PLoS ONE 12(2): e0172064. https://doi.org/10.1371/journal.pone.0172064
Editor: Chaolun Allen Chen, Academia Sinica, TAIWAN
Received: October 18, 2016; Accepted: January 30, 2017; Published: February 10, 2017
Copyright: © 2017 Lam et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by the Australian Research Council Linkage Grant, www.arc.gov.au: PJM and International Postgraduate Research Scholarship, Australian Government, https://education.gov.au/international-postgraduate-research-scholarships: VYYL. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The accelerating rate of change in many ecosystems [1–5] and apparent lack of recovery [6–8] has led to the perception that it is more appropriate to manage for ecosystem resilience rather than ecosystem state and condition [9–11]. This shift in management application has been termed ‘resilience-based management’ (RBM), which attempts to manage the resilience of systems explicitly. Resilience was first described by Holling  as a dynamical property of ecosystems such that they continue to gravitate toward one particular state versus another even when subjected to perturbations. A resilient coral reef, for example, will tend to exhibit recovery towards a coral dominant state even if subsequent disturbances prevent corals from eventually dominating . RBM steers management actions towards the preservation of fundamental ecosystem functions, structure, identity and feedbacks . RBM departs from the classic view of steady-state resource management and instead attempts to focus on the processes that govern system dynamics . Contrary to the emphasis on the maintenance of a static perceived optimal state in traditional management approaches, RBM is closely tied to the prevention of regime shifts, whereby a conspicuous change to the structure and function of a system occurs once a threshold is surpassed [15, 16]. Regime shifts involve complex feedback mechanisms that affect system dynamics, hence, a critical aspect of managing for resilience is a thorough understanding of ecological processes of the relevant ecosystems.
Monitoring and assessment are integral components of ecosystem management [17, 18], providing key information through empirical measurements and trend identification . Historically, monitoring activities deliver a detailed account on ecosystem states with an emphasis on the abundance of important biological species. However, state indicators are not able to reflect important underlying system, for example nonlinear interactions and feedback loops such as those between corals, algae and herbivores [20–22]. What is observed (i.e. the state) is the result of multiple interactions among the biophysical components of an ecosystem. Thus, in addition to ecosystem state changes, monitoring of ecological processes is fundamental to the successful implementation of RBM [23–25]. Ecological processes maintain the functioning of an ecosystem and are often responsible for the dynamics of a system, including processes such as energy flow, nutrient cycling and disturbance regimes . In the context of this study, ecological processes are defined as components that affect reef ecosystem functions, such as recruitment and connectivity .
There is a long history of coral reef monitoring in different parts of the world [28, 29], with the majority of international programs initiated in the mid-90s . The aim of these programs is to monitor and reflect the health of reef ecosystems, implemented through comprehensive surveys that record changes in the abundance of organisms and how they react to impacts . Conversely, metrics selected for resilience assessments aim to measure processes , yet this is often difficult to achieve because many dynamic processes are not easily observable , such as larval supply, settlement behaviour and post-settlement mortality.
Quantification is a crucial facet in the operationalisation of RBM, and efforts have concentrated on the identification of suitable resilience metrics [34–37]. Although the focus on system dynamics for resilience assessments is apparent , the extent to which RBM has transformed how reefs are evaluated and monitored is unclear. This study investigates how the introduction of RBM has changed the way reefs are surveyed. Specifically, we examine whether RBM has translated into an explicit change in the metrics surveyed and how it differs from earlier management approaches. To do so, metrics utilised by monitoring programs are compared to those adopted by more recent RBM approaches. Based on our results, new directions for resilience science are identified, in particular, on operationalising the metrics used for management and maximising the value of historical monitoring data.
A great challenge is to identify and keep track of emerging resilience approaches and papers, hence a literature review was conducted to identify coral reef resilience studies that documented quantifiable metrics. A broad list of search terms was used to avoid missing any relevant research because resilience and monitoring studies often use different terminology. The search was conducted in July 2016 using the Web of Science service (ISI Thomson Reuters), with the key topics of “reef” and “resilience/regime shift” and “driver*/assess*/measure*/variable*/indicator*” and no limits on publication dates, which resulted in a total of 625 studies. A large proportion (95.8%) of the resulting studies included conceptual and theoretical research, and further analysis resulted in 10 resilience studies that contained quantifiable metrics suitable for analysis. Studies that only focused on specific groups of reef organisms were not included, for example fish functional groups in Green et al. . Case studies using the same protocols were not included (total of 4 studies). For example, where Ladd et al.  applied the resilience index developed by Maynard et al.  in Mexico. Following, a snowball sampling technique  was employed that expanded the search using reference lists from the initial pool of studies. Monitoring protocols were taken from well-established long-term monitoring programs with widely-accepted monitoring procedures. Finally, twelve studies and six internationally recognised coral reef monitoring programs were identified that contained published protocols to represent resilience assessments and monitoring programs respectively. The classification of groups was based on the goals stated in each study, with the rationale behind the groupings outlined in S1 Table. A brief description of the data collection can be found in the PRISMA flow diagram (Fig 1) and checklist (S1 Checklist).
The initial stage of analysis included a thorough examination and documentation of metrics listed in each study, and the reasons for monitoring noted where applicable (S1 Table). Minor adjustments were made to the original terms describing metrics to minimise any biases resulting from heuristics, giving a final list of 136 standard metrics from both resilience studies and monitoring programs (S2 Table). The 136 standard metrics were then used to populate the data matrix, with a binomial response (present/absent) applied to each metric for each study in a multivariate data frame. Studies were visualised using non-metric multidimensional scaling (nMDS) and analysed for statistical significance among groups (resilience assessment, monitoring program) and locations (Caribbean, Pacific, Indian Ocean and global assessments) using PERMANOVA with 999 permutations to generate P values. Multivariate homogeneity of variance was tested using PERMDISP. SIMPER analysis was conducted to identify the key metrics that contribute to the similarities and differences between and within significant factors. Analyses were based on a Jaccard dissimilarity matrix, appropriate for presence-absence data , and conducted using the software Primer-E v6  with the PERMANOVA extension.
The second analysis classified the full list of 136 standard metrics into 28 higher-level metrics (S2 Table), grouped into the general categories of biological community, disturbances, ecological processes and site characteristics for comparative analysis (Table 1). Abundance and diversity metrics were grouped under ‘biological community’, and include algae, corals, fish and other organisms found in the benthic community. Disturbance metrics that impacted the reef were grouped under ‘disturbances’, broadly separated into anthropogenic, biological, physical and physiological (Table 1). Process-oriented metrics were grouped under ‘ecological processes’, and include critical coral processes such as growth, recruitment and connectivity. Finally, metrics that reflected reef conditions were grouped under ‘site characteristics’, and contain information on the location, management status and general environment of sites surveyed. Metrics were converted into presence/absence data for each study and the proportion of studies that measured the 28 higher-level metrics was calculated to indicate metric prevalence within the two groups (resilience assessment, monitoring program). Metric prevalence is used here to indicate emphasis on certain metrics by resilience assessments and monitoring programs respectively.
A final analysis was conducted to elucidate the potential of different metrics to provide information on reef processes used in the two groups of studies. Metrics from each study were classified into four broad categories: 1) state, 2) state/proxy, 3) proxy; and 4) process (S2 Table). ‘State’ represents static metrics (e.g., abundance), whereas metrics that directly measure rates and ecological processes are grouped under ‘process’ (e.g. recruitment, growth). Various state metrics are often used as proxies for ecological processes, such as herbivore biomass for herbivory, and these are grouped under ‘state/proxy’. Finally, metrics that were used directly as a proxy for a process within a study (i.e. indices developed to represent processes and disturbances such as coral submersion to estimate stress to corals when exposed to air, or number of boats to represent human impacts) were classified under ‘proxy’. When a state-only metric was explicitly used as a proxy for a process (42 out of 229 cases), metrics typically classified as ‘state’ (e.g., coral cover) were also grouped under the category of ‘state/proxy’. Metrics were considered on a case by case basis depending on how they were used in the particular study and the underlying measurement rationale (S2 Table). The proportion of metrics classified into each category were averaged to indicate differences between resilience assessments and monitoring programs.
A total of 136 standard coral reef metrics were recorded, with monitoring programs and resilience assessments totalling 61 and 126 metrics respectively (S2 Table). Metrics used for resilience assessments differed significantly from those employed for monitoring (p = 0.01, S3A Table; Fig 2), with an average dissimilarity of 75%. Despite the high dissimilarity between the two groups, metrics from resilience assessments encompassed many aspects observed by monitoring programs and had a higher multivariate dispersion (PERMDISP average dispersion: resilience = 59.1; monitoring = 47.1, S3B Table), implying that resilience assessments measure a much wider range of metrics compared to monitoring programs. Two resilience studies in particular [44, 45], showed more similarity to monitoring studies than the other resilience assessments (Fig 2), and this may reflect their transitional nature. For example, AGRRA  developed from monitoring methods in the late 1990s, but there was an explicit intent to include process-level metrics, such as densities of juvenile corals and rates of herbivory (Mumby, pers. obs.). The influence of geographical location on measured metrics and the interaction between the two groups were both non-significant (Location: p = 0.18; Group x Location: p = 0.534; S3A Table).
AIMS = Long Term Monitoring Program, Australia Institute of Marine Science; AGGRA = Atlantic and Gulf Rapid Reef Assessment; CARICOMP = Caribbean Coastal Marine Productivity; CRAMP = Hawai‘i Coral Reef Assessment and Monitoring Program; CREMP = Coral Reef Evaluation and Monitoring Project by Florida Fish and Wildlife Conservation Commission; IUCN = International Union for Conservation of Nature; NOAA BB = National Oceanic and Atmospheric Administration, Center for Coastal Monitoring and Assessment, Biogeography Branch.
Monitoring studies had an average similarity of 42%. Key benthic state metrics such as coral cover (living, diseased, bleached and dead), algal cover (macroalgae, turf, crustose coralline algae), sessile invertebrate cover (soft coral, gorgonian, sponge, anemones, tunicates, ascidians) and substrate were used in more than two-thirds of the monitoring programs. Metrics reflecting biodiversity (coral and fish diversity) and site characteristics (location, habitat, temperature, depth, rugosity and turbidity) were also found in over half of the studies (Fig 3, S4 Table). Metrics used in resilience assessments were more numerous and diverse, with a much lower average within-group similarity of 22%. Despite the high diversity of metrics being recorded, benthic components such as coral, macroalgal and substrate cover were used in more than half of the resilience assessments alongside drivers such as thermal regime, disease, fishing pressure and depth (Fig 3, S4 Table).
Blue and red areas represent monitoring programs and resilience assessments respectively. Axes points represent the proportion of studies within each study group that measured a given metric. Refer to S2 Table for original metrics categorised under each higher-level metric.
Evidently, resilience assessments tend to focus on ecological and environmental processes, whereas monitoring programs concentrate on the biological community including benthic cover and organism abundances (Fig 3). Resilience studies tend to target specific functions, such as converting sea surface temperatures into thermal regime indices and identifying substrate categories suitable for coral recruitment (i.e. substrate availability). Monitoring programs tend to record sea surface temperatures changes and document all substrate covers (i.e. sand, rubble and rock), leaving the analyst to determine the functions of the categories. Also, monitoring programs do not attempt to measure complex processes such as connectivity, competition and reproduction whereas most resilience assessments at least seek proxies for such processes. Monitoring studies often took note of other living organisms such as sessile and motile invertebrates, whereas resilience assessments focused on specific categories that are used as proxies for reef processes.
A more detailed examination of measurements by monitoring programs revealed that up to 35% metrics are state variables that can also be used proxies for processes (Fig 4), implying that scope exists to interpret monitoring data from a resilience perspective. The majority of metrics from monitoring programs are state variables (60%), with a strong focus on counts, abundances and diversity. In contrast, ~80% of the resilience assessment metrics fall under state/proxy, proxy and process categories. In resilience assessments, over half of the total measurements were states used as proxies for processes, signifying the critical role of surrogates in the development of RBM.
Monitoring and resilience: “states” vs. “rates”
We found substantial differences in the metrics utilised by monitoring programs and resilience assessments and confirm that the introduction of RBM has influenced how reef surveys are conducted. Our study provides clear evidence that the intent of RBM has translated into a real change in metrics surveyed, documenting a shift towards more process-oriented measurements as suggested by conceptual advice [46, 47]. The different foci of monitoring and resilience assessments reflect their respective objectives. Monitoring programs are concerned with the detection of detailed changes in the reef community, relying on state metrics that can be easily quantified. A strong emphasis on the biological community led to a higher degree of similarity within the monitoring group. Resilience assessments, on the other hand, have evolved from basic monitoring protocols to include additional ecological and environmental factors that provide insight on process dynamics [45, 48]. Hence, resilience assessments often incorporate many of the metrics used in monitoring assessments, as shown in AGRRA  and Bruckner , as well as a larger variety of parameters. Of interest, the National Coral Reef Monitoring Program (NCRMP), initiated in recent years to develop a nationally coordinated and consistent monitoring program, also illustrates the move from a traditional monitoring program to a program that focuses on ecological processes. In addition to critical state metrics that have traditionally been monitored by NOAA, NCRMP also promotes additional indicators that contribute to coral reef ecosystem function such as growth and bioerosion rates, reproduction and recruitment and hydrodynamics .
Resilience assessments have a much higher variability of metrics used among studies than do monitoring programs. Results from the PERMDISP analysis show that multivariate dispersion observed for resilience assessments was 1.3–times more than monitoring programs, and there are a number of reasons for this higher variability. First, resilience metrics include variables scored using systems such as the Likert scale to assign values rapidly in the field that would otherwise be complicated to quantify (e.g. self-, local- and distant-seeding that contributes to connectivity ), whereas monitoring programs do not attempt to quantify such variables. Second, metric variability within the resilience group occurs with the inclusion of modelling studies that incorporate the direct quantification of processes and rates such as growth, mortality and recruitment, which is hard to achieve in field-based resilience assessments, especially for snapshot surveys [50, 51]. Third, monitoring studies have well-established protocols whereas resilience metrics are often modified and adapted to study sites or region [36, 52].
In line with literature advocating for the development of surrogates for processes measured in resilience assessments , it is encouraging that resilience studies utilised a high proportion of state metrics, with the intent of using them as proxies for reef processes. Evidently, state metrics, when used appropriately, can provide valuable information on ecosystem dynamics . However, there are certain advantages and disadvantages associated with the use of proxies. Multiple proxies can be used to represent the same process or disturbance, and allows resilience assessments to be more flexible in data acquisition. For instance, distance to the nearest river mouth or human population density are both used as proxies for human disturbance . However, proxies also contribute to the high diversity of metrics used in resilience assessments. High metric variability may add to the complexities of quantifying resilience using field-based measurements [55, 56], thus, further work is needed to identify a uniform set of resilience metrics. Particular emphasis should be given to improving metrics for processes and drivers, as many of these are hard to observe using single proxies, making unification difficult .
From metrics to management
Despite finding clear differences between the metrics used in monitoring programs and resilience assessments, a substantial proportion of monitoring metrics have the potential to be used as proxies for processes and therefore help hindcast changes in ecosystem drivers. Relevant state metrics can be identified and interpreted using a resilience perspective to understand reef dynamics and assist with the interpretation of future reef trajectories based on mechanistic ecological relationships. The development of protocols on how state metrics can be interpreted to identify potential drivers and to estimate reef recovery based on ecological knowledge has recently been demonstrated by Flower et al. . For instance, a decrease in juvenile coral density may imply a reduction of substrate availability, larval supply, or the occurrence of disturbance. However, if turf canopy height is also found to increase, a diagnosis can be refined suggesting that the substrate is becoming less hospitable for recruitment, either because of reduced herbivory and/or greater rates of primary production (nutrients). With appropriate tools and analyses, valuable information collected from historical monitoring programs can be used to apply RBM to coral reefs.
In all types of surveys, there exists a trade-off between the speed and ease of data collection, and the level of taxonomic resolution. Our results show that resilience assessments have deviated from documenting detailed changes in the biological community to focusing on a few metrics representing key reef processes . Examples include documenting coral functional groups instead of species , and omitting groups of organisms that have less well understood ecosystem roles such as sponges, ascidians and tunicates . Functional approaches were developed for coral reef fishes and algae, where species level is either too difficult to acquire, or so variable that it imparts little information [39, 59]. Resilience assessments tend to take a functional approach to the benthos, suggesting an implicit assumption that species-specific measurements are less relevant, such as focusing on branching coral cover  and in some cases, only using coral cover in total [37, 50].
Many high taxonomic level metrics currently assessed by monitoring programs contain valuable information for reef management and should not be left out . For example, if management is focused on conserving biodiversity, then species level taxonomic resolution is a necessity. While higher-level taxonomic data is more time consuming to collect, the data can be combined into functional groups if desired. Detailed benthic documentation is important even when simplified to major lifeforms, especially when results are linked to ecosystem functioning such as the critical role of plating corals in driving rapid reef recovery in the Pacific [60–62] and the importance of branching Acropora as a nursery habitat for juvenile fishes . The attempt to make resilience assessments logistically more feasible with lower resolution data may limit the insights that can be drawn with respect to reef functioning. To provide a comprehensive understanding for current and future RBM, it is critical to work out an optimal strategy to find a balance between monitoring state vs. process metrics, and the level of taxonomic resolution . A potential approach would be to adopt as detailed taxonomic resolution as is possible for some of the most important ecological processes driving resilience and compromise the taxonomic resolution on others.
Avenues for future research
Two of the continuing challenges for reef monitoring, whether with a taxonomic or more resilience-based focus, are incentivising data collection and linking the results to management actions. Greater synthesis and interpretation of monitoring data could help resolve both problems by adding interpretative value to the products. Currently, many monitoring programmes archive data, and while overall trends are plotted, there is often limited interpretation of patterns. Are the trends of concern or merely natural fluctuations? Can the trends be used to diagnose a problem and suggest a management intervention? Greater efforts to provide a diagnostic and interpretative interface, including the use of decision trees, can enhance the usefulness of data . Here, the incorporation of process-orientated metrics along with changes in state can help provide diagnostic power.
Another opportunity to enhance the usefulness of monitoring data is in understanding and predicting reef dynamics. For example, statistical models such as Bayesian Belief Networks (BBN) [64, 65] can draw on individual case datasets to build predictive models. The more diverse the input data, in terms of environments and ecosystem states sampled, the stronger the predictions become. In an ideal scenario for coral reef monitoring data, it would be possible to imagine a central coral reef BBN being updated by multiple sets, with data providing new combinations of reef state and process and the ensuing trajectories. Individual practitioners could add their data and benefit from the functionality of the full reef model. A desirable outcome of this approach is that monitoring data are used to construct a dynamic model of the ecosystem that allows managers and scientists to run ‘what if’ scenarios, such as the likely consequences of reducing nutrient concentrations influencing reefs of a particular state and in a particular environment .
While utilising a global knowledge-base should improve predictions of reef state, it clearly raises concerns over heterogeneity in reef functioning. For example, processes influencing resilience, including the bottom-up and top-down drivers of macroalgal populations and the sensitivity of corals to algal interactions, can vary enormously between major biogeographic regions [67, 68]. Therefore, there remains a need for studies to identify the proximate drivers of reef dynamics across a diversity of environments . Some of this can be achieved through globally-replicated experiments [68, 70] and regional analyses of bivariate relationships [71, 72], but it is critical that key processes are disaggregated and not lost as confounding effects in broad-scale studies .
This paper is written for both scientists and managers to identify promising new directions for RBM. There exists a wealth of monitoring data from different parts of the world that is highly fragmented and has rarely been analysed comprehensively . While not specifically designed to measure processes, many monitoring variables provide a proxy of process. By using statistical approaches that consolidate monitoring data and hindcast trends in reef health [74, 75], comparisons can be drawn between the observed trajectory of reefs and those predicted from novel metrics-orientated approaches.
S1 Checklist. PRIMSA Checklist for current study.
S1 Table. The rationale behind the classification of studies into monitoring programs or resilience assessments.
S2 Table. Original metrics used in studies and their respective classification in the three phases of analysis.
S3 Table. Results of two-way permutational MANOVA and PERMDISP test of homogeneity of dispersions between monitoring and resilience studies.
This project was funded by an ARC Linkage grant and ARC Centre of Excellence for Coral Reef Science grant to PJM and an IPRS to VYYL.
- Conceptualization: VYYL CD PJM.
- Data curation: VYYL.
- Formal analysis: VYYL CD.
- Investigation: VYYL.
- Methodology: VYYL CD PJM.
- Supervision: PJM.
- Visualization: VL.
- Writing – original draft: VYYL.
- Writing – review & editing: VYYL CD PJM.
- 1. Knowlton N. The future of coral reefs. Proc Natl Acad Sci U S A. 2001;98(10):5419–25. PubMed Central PMCID: PMCPMC33228. pmid:11344288
- 2. Nyström M, Graham NAJ, Lokrantz J, Norstrom AV. Capturing the cornerstones of coral reef resilience: linking theory to practice. Coral Reefs. 2008;27(4):795–809.
- 3. Hooper DU, Adair EC, Cardinale BJ, Byrnes JEK, Hungate BA, Matulich KL, et al. A global synthesis reveals biodiversity loss as a major driver of ecosystem change. Nature. 2012;486(7401):105–8. pmid:22678289
- 4. Steffen W, Broadgate W, Deutsch L, Gaffney O, Ludwig C. The trajectory of the Anthropocene: The Great Acceleration. The Anthropocene Review. 2015;2(1):81–98.
- 5. Millennium Ecosystem Assessment. Ecosystems and human well-being: synthesis: Washington, DC: Island Press; 2005.
- 6. Gilljam D, Curtsdotter A, Ebenman B. Adaptive rewiring aggravates the effects of species loss in ecosystems. Nat Commun. 2015;6.
- 7. Jones HP, Schmitz OJ. Rapid recovery of damaged ecosystems. PLoS ONE. 2009;4(5):e5653. pmid:19471645
- 8. Scheffer M, Carpenter S, Foley JA, Folke C, Walker B. Catastrophic shifts in ecosystems. Nature. 2001;413(6856):591–6. pmid:11595939
- 9. Chapin FS III, Kofinas GP, Folke C, Chapin MC. Principles of ecosystem stewardship: resilience-based natural resource management in a changing world: Springer Science & Business Media; 2009.
- 10. Bestelmeyer BT, Briske DD. Grand Challenges for Resilience-Based Management of Rangelands. Rangeland Ecol Manage. 2012;65(6):654–63.
- 11. Walker B, Salt D. Resilience thinking: sustaining ecosystems and people in a changing world: Island Press; 2006.
- 12. Holling CS. Resilience and stability of ecological systems. Annu Rev Ecol Syst. 1973;4:1–23.
- 13. Mumby PJ, Chollett I, Bozec Y-M, Wolff NH. Ecological resilience, robustness and vulnerability: how do these concepts benefit ecosystem management? Current Opin Environ Sustain. 2014;7(0):22–7.
- 14. Anderies JM, Walker BH, Kinzig AP. Fifteen weddings and a funeral: case studies and resilience-based management. Ecol Soc. 2006;11(1):21.
- 15. Scheffer M, Carpenter SR. Catastrophic regime shifts in ecosystems: linking theory to observation. Trends Ecol Evol. 2003;18(12):648–56.
- 16. Folke C, Carpenter S, Walker B, Scheffer M, Elmqvist T, Gunderson L, et al. Regime shifts, resilience, and biodiversity in ecosystem management. Annu Rev Ecol Evol Syst. 2004:557–81.
- 17. Nichols JD, Williams BK. Monitoring for conservation. Trends Ecol Evol. 2006;21(12):668–73. pmid:16919361
- 18. Christensen NL, Bartuska AM, Brown JH, Carpenter S, D'Antonio C, Francis R, et al. The Report of the Ecological Society of America Committee on the Scientific Basis for Ecosystem Management. Ecol Appl. 1996;6(3):665–91.
- 19. Lindenmayer DB, Likens GE. The science and application of ecological monitoring. Biol Conserv. 2010;143(6):1317–28.
- 20. Kupschus S, Schratzberger M, Righton D. Practical implementation of ecosystem monitoring for the ecosystem approach to management. J Appl Ecol. 2016;53(4):1236–47.
- 21. Siddig AAH, Ellison AM, Ochs A, Villar-Leeman C, Lau MK. How do ecologists select and use indicator species to monitor ecological change? Insights from 14 years of publication in Ecological Indicators. Ecol Indicators. 2016;60:223–30.
- 22. Mumby PJ, Steneck RS. Coral reef management and conservation in light of rapidly evolving ecological paradigms. Trends Ecol Evol. 2008;23(10):555–63. pmid:18722687
- 23. Crowder L, Norse E. Essential ecological insights for marine ecosystem-based management and marine spatial planning. Mar Policy. 2008;32(5):772–8.
- 24. Herrick JE, Schuman GE, Rango A. Monitoring ecological processes for restoration projects. J Nat Conserv. 2006;14(3–4):161–71.
- 25. McLeod E, Anthony KRN, Andersson A, Beeden R, Golbuu Y, Kleypas J, et al. Preparing to manage coral reefs for ocean acidification: lessons from coral bleaching. Front Ecol Environ. 2013;11(1):20–7.
- 26. Noss RF, Cooperrider A. Saving nature's legacy: protecting and restoring biodiversity: Island Press; 1994.
- 27. Harborne AR, Rogers A, Bozec YM, Mumby PJ. Multiple Stressors and the Functioning of Coral Reefs. Ann Rev Mar Sci. 2017;9:445–68. pmid:27575738
- 28. Jackson J, Donovan M, Cramer K, Lam V. Status and trends of Caribbean coral reefs: 1970–2012. Report. Washington, D.C.: 2014.
- 29. Wilkinson C. Status of coral reefs of the world: 1998. Townsville, Australia: Global Coral Reef Monitoring Network, Reef and Rainforest Research Centre, 1998.
- 30. Hill J, Wilkinson C. Methods for ecological monitoring of coral reefs. Australian Institute of Marine Science, Townsville. 2004;117.
- 31. English SS, Wilkinson CR, Baker VJ. Survey manual for tropical marine resources: Australian Institute of Marine Science; 1994.
- 32. Hughes TP, Bellwood DR, Folke C, Steneck RS, Wilson J. New paradigms for supporting the resilience of marine ecosystems. Trends Ecol Evol. 2005;20(7):380–6. pmid:16701400
- 33. Carpenter SR, Westley F, Turner MG. Surrogates for Resilience of Social-Ecological Systems. Ecosystems. 2005;8(8):941–4.
- 34. West JM, Salm RV. Resistance and Resilience to Coral Bleaching: Implications for Coral Reef Conservation and Management. Conserv Biol. 2003;17(4):956–67.
- 35. Obura D, Grimsditch G. Resilience assessment of coral reefs: assessment protocol for coral reefs, focusing on coral bleaching and thermal stress. Gland, Switzerland: IUCN; 2009.
- 36. Maynard JA, Marshall PA, Johnson JE, Harman S. Building resilience into practical conservation: identifying local management responses to global climate change in the southern Great Barrier Reef. Coral Reefs. 2010;29(2):381–91.
- 37. McClanahan TR, Campbell SJ, Darling ES, Eakin CM, Heron SF, Jupiter SD, et al. Prioritizing key resilience indicators to support coral reef management in a changing climate. PLoS ONE. 2012;7(8):e42884. pmid:22952618
- 38. Anthony KRN, Marshall Paul A., Abdullah Ameer, Beeden Roger, Bergh Chris, Black Ryan, et al. Operationalising resilience for adaptive coral reef management under global environmental change. Global Change Biol. 2015;21:48–61.
- 39. Green AL, Bellwood DR, Choat H. Monitoring functional groups of herbivorous reef fishes as indicators of coral reef resilience. A practical guide for coral reef managers in the Asia Pacific Region IUCN, Gland, Switzerland. 2009.
- 40. Ladd MC, Collado-Vides L. Practical applications of monitoring results to improve managing for coral reef resilience: a case study in the Mexican Caribbean. Biodivers Conserv. 2013;22(8):1591–608.
- 41. Goodman LA. Snowball Sampling. Ann Math Statist. 1961;32(1):148–70.
- 42. Clarke KR, Warwick RM. Change in Marine Communities: An Approach to Statistical Analysis and Interpretation: Primer-E Ltd. Plymouth Marine Laboratory, U.K.; 2001.
- 43. Clarke KR, Gorley RN. PRIMER v6: User Manual/Tutorial. PRIMER-E, Plymouth, 192pp. 2006.
- 44. Lang JC. Status of coral reefs in the western Atlantic: Results of initial surveys, Atlantic and Gulf Rapid Reef Assessment (AGRRA) program. Atoll Res Bull. 2003;496.
- 45. Bruckner AW. Static measurements of the resilience of Caribbean coral populations. Rev Biol Trop. 2012;60:39–57.
- 46. Graham NAJ, Bellwood DR, Cinner JE, Hughes TP, Norström AV, Nyström M. Managing resilience to reverse phase shifts in coral reefs. Front Ecol Environ. 2013;11(10):541–8.
- 47. Briske D, Bestelmeyer B, Stringham T, Shaver P. Recommendations for development of resilience-based state-and-transition models. Rangeland Ecol Manage. 2008;61(4):359–67.
- 48. Allen CR, Cumming GS, Garmestani AS, Taylor PD, Walker BH. Managing for resilience. Wildl Biol. 2011;17(4):337–49.
- 49. NOAA Coral Program. National Coral Reef Monitoring Plan. Silver Spring, MD: NOAA Coral Reef Conservation Program, 2014.
- 50. Cinner JE, Huchery C, Darling ES, Humphries AT, Graham NAJ, Hicks CC, et al. Evaluating Social and Ecological Vulnerability of Coral Reef Fisheries to Climate Change. PLoS ONE. 2013;8(9):e74321. pmid:24040228
- 51. Mumby PJ, Wolff NH, Bozec YM, Chollett I, Halloran P. Operationalizing the Resilience of Coral Reefs in an Era of Climate Change. Conserv Lett. 2014;7(3):176–87.
- 52. Weeks R, Jupiter SD. Adaptive Comanagement of a Marine Protected Area Network in Fiji. Conserv Biol. 2013;27(6):1234–44. pmid:24112643
- 53. Flower J, Ortiz JC, Chollett I, Abdullah S, Castro-Sanguino C, Hock K, et al. Interpreting coral reef monitoring data: A guide for improved management decisions. Ecol Indic. 2017;72:848–69.
- 54. Jouffray JB, Nystrom M, Norstrom AV, Williams ID, Wedding LM, Kittinger JN, et al. Identifying multiple coral reef regimes and their drivers across the Hawaiian archipelago. Philoso Trans R Soc Lon B Biol Sci. 2015;370(1659).
- 55. Standish RJ, Hobbs RJ, Mayfield MM, Bestelmeyer BT, Suding KN, Battaglia LL, et al. Resilience in ecology: Abstraction, distraction, or where the action is? Biol Conserv. 2014;177(0):43–51.
- 56. Angeler DG, Allen CR. Quantifying resilience. J Appl Ecol. 2016;53(3):617–24.
- 57. Quinlan AE, Berbés-Blázquez M, Haider LJ, Peterson GD, Allen C. Measuring and assessing resilience: broadening understanding through multiple disciplinary perspectives. J Appl Ecol. 2016;53(3):677–87.
- 58. Graham NAJ, Jennings S, MacNeil MA, Mouillot D, Wilson SK. Predicting climate-driven regime shifts versus rebound potential in coral reefs. Nature. 2015;518(7537):94–7. pmid:25607371
- 59. Steneck RS, Dethier MN. A functional group approach to the structure of algal-dominated communities. Oikos. 1994;69(3):476–98.
- 60. Ortiz JC, Bozec Y-M, Wolff NH, Doropoulos C, Mumby PJ. Global disparity in the ecological benefits of reducing carbon emissions for coral reefs. Nat Clim Chang. 2014;4(12):1090–4.
- 61. Halford A, Cheal AJ, Ryan D, Williams DM. Resilience to large-scale disturbance in coral and fish assemblages on the Great Barrier Reef. Ecology. 2004;85(7):1892–905.
- 62. Doropoulos C, Ward S, Roff G, Gonzalez-Rivero M, Mumby PJ. Linking demographic processes of juvenile corals to benthic recovery trajectories in two common reef habitats. PLoS ONE. 2015;10(5):e0128535. PubMed Central PMCID: PMCPMC4444195. pmid:26009892
- 63. Floros C, Schleyer MH. The functional importance of Acropora austera as nursery areas for juvenile reef fish on South African coral reefs. Coral Reefs. 2016:1–11.
- 64. Renken H, Mumby PJ. Modelling the dynamics of coral reef macroalgae using a Bayesian belief network approach. Ecol Model. 2009;220(9–10):1305–14.
- 65. Franco C, Hepburn LA, Smith DJ, Nimrod S, Tucker A. A Bayesian Belief Network to assess rate of changes in coral reef ecosystems. Environ Model Software. 2016;80:132–42.
- 66. Ban SS, Pressey RL, Graham NAJ. Assessing interactions of multiple stressors when data are limited: A Bayesian belief network applied to coral reefs. Global Environ Change. 2014;27(0):64–72.
- 67. Roff G, Mumby PJ. Global disparity in the resilience of coral reefs. Trends Ecol Evol. 2012;27(7):404–13. pmid:22658876
- 68. Mumby PJ, Steneck RS, Adjeroud M, Arnold SN. High resilience masks underlying sensitivity to algal phase shifts of Pacific coral reefs. Oikos. 2015.
- 69. Chollett I, Mumby PJ, Müller-Karger FE, Hu C. Physical environments of the Caribbean Sea. Limnol Oceanogr. 2012;57(4):1233.
- 70. Steneck RS, Arnold SN, Mumby PJ. Experiment mimics fishing on parrotfish: insights on coral reef recovery and alternative attractors. Mar Ecol Prog Ser. 2014;506:115–27.
- 71. McClanahan TR, Graham NAJ, MacNeil MA, Muthiga NA, Cinner JE, Bruggemann JH, et al. Critical thresholds and tangible targets for ecosystem-based management of coral reef fisheries. Proc Natl Acad Sci U S A. 2011;108(41):17230–3. pmid:21949381
- 72. Karr KA, Fujita R, Halpern BS, Kappel CV, Crowder L, Selkoe KA, et al. Thresholds in Caribbean coral reefs: implications for ecosystem-based fishery management. J Appl Ecol. 2015;52(2):402–12.
- 73. Williams SM, Chollett I, Roff G, Cortés J, Dryden CS, Mumby PJ. Hierarchical spatial patterns in Caribbean reef benthic assemblages. J Biogeogr. 2015;42(7):1327–35.
- 74. Zychaluk K, Bruno JF, Clancy D, McClanahan TR, Spencer M. Data-driven models for regional coral-reef dynamics. Ecol Lett. 2012;15(2):151–8. pmid:22188529
- 75. Cooper JK, Spencer M, Bruno JF. Stochastic dynamics of a warmer Great Barrier Reef. Ecology. 2015;96(7):1802–11. pmid:26378303