Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Uncertainties in Ecosystem Service Maps: A Comparison on the European Scale

  • Catharina J. E. Schulp ,

    Affiliation Faculty of Earth and Life Sciences, VU University Amsterdam, Amsterdam, the Netherlands

  • Benjamin Burkhard,

    Affiliations Institute for Natural Resource Conservation, Kiel University, Kiel, Germany, Leibniz Centre for Agricultural Landscape Research ZALF, Müncheberg, Germany

  • Joachim Maes,

    Affiliation European Commission - Joint Research Centre, Institute for Environment and Sustainability, Ispra, Varese, Italy

  • Jasper Van Vliet,

    Affiliation Faculty of Earth and Life Sciences, VU University Amsterdam, Amsterdam, the Netherlands

  • Peter H. Verburg

    Affiliation Faculty of Earth and Life Sciences, VU University Amsterdam, Amsterdam, the Netherlands

Uncertainties in Ecosystem Service Maps: A Comparison on the European Scale

  • Catharina J. E. Schulp, 
  • Benjamin Burkhard, 
  • Joachim Maes, 
  • Jasper Van Vliet, 
  • Peter H. Verburg


Safeguarding the benefits that ecosystems provide to society is increasingly included as a target in international policies. To support such policies, ecosystem service maps are made. However, there is little attention for the accuracy of these maps. We made a systematic review and quantitative comparison of ecosystem service maps on the European scale to generate insights in the uncertainty of ecosystem service maps and discuss the possibilities for quantitative validation. Maps of climate regulation and recreation were reasonably similar while large uncertainties among maps of erosion protection and flood regulation were observed. Pollination maps had a moderate similarity. Differences among the maps were caused by differences in indicator definition, level of process understanding, mapping aim, data sources and methodology. Absence of suitable observed data on ecosystem services provisioning hampers independent validation of the maps. Consequently, there are, so far, no accurate measures for ecosystem service map quality. Policy makers and other users need to be cautious when applying ecosystem service maps for decision-making. The results illustrate the need for better process understanding and data acquisition to advance ecosystem service mapping, modelling and validation.


The benefits that ecosystems provide to society are increasingly acknowledged. Safeguarding these benefits and maintaining, restoring and enhancing ecosystem services (ES) in the future is included as a target in several international policies, such as the 2020 targets of the Convention on Biological Diversity [1], [2]. The European Union (EU) elaborates this target in the European Biodiversity Strategy that aims at maintaining and enhancing ecosystems and their services [3].

Decisions or policies on ES are made based on available information on the status, trends, and spatial distribution of ecosystem service provision. To support such policies, there is, consequently, an increasing demand for accurate maps of the supply and demand of ecosystem services [4], [5]. The European Commission therefore aims to “map and assess the state of ecosystems and their services (…) by 2014” [3] and several attempts to map the supply and demand of ecosystem services have been presented in the literature [5], [6], [7], [8].

To support policy design on ES, indicators are needed to quantify specific targets on maintaining ES and to monitor progress towards these targets. These indicators should pass basic quality criteria. The Impact Assessment Guidelines of the European Commission summarize such criteria in the RACER framework [9]: indicators should be Relevant to the objectives to be reached by the target, Accepted by staff and stakeholders, Credible, unambiguous and easy to interpret, Easy to monitor and Robust against manipulation. Although not explicitly stated, the “Accepted, Credible and Robust” criteria acknowledge that indicators should provide accurate data.

Due to the lack of direct monitoring data on ES, they are commonly mapped using model-based proxies. Although it is frequently recognized that such maps are crude estimates, there is little discussion on the magnitude of the errors associated with them [10], [11]. Eigenbrod et al. [12] were the first to quantify the magnitude of errors in ES maps for part of the UK and raised concerns about the accuracy of ES maps and about inconsistencies among mapping approaches [12]. Later reviews of ES mapping studies indicated that only a small fraction of the ES mapping studies did address uncertainty in a quantitative way [11], [13]. For example, uncertainties in ES models were addressed by Kozak et al [14] and Lautenbach et al [15] for small case studies. Schulp et al [16] do address uncertainties in a map for pollination services at a EU scale. Nevertheless, there is little knowledge about the influence of the mapping method and input data on the representation of spatial patterns of ecosystem service supply [17]. Most of the mapping studies pay little attention to error propagation [18].

Studies on ecosystem service map validation are lacking [11]. This is attributed to the fact that many ecosystem services cannot be measured directly, resulting in a lack of direct data on the provision of the service. Several ES mapping studies provide a qualitative comparison with independent proxies, e.g. [7], [19], but these are rather indications for the credibility than full validations.

In this paper, we identify uncertainties in continental-scale ecosystem service maps. Based on a systematic comparison of maps for the EU territory for five ecosystem services (climate regulation, flood regulation, erosion protection, pollination, and recreation), we map spatial patterns of agreement and disagreement for the provision of these five services. Secondly, we evaluate the magnitude and sources of uncertainty in current ecosystem service maps. Based on the quantitative evaluation of ES map consistency and validity, we evaluate to what extent the current ES indicators suffice for target setting and evaluation and other forms of policy support and recommend best practices for ES mapping.


Considered studies

To provide insight in the uncertainty in ecosystem service maps, we made an inventory of ES maps that cover the EU extent (Figure 1). For five ES (climate regulation, flood regulation, erosion protection, pollination, and recreation), we identified a wide range of existing maps representing a variety of sources and approaches. For other ES insufficient different maps were available to be included in the analysis.

Figure 1. Study area location (left) and regional subdivision and country names as referred to in the results (right).

U.K. = United Kingdom, NL = Netherlands, LC = Luxembourg.

We analysed uncertainties in ES maps building on four consistent and published sets of ecosystem service maps (Table 1). First, Burkhard et al. [6] map the capacity to provide ES at the European scale using an expert-based classification of land cover data (hereafter referred to as: LC approach). In this approach, an expert evaluation of the level of ES provision for each land cover type into five classes is used to map ES provision. Second, Kienast et al. [7] provide an expert-based map of landscape capacities to provide ES. These maps are based on a similar expert evaluation as the maps of Burkhard et al [6] but include a wide range of environmental variables like relief and landscape types (EV approach). A third set of ES maps originates from a hybrid approach. A hybrid approach uses both process-based models as well as empirical models. This set of ES maps aims to take optimal advantage of available data on land use and environmental indicators [5] (JRC approach). The fourth set of ES maps consists of maps of intermediate complexity. In an intermediate complexity approach, process-based model results are upscaled to a wider extent using empirical relationships with other spatial data [16], [19], [20], [21], [22] (IVM approach).

Table 1. Overview of the ecosystem service datasets analysed in this study.

In addition to these four sets that all contain the same five ES, other studies are available that map one single ES (Table 1). Together, the maps represent the range of complexity of approaches to create ES maps for larger areas.

Map preparation

Available ES maps strongly differ in representation of the services, units, range of output values and spatial resolution (Table 1). To enable comparison, the maps were made consistent by aggregation to a common spatial resolution and normalizing the ecosystem service indicator values to a common range and unit. Firstly, the categorical LC maps were converted into numerical maps. Following Burkhard et al [33], who indicate that the ES provision categories can be translated into numerical variables using an equal interval classification, we reclassified the ES provision categories of the LC maps into: no ES provision = 0, very low ES provision = 0.2, low = 0.4, moderate = 0.6, high = 0.8, very high = 1. Secondly, all maps were aggregated to NUTS2 regions by calculating the mean value for the ES for each region. The NUTS2 level was chosen as it represents the resolution of the least detailed map. NUTS (the EU Nomenclature of Territorial Units for Statistics) is the standard regional subdivision of the European territory for statistical purposes. NUTS2 regions are the basic regions for the application of regional policies [34]. Thirdly, all maps were normalised using a min-max normalisation to cover the range [0,1] with 0 indicating the lowest value for an ES. The EV maps were computed using a linear combination of explaining variables, and therefore we assumed linearity for the normalization [7].

To summarise maps of individual services, we calculated an ES bundle map for each of the four sets of maps (LC, EV, JRC, IVM). An ES bundle represents an overall level of the provisioning of the five services considered and was calculated as the sum of the five normalised ecosystem service maps. High values thus indicate locations with a relatively high supply or multiple services, while low values indicate the opposite. These bundle maps were included in the comparison because policies aim at protecting the overall level of ecosystem service provision rather than or additional to the provision of individual services [3], [35].

Map comparison and analysis

Maps for individual ES as well as the bundles were analysed both pair-wise and for all maps together. For the pair-wise comparisons, we use one index that summarizes the relative differences between the maps, the Map Comparison Statistic (MCS) (Equation 1):(Equation 1)Where MCS is the Map Comparison Statistic, a and b are the normalized values of an ecosystem service in a particular NUTS2 region, N is the number of NUTS2 regions considered. MCS values were computed for all available ES maps. This comparison statistic was chosen because it is symmetric (yielding the same result independent of which of the maps is map a or b) and has a defined range (zero for two equal maps; one for two completely contrasting maps) [36]. The MCS thus indicates the average difference between any pair of ES values, expressed as a fraction of the highest value. Two random maps would have an MCS of 0.5 while two opposing maps would have an MCS of 1 and two identical maps would have an MCS of zero.

To analyse the agreement in spatial patterns of ES in the four sets of maps (LC, EV, JRC, IVM), we calculated hotspot and coldspot maps. Hotspots and coldspots are areas providing, respectively, high and low amounts of a particular ES [37], [38] and are defined as areas where the ES supply values fall within the upper or lower quartile of its value distribution. Agreement between the hotspot and coldspot maps of the four mapping approaches was calculated by counting the number of maps that indicated a hotspot or coldspot at a certain NUTS2 region. In addition, we calculated the mean value per NUTS2 region over the four included maps, as well as the coefficient of variation (CV), which is the standard deviation divided by mean. The mean and CV maps were calculated to give a general impression of the spatial patterns of ES supply and their related uncertainty. The mean value over the four included maps gives an indication of the ES supply in each NUTS2 region, while the CV provides information on the relative range of values provided by the different maps, and is therefore an indicator for the patterns of uncertainty in the ES maps.

To support analysis of the sources of uncertainty, ES maps were compared with spatial patterns of land cover. We calculated Pearson's correlations between the percentage of a specific land cover per NUTS2 region and the mean and CV of the mapped supply of each ES. This analysis aimed to explore relations between land cover and ES supply values and the variation in reported values of the ES indicators per land cover type. Although relations between land cover and ES are frequently used for mapping ES, they are largely untested [13] and the exploration therefore was expected to provide useful insights into the variation between ES models for different land cover types.


The map comparison methods described in the section “Map comparison and analysis” provide insight in the agreement among the maps and give an indication of the overall level of uncertainty in ES mapping at EU scale. However, it does not provide insight in the deviations from the actual provision of the ES. Therefore, additional to the systematic comparison of ecosystem services maps, the ES maps were compared against independent data that provide a proxy for the ES. As most ES are difficult to measure directly, the independent proxies do not fully match the definition of the ES and not all independent proxies cover the full European Union. However, in all cases association between the spatial patterns of the ES map and the independent proxy can be expected and we interpret such a coincidence association as an indication of the model quality. Table 1 provides an overview of the independent data used for comparison and the assumed relations between the values of the independent map and the ES maps. All independent maps were aggregated to NUTS2 resolution and transformed to ensure the highest values in the independent maps matched the highest values expected from the ES maps. Consistent with Kienast et al. [7], we subdivided the ES map data and the independent data into four quartiles and made a cross-tabulation to calculate the overlap between the independent data and the ES maps. We counted the regions where there was agreement and subdivided this by number of regions where agreement could be expected by chance.

All analyses were performed in R using the packages rgdal [39] and raster [40].

Results and Interpretation

Pair-wise map comparisons

Differences among the climate regulation maps are small with MCS values of 0.27 and lower (Table 2). However, when the four maps included in this study are compared to a process-based estimate derived from the LPJ carbon cycle model [27], larger differences are found, with MCS values up to 0.46 for the comparison with the LC map. A map of carbon stocks [41] (Table 1) compares reasonably with all other climate regulation maps; MCS values range between 0.13 (EV map) and 0.24 (LC map). The recreation maps also show relatively small differences among the maps. MCS values for pollination are higher and range up to 0.49 for the comparison between the JRC map and the IVM map. The maps were also compared to two other maps that are an indicator of the available potential pollinator habitat. The map by Serna-Chavez et al. [28] is close to the LC map (MCS: 0.19) but deviates from the JRC map (MCS: 0.44). The habitat map by Schulp et al. [16] is most similar to the JRC map (MCS: 0.19) and deviates most from the IVM map (MCS: 0.38). Flood regulation and erosion protection show high MCS values, indicating that the maps are more different from each other than maps for the other ecosystem services.

Table 2. Map comparison statistics of individual ecosystem services and bundles.

For the ecosystem service bundles, the MCS values are lower than for the individual service maps (Table 2). While for the individual services the JRC maps and IVM maps are most deviating, the bundle maps of JRC and IVM are the most similar because differences amongst ecosystem services average out.

Spatial patterns

For climate regulation, there is agreement on the location of a coldspot in the north-western EU while there is reasonable agreement on hotspots in the central southern region (Figure 2; see Figure 1 for regional subdivision). These coldspots and hotspots can also be seen in the average climate regulation map (Figure 3). High climate regulation capacities are found in Sweden and Finland because of the high percentage forest cover, but here the maps strongly disagree. The provision of climate regulation is strictly defined [42], and is normally quantified based on the rate of carbon sequestration (e.g. in the Common International Classification of Ecosystem Services, CICES ( This service is to a large extent provided by natural vegetation. Consequently, the climate regulation maps depend largely on land cover data. All the analysed maps use the same land cover map [23]. The process of carbon sequestration is well-researched [11] and there is consensus on the direction and magnitude of drivers for climate regulation. All maps assume that arable land and urban areas do not provide the service in a relevant amount, and assume that forests and areas that are more natural do. Although the parameterisation of the land cover types differs among the studies, the consistency in input data, well-established process knowledge and strict indicator definition result in the highest level of agreement among the ES assessed here.

Figure 2. Agreement between maps for each ecosystem service.

The maps indicate the number of maps that have a hotspot or coldspot per NUTS2 region. Dark grey areas were not considered.

Figure 3. Mean ecosystem service provision per NUTS2 region.

Dark grey areas were not considered.

Pollination maps agree on hotspots in southern Europe and coldspots in western and eastern Europe, while disagreement is seen in central and northern Europe (Figure 2). The areas where the maps disagree have a high average level of pollination provisioning (Figure 3). Indicators for pollination are all based on land cover only, but the maps differ strongly. First, there are differences in definition of the service and in its parameterisation. The JRC approach uses a joint indicator for demand and supply while the indicators used in the LC, EV and IVM approaches focus on supply. The IVM indicator quantifies the probability that a pollinator visits a location while the EV and LC indicators are based on pollinator habitats as proxies. Secondly, pollination depends on landscape configuration and small landscape elements, and with that on the resolution of the input data. The analysed maps are based on different input land cover data and differ in parameterisation of small patches of nature, forest edges, linear landscape elements, and the role of pastures, olive groves and other permanent crops. The EV and LC approach only use the EU-scale CORINE land cover map [23]. The JRC approach supplements this with a map of the density of small patches of nature while the IVM map includes the density of linear landscape elements as an input. As a consequence of the different indicators, parameterisations and input data, high variation among the maps is seen as well as high CV values (Table 3) and a positive correlation of the CV with pasture areas (Table 4).

Table 3. Minimum and maximum coefficients of variation for NUTS2 regions between service estimates; low values indicate agreement between the different ES estimates, high values indicate large variation between reported values.

Table 4. Correlations between area percentages of land cover classes* per NUTS2 region and mean and CV of ecosystem service provision.

The erosion protection maps show no agreement in regions identified as a hotspot (Figure 2). A few regions show agreement between the coldspots for erosion protection, especially within strongly urbanised regions. This disagreement between the maps for this service is also reflected in the high minimum coefficient of variation (0.31, Table 3). On average, high erosion protection is expected in Sweden and Finland, and in central Europe, due to the high amount of natural vegetation. Low values are found in Hungary, the UK and parts of Spain. In most of the areas with a high average level of erosion protection, the variation among the estimates is large. A variety of indicator definitions is available for this service, that quantify the reduction of soil loss or provide a general indication for the protective effect of natural vegetation [7]. The service depends on many variables, including precipitation, water flow, soil, relief, vegetation and management. This leads to a large variation in input data, as well as model definition and parameterisation, and consequently to a large disagreement between the maps.

The flood regulation maps show large differences in their spatial pattern but agree on hotspots in Sweden and Finland and coldspots in Hungary. High mean values are also found in large parts of central Europe while low values dominate in the UK. In considerably large areas with low flood regulation, the maps are in agreement. A variety of indicator definitions is available for this service. Flood regulation can be quantified as the water storage capacity, the reduction of flood danger or damage [43] or as the role of land cover in regulating runoff, discharge, or retention of water [7], [44]. Flood regulation depends on many variables, including precipitation, water flow, soil, relief, vegetation and management. This leads to a large variation in input data, as well as model definition and parameterisation. Finally, flood regulation is a directional service (the service flows from a point of production to a point of use in a specific direction [45], [46], [47]. This is accounted for in the IVM and JRC flood regulation maps but not in the LC and EV maps.

The recreation service maps only show small areas of disagreement scattered across Europe. High values are seen along the southern margin of the EU, in the north of the UK, northern Spain and in Sweden and Finland. There is reasonable agreement on the values between the maps (Figure 3) with low coefficients of variation (Table 3). Recreation ES supply is strongly dependent on land cover and the four mapping approaches use the same variables to quantify supply, such as the presence of coasts, protected areas and relief. Also the input datasets are similar in the different approaches, resulting in similar maps.

High overall ES provision is expected in Sweden and Finland and parts of southern Europe while a low provision of the selected services is seen in large urban areas, and in Hungary and the southeast of the UK (Figure 3). The maps do agree on the areas with low values for the ecosystem service bundle. Agreement on areas with high provision of the total bundle is lower (Figure 2).

Figure 4 summarizes the area percentage in which the analysed ES maps agree. The erosion protection maps disagree in half of the area considered, meaning that in half of the EU territory some maps expect a hotspot for erosion protection while other maps expect a coldspot at the same location. The recreation maps (partly) agree in >80% of the EU territory. In about 5% of the area, all four analysed maps expect a coldspot for recreation. For all ES, there tends to be more agreement on the locations of coldspots than on the locations of hotspots (Figures 2 and 4). Coldspots for all ES coincide with urban or arable areas. This is supported by more detailed studies that have focussed on the provision of services in arable and urban areas: carbon sequestration [48], pollinator habitat [49], protection against erosion and floods [21] and landscape features for recreational activities [19] are often observed at lower levels in urban or arable areas.

Figure 4. Agreement between the ecosystem service maps.

100% agreement indicates the area where all maps indicate a hotspot, a coldspot or no extreme values, <100% agreement indicates regions where one to three of the maps have a hotspot or coldspot and the other maps do not demonstrate extreme values. Disagreement indicates the regions where at least one map indicates a hotpot and at least one other map indicates a hotspot.

Table 4 summarizes correlations between the mean ES provision values and CVs, and the percentage per region covered by particular land cover types. The provision of all five ES is negatively correlated with regions with a high coverage of urban and arable land, and positively correlated with forests and natural areas. For all individual ES, except recreation, the CVs are positively correlated with the area covered by built-up land, indicating that the maps disagree on ES provision in urban areas. The maps agree on a high level of ES provision in forest areas, indicated by the negative correlations between CVs and forest areas. The positive correlations between CVs and arable land area indicate that the maps disagree on the ES provision in arable land, while for pasture the CV differs per service. In areas with more pasture, the maps disagree more on the provision of pollination and recreational services, while for the other services no relations were found. However, the individual estimates for these areas still show a large variation due to a lack of process understanding and different parameterisations in the models used. The higher agreement of the ES bundle maps is due to averaging out differences between the services.


Table 5 summarizes the agreement of the ES maps with independent datasets. For climate regulation, all ES maps compare better with the independent proxy than could be expected by chance. Agreement is mainly seen in parts of northern and southern Europe. For pollination and erosion prevention only one of the ES maps corresponds better with the independent proxy than would be expected by chance. Correspondence of the pollination maps with the independent proxy is seen in mainland western Europe while the erosion maps only show agreement in southern Europe. The flood regulation maps show some agreement with the independent proxy mainly in northern Europe while the recreation maps mainly show some agreement in western Europe.

Table 5. Agreement between ecosystem service maps and independent maps.


Sources of uncertainty

The considerable disagreement among spatial patterns of ecosystem service provision across Europe is an indication of the uncertainties in large-scale ecosystem service assessments. Five sources can contribute to these uncertainties (classified after [18]).

First, the definition of the ecosystem service indicators is not consistent. Different categorisations of ecosystem services are available, the Millennium Ecosystem Assessment [50], the TEEB classification [42] and the CICES classification [51] being the most common. Due to differences in the definition of services in these classification systems, the same service does not necessarily address the same aspects [52], [53].

Secondly, the level of process understanding can cause uncertainty in quantification and mapping. Ecosystem services are supplied by ecosystems to humans through a variety of biophysical and socio-economic processes. Not all these processes are completely understood or quantified [44]. Different levels of understanding and the inherent uncertainty in understanding lead to different quantification methods and different choices regarding the inclusion of determinants.

Third, the aim of mapping influences the selection of the most relevant indicators, the data that are used, and the parameterization of the models.

Fourth, the data sources themselves influence the uncertainty of ES maps. An important data source for all ES maps are land cover data, but also several other biophysical or socio-economic data sources are used. Different ES maps are often based on different data sources to quantify the same input variable. These differences in input data propagate into differences in the resulting ecosystem service maps.

Finally, the methodology for mapping ES is a source of uncertainty. Mapping methods have different levels of complexity, ranging from process-based simulation to expert based value-transfer methods. Different methods result in different ES maps.

The systematic comparison of ES maps indicates that the agreement among ES maps increases when the sources of uncertainty described above are lower. Climate regulation is a clearly defined and well-understood ES which indicators are mostly based on land cover only, resulting in a high agreement. On the other hand, for erosion protection the indicators used for mapping diverge strongly and use a wide variety of input data. As a consequence, the agreement among the maps is lower.


By the intercomparison of different ES maps, we provide insight in the spatial patterns of uncertainties and the level of agreement between the maps across Europe. Such intercomparisons of various model outcomes are a common methodology used for different types of global environmental change models, especially for those where independent validation data are scarce [54], [55]. However, model intercomparison does not provide insight in the validity of the models and deviations from the actual ecosystem service provision. Only a comparison of the maps with observed data can help to determine absolute validity levels of the ecosystem service maps.

For the five ecosystem services considered in this paper, available data that can serve as independent proxies to validate the results are collected and compared with the ecosystem service maps. Generally, the studied ES maps are poorly or moderately similar to the independent proxy maps. This does not necessarily provide evidence of the quality of the ES maps assessed here and results have to be interpreted with care. First, the independent proxies are highly different from the ES maps. For none of the ES maps, independent proxies could be identified that exactly match the definition of the service and the indicators used for mapping them. As many ES cannot be measured directly [56], independent proxies that better fit the definitions of the ES indicators were not available. Additionally, there are differences in scale between the maps and independent data. It is not possible to disentangle the relative importance of these two causes from the importance of the map quality upon comparison with independent proxy maps. For a proper validation, independent data covering the variety of conditions throughout the EU would be needed that match the ES definition as described in Table 1. Such data are lacking.

We compared ES maps at the level of administrative units using normalised values of ES provision. Comparing normalized values is potentially less accurate than comparing absolute values. For example, comparison of normalized values would not yield any difference in the case were values for ES provisioning are overestimated by a certain percentage in all locations. However, because the ESs compared in this study were expressed using different units for the same ES, a comparison based on absolute values was not possible. The harmonization of the data to allow comparison has a few other disadvantages as well. Aggregating maps to the resolution of administrative units can lead to a reduction of the spatial variation in ES provision and is likely to result in higher levels of agreement between the maps, especially for ecosystem services showing high spatial variation (e.g. erosion risk, pollination), this can have a large impact.

Importance for policy making

Robust, reliable and comparable data on ES are important for the advancement of biodiversity objectives and to inform the development and implementation of related policies, on water, climate, agriculture, forest, and regional planning. As elaborated by Maes et al. [51], ES maps at EU scale can support decision-making and implementation in multiple ways. First and foremost, mapping ES is an essential part of the EU Biodiversity Strategy to 2020 and ES maps are used to identify priorities for ecosystem restoration and enable the development of an initiative on no net loss of biodiversity and ES. Importantly, the biodiversity strategy aims to mainstream ES into other policies [41], which also entails the use of ES maps for implementation and targeting of those policies. In the EU, these are notably the common agriculture policy (CAP) and the cohesion policy. The CAP has a profound influence on ecosystems and biodiversity [57] that is recognised in a reform of the policy in 2014, by introducing ecological focus areas aiming at protecting farmland biodiversity and small landscape elements. ES maps will prove to be crucial elements in the spatial identification of those areas where regulating ES support (e.g. pollination, control of pest species, erosion control) and enhance sustainable agricultural production. The cohesion policy, which is essentially responsible for the main share of the EU's investments in the regional economy, is aligning its objectives with goals on sustainable growth. In particular, the conservation and enhancement of natural assets through the development of a green infrastructure network at multiple scales can give rise to socio-economic benefits, which is a priority of cohesion policy. Hence again the need for high quality and consistent spatial information on the levels of services provided by ecosystems which are essential to decision making on future investments using regional EU funds.


This study showed that a different definition of an ecosystem service or a different mapping approach could lead to strongly different spatial patterns of ecosystem service provision. The systematic intercomparison of four EU-scale maps of different ecosystem services demonstrated that there is an overall agreement among the climate regulation maps and the recreation potential maps. The erosion protection and flood regulation maps differed strongly, the pollination maps showed intermediate variation among the maps. Differences between the maps are caused by differences in the mapping aim, indicator definitions, input data and mapping approaches. The sources of uncertainty differ in their importance for the mapping of different ecosystem services. For services with larger differences in definition and mapping approaches, larger differences between individual maps emerge.

Due to the lack of independent data on ecosystem service provision, ecosystem service maps cannot be properly validated and there are, so far, no appropriate measures for map quality.

The choice of a specific ecosystem service map to support policy will influence the specification of policy targets and implementation priorities. Together with the lack of insight in ecosystem service map quality, varying map compilation and interpretation skills, this indicates that mapmakers and end-users should be cautious when applying ecosystem service maps for decision-making. Mapmakers need to clearly underpin the indicators used, the methods, and related uncertainties. Finally, there is an urgent need for better process understanding and data acquisition for ecosystem service mapping, modelling and validation.


Felix Kienast and Veiko Lehsten are thanked for making their maps available.

Author Contributions

Conceived and designed the experiments: CJES PV JV. Performed the experiments: CJES. Analyzed the data: CJES PV JV. Contributed reagents/materials/analysis tools: CJES BB JM. Wrote the paper: CJES PV JV BB JM.


  1. 1. Larigauderie A, Prieur-Richard AH, Mace GM, Lonsdale M, Mooney HA, et al. (2012) Biodiversity and ecosystem services science for a sustainable planet: the DIVERSITAS vision for 2012–20. Curr Opin Environ Sustain 4: 101–105.
  2. 2. Mace GM, Cramer W, Díaz S, Faith DP, Larigauderie A, et al. (2010) Biodiversity targets after 2010. Curr Opin Environ Sustain 2: 3–8.
  3. 3. European Commission (2011) Communication from the Commission to the European Parliament, the Council, the Economic and Social Committee and the Committee of the Regions: Our life insurance, our natural capital: an EU biodiversity strategy to 2020. Brussel: European Commission.
  4. 4. Crossman ND, Burkhard B, Nedkov S, Willemen L, Petz K, et al. (2013) A blueprint for mapping and modelling ecosystem services. Ecosystem Services 4: 4–14.
  5. 5. Maes J, Egoh BN, Willemen L, Liquete C, Vihervaara P, et al. (2012) Mapping ecosystem services for policy support and decision making in the European Union. Ecosystem Services 1: 31–39.
  6. 6. Burkhard B, Kroll F, Nedkov S, Müller F (2012) Mapping ecosystem service supply, demand and budgets. Ecol Indic 21: 17–29.
  7. 7. Kienast F, Bolliger J, Potschin M, De Groot RS, Verburg PH, et al. (2009) Assessing Landscape Functions with Broad-Scale Environmental Data: Insights Gained from a Prototype Development for Europe. Environ Manage 44: 1099–1120.
  8. 8. Schulp CJE, Alkemade JRM, Klein Goldewijk K, Petz K (2012) Mapping ecosystem functions and services in Eastern Europe using global-scale data sets. Int J Biodiv Sci, Ecosyst Serv & Manage 8: 156–168.
  9. 9. European Commission (2009) Impact Assessment Guidelines. Brussels: European Commission, SEC(2009) 92
  10. 10. Egoh BN, Reyers B, Rouget M, Richardson DM, Le Maitre DC, et al. (2008) Mapping ecosystem services for planning and management. Agric Ecosyst Environ 127: 135–140.
  11. 11. Seppelt R, Dormann CF, Eppink FV, Lautenbach S, Schmidt S (2011) A quantitative review of ecosystem service studies: approaches, shortcomings and the road ahead. J Appl Ecol 48: 630–636.
  12. 12. Eigenbrod F, Armsworth PR, Anderson BJ, Heinemeyer A, Gillings S, et al. (2010) The impact of proxy-based methods on mapping the distribution of ecosystem services. J Appl Ecol 47: 377–385.
  13. 13. Pagella TF, Sinclair FL (2014) Development and use of a typoology of mapping tools to assess their fitness for supporting management of ecosystem service provision. Landsc Ecol 29: 383–399.
  14. 14. Kozak J, Lant C, Shaikh S, Wang G (2011) The geography of ecosystem service value: The case of the Des Plaines and Cache River wetlands, Illinois. Appl Geogr 31: 303–311.
  15. 15. Lautenbach S, Kugel C, Lausch A, Seppelt R (2011) Analysis of historic changes in regional ecosystem service provisioning using land cover data. Ecol Indic 11: 676–687.
  16. 16. Schulp CJE, Lautenbach S, Verburg PH (2014) Quantifying and mapping ecosystem services: Demand and supply of pollination in the European Union. Ecol Indic 36: 131–141.
  17. 17. Kandziora M, Burkhard B, Müller F (2013) Mapping provisioning ecosystem services at the local scale using data of varying spatial and temporal resolution. Ecosystem Services 4: 47–59.
  18. 18. Hou Y, Burkhard B, Müller F (2013) Uncertainties in landscape analysis and ecosystem service assessment. J Environ Manage in press.
  19. 19. Van Berkel DB, Verburg PH (2011) Sensitising rural policy: Assessing spatial variation in rural development options for Europe. Land Use Policy 28: 447–459.
  20. 20. Schulp CJE, Nabuurs GJ, Verburg PH (2008) Future carbon sequestration in Europe - Effects of land use change. Agric Ecosyst Environ 127: 251–264.
  21. 21. Sturck J, Poortinga A, Verburg PH (2014) Mapping ecosystem services: The supply and demand of flood regulation services in Europe. Ecol Indic 38: 198–211.
  22. 22. Tucker G, Allen B, Conway M, Dickie I, Hart K, et al.. (2013) Policy Options for an EU No Net Loss Initiative. London: Institute for European Environmental Policy,.
  23. 23. EEA (2000) CORINE Land Cover 2000. Available: Accessed 2012 Apr 2.
  24. 24. Maes J, Paracchini ML, Zulian G (2011) A European assessment of the provision of ecosystem services. Towards an atlas of ecosystem services. Ispra: JRC.
  25. 25. Zulian G, Maes J, Paracchini ML (2013) Linking Land Cover Data and Crop Yields for Mapping and Assessment of Pollination Services in Europe. Land 2: 472–492.
  26. 26. Paracchini ML, Zulian G, Kopperoinen L, Maes J, Schägner JP, et al. (2014) Mapping cultural ecosystem services: A framework to assess the potential for outdoor recreation across the EU. Ecol Indic 45: 371–385.
  27. 27. Lehsten V, Sykes MT, Kallimanis A, Mazaris A, Verburg PH, et al. (2014) Disentangling the effects of expected land use, climate and CO2 on European habitat types, carbon stocks and primary productivity. Global Ecology and Biogeography: Submitted.
  28. 28. Serna-Chavez HM, Schulp CJE, Van Bodegom PM, Bouten W, Verburg PH, et al. (2014) A quantitative framework for assessing spatial flows of ecosystem services. Ecol Indic 39: 24–33.
  29. 29. Imhoff ML, Bounoua L, Ricketts TH, Loucks C, Harriss R, et al.. (2004) HANPP Collection: Global Patterns in Net Primary Productivity (NPP). Palisades, NY: NASA Socioeconomic Data and Applications Center (SEDAC). Accessed 15 February 2012.
  30. 30. Brakenridge GR (2010) Global Active Archive of Large Flood Events. Available: Accessed 2013 Jul 27.
  31. 31. GBIF (2007) Global Biodiversity Information Facility data portal. Available: Accessed 2013 Jul 27.
  32. 32. Bai ZG, Dent DL, Olsson L, Schaepman ME (2008) Global Assessment of Land Degradation and Improvement 1. Identification by remote sensing (No. GLADA Report 5). Wageningen: ISRIC.
  33. 33. Burkhard B, Kandziora M, Hou Y, Müller F (2014) Ecosystem service potentials, flows and demands – concepts for spatial localization, indication and quantification. Landscape Online 34: 1–32.
  34. 34. EUROSTAT (2011) Regions in the European Union. Nomenclature of territorial units for statistics NUTS2010/EU-27. EUROSTAT methodologies and working papers DOI: 10.2785/15544.
  35. 35. BIO by Deloitte (2014) Study supporting potential land and soil targets under the 2015 Land Communication, Report prepared for the European Commission, DG Environment in collaboration with AMEC, IVM and WU.
  36. 36. Hagen-Zanker A (2006) Comparing Continuous Valued Raster Data. Maastricht: RIKS BV.
  37. 37. García-Nieto AP, García-Llorente M, Iniesta-Arandia I, Martín-Lopez B (2013) Mapping forest ecosystem services: From providing units to beneficiaries. Ecosystem Services 4: 126–138.
  38. 38. Gimona A, Horst D (2007) Mapping hotspots of multiple landscape functions: a case study on farmland afforestation in Scotland. Landsc Ecol 22: 1255–1264.
  39. 39. Bivand R, Keitt T, Rowlingson B, Pebesma M, Summer M, et al.. (2014) Rgdal: Bindings for the Geospatial Data Abstraction Library. Available at Accessed: 2013 Apr 8.
  40. 40. Hijmans RJ, Van Etten J (2012) Raster: Geographic analysis and modelling with raster data. Available at Accessed: 2013 Apr 8.
  41. 41. Maes J, Hauck J, Paracchini ML, Ratamäki O, Hutchins M, et al. (2013) Mainstreaming ecosystem services into EU policy. Curr Opin Environ Sustain In Press.
  42. 42. De Groot RS, Fisher B, Christie M, Aronson J, Braat L, et al.. (2010) Integrating the ecological and economic dimensions in biodiversity and ecosystem service valuation. In: Kumar P, editor. The Economics of Ecosystems and Biodiversity: Ecological and Economic Foundations. London and Washington, Earthscan, pp. 9–40.
  43. 43. De Groot RS, Alkemade JRM, Braat L, Hein L, Willemen L (2010) Challenges in integrating the concept of ecosystem services and values in landscape planning, management and decision making. Ecological Complexity 7: 260–272.
  44. 44. Nedkov S, Burkhard B (2012) Flood regulating ecosystem services—Mapping supply and demand, in the Etropole municipality, Bulgaria. Ecol Indic 21: 67–79.
  45. 45. Bagstad KJ, Johnson GW, Voigt B, Villa F (2013) Spatial dynamics of ecosystem service flows-A comprehensive approach to quantifying actual services. Ecosystem Services 4: 117–125.
  46. 46. Costanza R (2008) Ecosystem services: Multiple classification systems are needed. Biol Conserv 141: 350–352.
  47. 47. Syrbe R, Walz U (2012) Spatial indicators for the assessment of ecosystem services: Providing, benefiting and connecting areas and landscape metrics. Ecol Indic 21: 80–88.
  48. 48. Janssen IA, Freibauer A, Schlamadinger B, Ceulemans R, Ciais P, et al. (2004) The carbon budget of terrestrial ecosystems at country-scale–a European case study. Biogeosci Discuss 1: 167–193.
  49. 49. Carré G (2009) Landscape context and habitat type as drivers of bee diversity in European annual crops. Agric Ecosyst Environ 133: 40–47.
  50. 50. Millennium Assessment (2005) Ecosystems and human well-being.
  51. 51. Maes J, Teller A, Erhard M (2013) Mapping and assessment of ecosystems and their services: an analytical framework for ecosystem assessments under action 5 of the EU Biodiversity Strategy to 2020. Luxembourg: Publications office of the European Union.
  52. 52. Hernández-Morcillo M, Plieninger T, Bieling C (2013) An empirical review of cultural ecosystem service indicators. Ecol Indic 29: 434–444.
  53. 53. Villamagna AM, Angermeier PL, Bennett EM (2013) Capacity, pressure, demand, and flow: A conceptual framework for analyzing ecosystem service provision and delivery. Ecological Complexity 15: 114–121.
  54. 54. Cheaib A, Badeau V, Boe J, Chuine I, Delire C, et al. (2012) Climate change impacts on tree ranges: model intercomparison facilitates understanding and quantification of uncertainty. Ecol Lett 15: 533–544.
  55. 55. Rosenzweig C, Elliott J, Deryng D, Ruane AC, Müller C, et al. (2014) Assessing agricultural risks of climate change in the 21st century in a global gridded crop model intercomparison. Proc Natl Acad Sci U S A 111: 3268–3273.
  56. 56. Bennett EM, Peterson GD, Gordon LJ (2009) Understanding relationships among multiple ecosystem services. Ecol Lett 12: 1394–1404.
  57. 57. Pe'er G, Dicks LV, Visconti P, Arlettaz R, Báldi A, et al. (2014) EU agricultural reform fails on biodiversity. Science 344: 1090–1092.