The objective of this study was to evaluate the performance of stacked species distribution models in predicting the alpha and gamma species diversity patterns of two important plant clades along elevation in the Andes. We modelled the distribution of the species in the Anthurium genus (53 species) and the Bromeliaceae family (89 species) using six modelling techniques. We combined all of the predictions for the same species in ensemble models based on two different criteria: the average of the rescaled predictions by all techniques and the average of the best techniques. The rescaled predictions were then reclassified into binary predictions (presence/absence). By stacking either the original predictions or binary predictions for both ensemble procedures, we obtained four different species richness models per taxa. The gamma and alpha diversity per elevation band (500 m) was also computed. To evaluate the prediction abilities for the four predictions of species richness and gamma diversity, the models were compared with the real data along an elevation gradient that was independently compiled by specialists. Finally, we also tested whether our richness models performed better than a null model of altitudinal changes of diversity based on the literature. Stacking of the ensemble prediction of the individual species models generated richness models that proved to be well correlated with the observed alpha diversity richness patterns along elevation and with the gamma diversity derived from the literature. Overall, these models tend to overpredict species richness. The use of the ensemble predictions from the species models built with different techniques seems very promising for modelling of species assemblages. Stacking of the binary models reduced the over-prediction, although more research is needed. The randomisation test proved to be a promising method for testing the performance of the stacked models, but other implementations may still be developed.
Citation: Mateo RG, Felicísimo ÁM, Pottier J, Guisan A, Muñoz J (2012) Do Stacked Species Distribution Models Reflect Altitudinal Diversity Patterns? PLoS ONE 7(3): e32586. doi:10.1371/journal.pone.0032586
Editor: Abdisalan Mohamed Noor, Kenya Medical Research Institute - Wellcome Trust Research Programme, Kenya
Received: September 2, 2011; Accepted: February 1, 2012; Published: March 2, 2012
Copyright: © 2012 Mateo et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The foundation of the “Banco Banco Bilbao Vizcaya Argentaria” gave the financial support. The Center for Conservation and Sustainable Development (Missouri Botanical Garden) generously provided the data on the distribution of plants. AG and JP received support from the European Commission (ECOCHANGE project) and from the Swiss National Science Foundation (project BIOASSEMBLE), and JM was also funded by grant CGL2009-09530-BOS of the Ministry of Science and Technology of Spain. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Altitudinal gradients have proven to be useful to test general hypotheses on the main drivers shaping global species diversity patterns, such as scale, landscape ecology, and area and season length effects . Altitudinal gradients are complex gradients and thus include variations in several environmental factors, such as temperature, precipitation, topography, erosion, and soil resources , which directly influence the growth, persistence and reproduction of organisms . These factors further control the spatial variation in species richness –.
The analysis of the biodiversity response to such key ecological gradients mainly involves modelling exercises at community level using comprehensive observational dataset (including a set of environmental variables and data on the distribution of a given organism). Modelling at community level can be performed following different strategies , such as direct versus species-assembly approaches , each involving different modelling options . The direct strategy of aggregating biological survey data to produce community-level entities that are then modelled (i.e., assemble first, predict later in ) has been much used and evaluated, but the alternative strategy of assembling individual species models (i.e., predict first, assemble later in ) has been evaluated far less and only more recently –, even though many of the assessments of the global threat to biodiversity that have been published were based on such an approach –. This option involves making individual models for all the species included in the analysis separately and then combine them to generate a community level analysis. More specifically, species distribution models (SDMs) have often been developed using data sampled along elevation gradients for the forecasting of biodiversity changes, for instance to anticipate the possible ecological impacts of climate change on mountain flora –. These models and predictions were usually evaluated in a standard way, e.g., by comparing the predictions and observations at the level of individual species distributions, but rarely by evaluating the properties of the assemblages themselves . In particular, little is known about the performance of stacked species distribution models (S-SDMs) in predicting biodiversity patterns along important ecological gradients such as elevation .
The S-SDM approach considers a simple stacking of individual species responses to the environment and therefore does not explicitly integrate any potential constraint on the maximum number of species that can co-occur in a given area (e.g., available energy, heterogeneity within the modelled unit, or biotic interactions; ). On average, it has been shown that the sum of the individual predictions tends to overestimate species richness (i.e., commission errors; , , ). Species assemblages can better represent environmental constraints on species richness in stressful (non-productive) environments (e.g., alpine areas) , , where diversity is primarily determined directly or indirectly by climate. In more productive environments, species responses to climatic factors alone cannot account for the key filters on the local assembly, and their stacked predictions may lead to greater species overprediction. These studies emphasise that the accuracy of prediction is not necessarily constant across geographic space or along an indirect ecological environmental gradient such as elevation.
Specific aspects of the model technique can also lead to error in species stacking that shapes biodiversity patterns along elevation gradients; some of these errors are more related to the technical aspects of modelling (e.g., the threshold for the binary classification of predicted probabilities; ) and others are more related to the ability of SDMs to capture the full spectrum of community assembly processes . These findings support the need to better evaluate the capacity of SDMs to predict assemblage and diversity patterns and to better understand their strengths and weaknesses in doing so. However, many questions, both technical and conceptual, remain to be addressed. The related assembly hypotheses should also be tested on a large variety of ecosystems and organisms.
In particular, one remaining question is whether stacked predictions from species distribution models (S-SDMs) can reproduce existing biogeographic patterns, such as the biodiversity patterns along environmental gradients. For instance, for species richness for different clades along an elevation gradient, Rahbek  recognised three main patterns: (1) a monotonic reduction from the lowest to the highest elevations; (2) a hump-shaped pattern, with the maximum values at middle elevations; (3) relatively constant values from low to middle elevations, followed by a sharp decrease toward highest elevations.
In this study, our objective was to fill this gap by evaluating the ability of S-SDMs to predict known patterns of species richness for Bromeliaceae and Araceae along a wide elevation gradient in Ecuador and by comparing different ecological modelling options. We used typical herbarium species occurrence data for 142 species, as used in Elith et al. , combined with typical bioclimatic maps to predict potential altitudinal biodiversity patterns and compare these with actual patterns obtained from two exhaustive, independent data: (1) expert criteria extracted from bibliography , and data from plot transect –. In the central Andes, Kessler  identified hump-shaped curves for Bromeliaceae, whereas Araceae showed relatively constant values up to elevations of between 1000 and 1500 m, followed by a monotonic decrease. It is thus interesting to evaluate how well these patterns can be reproduced by stacking individual predictions of species distributions. More specifically, we place more emphasis on comparing the performance of the two-ensemble modelling approach , which combines predictions from six techniques into a single prediction of species richness. To our knowledge, such an evaluation of SDMs to reconstruct patterns of species richness along an elevation gradient has very rarely been performed  and never along such a wide elevation gradient in the tropics.
Materials and Methods
We conducted all analyses on two plant clades: the genus Anthurium (Araceae family; 53 species) and the family Bromeliaceae (89 species). These two groups are interesting for this purpose because (1) the taxonomic knowledge for these two plant groups is extensive and thus offers the required guarantees of reliable identification at the species level; and (2) their observed altitudinal patterns have already been thoroughly investigated .
We used all of the records stored in the TROPICOS database (Missouri Botanical Garden). All records and location data (latitude/longitude) were checked by specialists from the Missouri Botanical Garden (Saint Louis, USA) and Real Jardín Botánico (Madrid, Spain), and whenever possible errors (i.e., georeferencing or species identification) were corrected; otherwise, data in error were removed. As part of this data checking process, we performed a statistical analysis to detect outliers, as in Mateo , and analyzed the outliers individually. Outliers that presented insufficient reliability (expert criteria) were discarded.
The final occurrence maps included 17,064 point locations. The minimum sample size to obtain reliable predictions of species distribution for these dataset was determined in a previous study , Therefore, species with fewer than 15 occurrences (i.e., for which reliable models could not be fitted because of the small sample size) were excluded from further analyses , .
We used the 19 bioclimatic variables (Table 1) that were available in WorldClim 1.3  (http://www.worldclim.org) as predictor variables. These bioclimatic variables were derived by interpolating monthly mean temperature and rainfall data onto a digital elevation model (1×1 km grid cell). They represent biologically relevant environmental factors . We did not find a priori reason for removing some variables and therefore kept all variables for the analyses, recognizing that overfitting may thus happen for species with low number of occurrences. We argue that such technical decision is conservative and may tend to predict more around the know presences.
Species distribution modelling
We used six different techniques to model individual species distributions. Boosted regression trees (BRT) , generalised linear models (GLM) , and multivariate adaptive regression splines (MARS)  are group discriminative techniques that need presence/absence data. The other three techniques, i.e., genetic algorithm for rule-set prediction (GARP) , Gower's metric distance (GMD)  and maximum entropy (MAXENT) , require only presence data.
Absences are necessary to perform the group discriminative techniques. As herbarium collections only provide presence data, we generated pseudo-absences as similarly performed by Elith et al.  with the extension “Random Point Generator 1.28” (ArcView 3.2) and the following constraints : (1) we generated approximately the same number of pseudo-absences as presences to avoid problems associated with unbalanced prevalence ; (2) to collect information on the different ecological conditions in the study area, we defined a minimum distance of 30 km between pseudo-absences , ; (3) to avoid increasing the false negative rate, we defined a buffer (30 km in diameter) around each presence from which pseudo-absences were eliminated , . The distance of 30 km was calculated based on the information contained in the maps according to the pixel size .
The six modelling techniques used are standard and well described , . We generated MARS models using MARS 2.0 (www.salford-systems.com), running 30 models per species and varying the following parameters: (1) the maximum number of basic functions; (2) whether or not interactions were allowed between basic functions; and (3) inclusion of all of the 19 WorldClim variables or elimination of the mean annual temperature and mean annual precipitation to reduce multicollinearity. We used MARS 2.0 instead of the mda library  related to the findings in previous works , , . The GLM models were generated using BIOMOD, and quadratic terms were allowed. The MAXENT models were generated in MAXENT 2.1 with the default settings (“Auto features”, convergence = 10-5, maximum number of iterations = 500, regularisation value β = 10-4). BRUTO (BRT) models were generated in R (www.r-project.org) with the “mda” package and the parameters detailed in Elith et al. . The Gower distance models (GMD) were performed in DIVA-GIS . GARP Desktop 1.1.6 was used to generate 100 models per species; we selected the bottom 20% of models with the lowest extrinsic omission error, and of those, the ten models around the median of the commission error were used to generate the GARP ensemble model presented in the results section.
Each modelling technique produces models with different prediction values. The GLM generates probabilities in the range of 0–1. MARS generates scores that are not restricted to a predefined range. MAXENT generates models with values between 0 and 100. GARP generates a set of presence/absence models (in this case, we used a combination of 10 presence/absence models). The values in the GMD models have a maximum of 100, but they do not have a minimum value; these values can be used “as is” or transformed. All models were rescaled to the [0–1] range to generate ensemble models. The models were rescaled using the following equation:
Assessing predictive performance
The predictive performance of SDMs should ideally be evaluated with a set of independent data. In our study, this procedure was not possible for most species, due to the scant number of available collections that requires using all available data to fit the model . Therefore, we assessed predictive performance of all SDMs by means of resubstitution, i.e. calculating ROC plots and the AUC statistic on the same data as used to fit the model. This is thus a different measure of model fit and some authors suggested that this can still be effective when no independent data can be left out for evaluation . Although, the AUC values obtained by a resubstitution process tend to be higher than the AUC values obtained by means of evaluation . In addition, we use independent data for some species of the genus Anthurium to evaluate the predictive power of models .
Following Araújo and New  and Marmion et al. , we calculated ensemble models for each of the species based on two different criteria: (1) ENSEMBLE-A: the average of all of the available rescaled SDMs (BRT, GARP, GLM, GMD, MARS, and MAXENT). (2) ENSEMBLE-B: the average of the four best methods (BRT, GLM, MARS and MAXENT) based on the model ranking in Elith et al. .
Binary models (presence/absence)
The original models were reclassified into models of presence/absence (BINARY) using a threshold approach. Liu et al.  and Jiménez-Valverde and Lobo  present different possibilities for choosing thresholds. Because only presence data were available, we used a threshold approach that minimised the commission error  and allowed a maximum commission error of 0.05.
Prediction of gamma diversity with respect to elevation
We estimated the gamma diversity in the same elevation band (500 m) used for the two ensemble models of alpha diversity. For the gamma diversity, we only used binary models and calculated the number of species predicted in at least a minimum number of pixels pertaining to each elevation band. We imposed three different thresholds by summing all of the species predicted in at least one pixel, in at least 10 pixels or in at least 50 pixels per elevation band.
Prediction of alpha diversity along altitude
We stacked (i.e., summed) the rescaled and binarised SDM predictions for the two ensemble procedures so that we obtained four species richness maps (S-SDMs) per taxa (Anthurium spp. and Bromeliaceae). We estimated the altitudinal alpha diversity patterns of the four S-SDMs along the elevation gradient by calculating the mean and maximum species richness of the pixels falling into the different 500 m elevation classes.
Evaluation of predicted altitudinal diversity patterns
To evaluate the ability of the ensemble S-SDMs to predict the alpha diversity patterns along the elevation gradient and the gamma diversity per elevation belt, we compared the model predictions to independent data compiled by Jørgensen and León-Yánez  for gamma diversity and to data compiled by Kessler ,  for alpha diversity.
For gamma diversity, independent distributions of the 53 species considered in the genus Anthurium and of the 89 Bromeliaceae species were extracted from the Catalogue of Vascular Plants of Ecuador . To determine whether the patterns of gamma diversity derived from the models were statistically similar to the observed patterns , , we used a reconstruction of the diversity change with elevation based on the literature. This procedure starts by generating for the most specious altitudinal band a random number between zero and the maximum number of species found for that band in the literature . For the remaining altitudinal bands, we generated random numbers limited to +/−10 species from the previous altitudinal band for Anthurium and +/−22 species for Bromeliaceae; these two values correspond to the maximum change in the number of species found in the literature between one altitude and the next level . This restriction was needed to keep the variability of the simulated values within a range similar to that of the observed values (i.e., to generate a realistic null model). We then compared the S-SDMs predicted differences in gamma diversity between each neighbouring altitudinal band with the differences generated by a set of 10,000 random simulations from our null model of altitudinal changes in gamma diversity. This comparison was based on the difference between the generated random number and the observed number of species and the average of the differences between the randomly generated and observed values across altitudinal bands. These differences were ordered, and the rank of the observed difference was divided by 10,000 to obtain the final empirical P-value. A P-value exceeding 0.05 would mean that the distribution derived from the models could have been obtained by chance alone, so that there was no association, at the 5% level, between the modelled and observed distributions.
For alpha diversity (species richness), the numerical data were not available for a similar statistical validation as performed for the gamma diversity. In this case, it was only possible to determine whether the patterns obtained with the models fit the patterns (curves comparison) established by Kessler , .
All species distribution models were highly accurate in regard to AUC values that were all above 0.95 . Figure 1 shows two richness models (S-SDMs) for the genus Anthurium, and Figure 2 shows the predicted richness for Bromeliaceae. Richness models that were derived from different ensemble procedures can be slightly different.
The S-SDMs were generated by stacking the binary models of 53 species. ENSEMBLE-A: ensemble model of the six methods available. ENSEMBLE-B: ensemble model of the four best methods.
The S-SDMs were generated by stacking the binary models of 89 species. ENSEMBLE-A: ensemble model of the six methods available. ENSEMBLE-B: ensemble model of the four best methods.
Table 2 shows the P-values of the randomisation tests, which show overall that the predicted gamma diversity patterns could be considered in most cases to be different from those derived from the null model of altitudinal changes in gamma diversity based on the literature  (Figure 3). However, only the ENSEMBLE-A-BINARY model could not be separated from (i.e., fits) the patterns derived from the literature.
Altitudinal patterns for the genus Anthurium (above) and the Bromeliaceae family (below) according to the two ensemble modelling procedures. We imposed three different thresholds by summing all of the species predicted in at least one pixel, in at least 10 pixels or in at least 50 pixels per elevation band. Independent γ-diversity: the altitudinal patterns of gamma diversity in Ecuador for the genus Anthurium (53 species) and the Bromeliaceae family (89 species). Information from the “Catalogue of the vascular plants of Ecuador” . ENSEMBLE-A: ensemble model of the six methods available. ENSEMBLE-B: ensemble model of the four best methods.
There was no large difference between the three thresholds (summing all species predicted in at least one pixel, 10 pixels or 50 pixels per elevation band) used to calculate the altitudinal gamma diversity patterns, although the predicted patterns that were closest to the independent evaluation datasets were always obtained with a threshold of 50 pixels (Figure 3, Table 2).
Figure 4 shows the predicted altitudinal patterns of alpha diversity. In both taxa (Anthurium spp. and Bromeliaceae), only the binary model yielded predictions that were comparable to the patterns described by Kessler , . The original models revealed a clear tendency toward overprediction in the high elevation areas.
Altitudinal patterns for the genus Anthurium (above) and the Bromeliaceae family (below) according to the two ensemble modelling procedures and original predictions or binary predictions of the SDMs. Independent α- diversity: the Araceae and Bromeliaceae altitudinal patterns of alpha diversity modified from Kessler . Maximum value: maximum number of species within each 500-m altitudinal belt. Mean value: average number of species within each 500-m altitudinal belt. ENSEMBLE-A: ensemble model of the six methods available. ENSEMBLE-B: ensemble model of the four best methods.
In this paper, we assessed the ability of binarised predictions of S-SDMs to reproduce patterns of species richness along a wide elevation gradient, considering both the mean alpha diversity and gamma diversity in elevation belts. We tested original rescaled and binarised predictions of S-SDMs based on two ensemble approaches for 142 plant species within two different taxonomic groups, namely the genus Anthurium and the family Bromeliaceae.
Altitudinal gamma diversity patterns
All of the ensemble procedures presented a significant over-prediction of gamma diversity (i.e., high commission error; Figure 3). ENSEMBLE-A-BINARY predicted the altitudinal gamma diversity patterns with fair to good accuracy, yielding patterns similar to those derived from the literature . Other models showed more serious problems of overprediction. If the goal of a study is related to conservation or to the disentanglement of spatial biodiversity patterns, the use of ENSEMBLE-BINARY or stacking results from models of that type is thus recommended. Furthermore, such an approach is also useful when the objective is to generate SDMs at the species level, for instance when associated with the conservation of a single species . However, to gain generality, these findings should be confirmed with studies in other ecosystems and involving other organisms.
The absence of large differences between the three thresholds (summing all species predicted in at least one pixel, 10 pixels or 50 pixels per elevation band) used to calculate the altitudinal gamma diversity patterns was likely because many more than 1 or 30 suitable pixels are predicted for most species found in each elevation band, making the difference weak even when the threshold was 50. The patterns closest to reality were most often obtained with the threshold of 50 pixels. Indeed, these thresholds are likely to depend on the extent and resolution used for the study, and in further studies, they could be defined as percentages of the band surface area rather than absolute pixel number values.
Altitudinal alpha diversity patterns
The first study exploring the altitudinal patterns in several plant families in the Neotropics was that of Kessler , who showed that Araceae had a relatively constant increase in alpha diversity values up to altitudes between 1,000–1,500 m and then decreased constantly above these elevations (Figure 4, ARAC). In our study, the richness map obtained with ENSEMBLE-A-BINARY and ENSEMBLE-B-BINARY showed altitudinal alpha diversity patterns similar overall to those in Kessler . However, the Kessler data are for all Araceae species, whereas in our study only the genus Anthurium was considered.
For the Bromeliaceae (Figure 4, BROM), Kessler  found hump-shaped curves for both the epiphyte (maximum to 1,700 m) and terrestrial species (maximum to 3,000 m). The species richness predictions obtained with ENSEMBLE-A-BINARY and ENSEMBLE-B-BINARY showed the pattern most similar to that of Kessler  for the Bromeliaceae.
For both taxa, the results obtained by the mean model (mean alpha diversity per pixel in binary models) were closer to reality than the maximum models (maximum alpha diversity per pixel in binary models). The maximum models presented significant over-prediction of gamma diversity (i.e., high commission error; Figure 4). All of the original models also showed significant over-prediction (Figure 4). These results are consistent with previous studies dealing with alpha diversity , , . The quality of the results obtained by the ENSEMBLE-A-BINARY procedure was most probably due to the binarisation procedure that was used. Indeed, the recently shown intrinsic tendency of S-SDM to overpredict species richness independently from any binarisation procedure  might have been balanced here by the setting of classification thresholds that minimized the commission error rates of the individual SDMs. Although this procedure appears to reduce the overprediction problem of S-SDMs, further investigation should be conducted on the effects on the assemblage composition in addition to the species richness predictions.
Evaluation of predicted altitudinal diversity patterns
In general, studies investigating the response of biodiversity to environmental changes that are based on SDMs evaluate the accuracy of their predictions at the species level. Here we showed that highly accurate SDMs (AUC above 0.95) might lead to important discrepancies between the predicted diversity patterns from S-SDMs and the observed patterns . We suggest the provision of both species-level and assemblage-level evaluation metrics when SDMs are used to investigate biodiversity patterns (S-SDMs). Robust gamma diversity estimates rarely exist; thus, such a null-model reconstruction should prove useful in further studies.
Binary models (presence/absence)
The use of a threshold clearly improved the results (Figures 3 and 4) by decreasing the commission error rates in SDMs and thus allowing the modelled altitudinal alpha diversity patterns to better fit the observed patterns. The original models showed serious overprediction problems at high elevations that were solved when the binary models were used. As previously suggested , the selection of an appropriate suitability threshold can reduce error rates in both individual and ensemble SDMs, but this selection is not straightforward and the results can vary, sometimes dramatically, depending on the threshold chosen. An additional problem in the selection of reliable and stable threshold values is the lack of real absences, as in the present study. When the modelling algorithm has no information on absences, small differences in the selected threshold value can severely affect the model outputs . As this threshold selection is often subjective, in this study, we chose a conservative value, which allowed a maximum commission error of 0.05. An interesting methodological line of research would thus be to study the reliability of the different thresholding approaches in species assemblage modelling, as it may help to reduce over-prediction in some cases.
Ensemble models have only relatively recently been applied to ecological modelling for predicting the spatial distributions of single species. Given the difficulty in choosing the most suitable technique , , , some authors suggest the combination of predictions from several modelling techniques to reduce the observed variability , , , . In addition to improving the prediction accuracy at the species level, our results further show that ensemble modelling approaches can also allow adequate predictions when stacking multiple species distributions.
Our results show that the S-SDMs generated from all of the techniques provide better results than the S-SDMs generated from the four best modelling techniques (Table 2). Thus, in future work, research efforts may be reduced by using only techniques that are known to generate reliable, stable and accurate SDMs, without the need to select the best ones. Furthermore, in our study, both stacking strategies over-predicted species richness, particularly at high elevations, although this is likely to be study-dependent.
The main conclusions that we can draw from this work are 1) Stacking ensemble models of species distributions could successfully reproduce alpha and gamma diversity patterns along a wide elevation gradient in the Andes; 2) The best results in relation to conservation or to disentangling the spatial patterns of biodiversity were obtained when stacking binary predictions of individual species distributions; 3) Stacking binary models may also reduce over-prediction, and more research must be conducted to find the most appropriate thresholding approach; and 4) The randomisation procedure used to reconstruct the gamma diversity patterns and to compare them with the S-SDM predictions represents a promising way to assess the predictions of stacked species distribution models along incompletely surveyed environmental gradients.
Conceived and designed the experiments: RGM JM AMF AG. Performed the experiments: RGM AMF JM. Analyzed the data: RGM AMF JM. Contributed reagents/materials/analysis tools: RGM AMF JM. Wrote the paper: RGM AG JM JP. Wrote the research project: JM AMF.
- 1. Nogués-Bravo D, Araújo MB, Romdal T, Rahbek C (2008) Scale effects and human impact on the elevational species richness gradients. Nature 453: 216–220.
- 2. Becker A, Korner C, Brun JJ, Guisan A, Tappeiner U (2007) Ecological and land use studies along elevational gradients. Mt Res Dev 27: 58–65.
- 3. Korner C (2000) Why are there global gradients in species richness? Mountains might hold the answer. Trends Ecol Evol 15: 513–514.
- 4. Ah-Peng C, Chuah-Petiot M, Descamps-Julien B, Bardat J, Stamenoff P, et al. (2007) Bryophyte diversity and distribution along an altitudinal gradient on a lava flow in La Réunion. Divers Distrib 13: 654–662.
- 5. Bhattarai KR, Vetaas OR, Grytnes JA (2004) Fern species richness along a central Himalayan elevational gradient, Nepal. J Biogeogr 31: 389–400.
- 6. Fleishman E, Fay JP, Murphy DD (2000) Upsides and Downsides: Contrasting Topographic Gradients in Species Richness and Associated Scenarios for Climate Change. J Biogeogr 27: 1209–1219.
- 7. Heaney LR (2001) Small mammal diversity along elevational gradients in the Philippines: an assessment of patterns and hypotheses. Global Ecol Biogeogr 10: 15–39.
- 8. Körner C (2000) Why are there global gradients in species richness? Mountains might hold the answer. Trends Ecol Evol 15: 513–514.
- 9. McCain CM (2004) The mid-domain effect applied to elevational gradients: species richness of small mammals in Costa Rica. J Biogeogr 31: 19–31.
- 10. Rahbek C (2005) The role of spatial scale and the perception of large-scale species-richness patterns. Ecol Lett 8: 224–239.
- 11. Rickart EA (2001) Elevational diversity gradients, biogeography and the structure of montane mammal communities in the intermountain region of North America. Global Ecol Biogeogr 10: 77–100.
- 12. Romdal TS, Grytnes J-A (2007) An indirect area effect on elevational species richness patterns. Ecography 30: 440–448.
- 13. Rowe RJ (2005) Elevational gradient analyses and the use of historical museum specimens: a cautionary tale. J Biogeogr 32: 1883–1897.
- 14. Vetaas OR, Grytnes J-A (2002) Distribution of vascular plant species richness and endemic richness along the Himalayan elevation gradient in Nepal. Global Ecol Biogeogr 11: 291–301.
- 15. Ferrier S, Guisan A (2006) Spatial modelling of biodiversity at the community level. J Appl Ecol 43: 393–404.
- 16. Algar AC, Kharouba HM, Young ER, Kerr JT (2009) Predicting the future of species diversity: macroecological theory, climate change, and direct tests of alternative forecasting methods. Ecography 32: 22–33.
- 17. Wilson KA, Westphal MI, Possingham HP, Elith J (2005) Sensitivity of conservation planning to different approaches to using predicted species distribution data. Biol Conserv 122: 99–112.
- 18. Baselga A, Araújo MB (2010) Do community-level models describe community variation effectively? J Biogeogr 37: 1842–1850.
- 19. Mateo RG (2008) Modelos Predictivos de Riqueza de Diversidad Vegetal. Comparación y Optimización de Métodos de Modelado Ecológico. Madrid: Universidad Complutense de Madrid. 187 p.
- 20. Pineda E, Lobo JM (2009) Assessing the accuracy of species distribution models to predict amphibian species richness patterns. J Anim Ecol 78: 182–190.
- 21. Trotta-Moreu N, Lobo JM (2010) Deriving the Species Richness Distribution of Geotrupinae (Coleoptera: Scarabaeoidea) in Mexico From the Overlap of Individual Model Predictions. Environ Entomol 39: 42–49.
- 22. Araújo MB, Pearson RG, Thuiller W, Erhard M (2005) Validation of species–climate impact models under climate change. Glob Change Biol 11: 1504–1513.
- 23. Botkin DB, Saxe H, Araújo MB, Betts R, Bradshaw RHW, et al. (2007) Forecasting the effects of global warming on biodiversity. Bioscience 57: 227–236.
- 24. Hortal J (2008) Uncertainty and the measurement of terrestrial biodiversity gradients. J Biogeogr 35: 1335–1336.
- 25. Randin CF, Engler R, Normand S, Zappa M, Zimmermann NE, et al. (2009) Climate change and plant distribution: local models predict high-elevation persistence. Glob Change Biol 15: 1557–1569.
- 26. Engler R, Randin CF, Vittoz P, Czáka T, Beniston M, et al. (2009) Predicting future distributions of mountain plants under climate change: does dispersal capacity matter? Ecography 32: 34–45.
- 27. Engler R, Randin CR, Thuiller W, Dullinger S, Zimmermann NE, et al. (2011) 21st century climate change threatens mountain flora unequally across Europe. Glob Change Biol 17: 2330–2341.
- 28. Pottier J, Dubuis A, Pellissier L, Maiorano L, Rossier L, et al. (In review) Accuracy of assemblage prediction from species distribution models for plants varies along environmental gradients. Global Ecol Biogeogr.
- 29. Guisan A, Rahbek C (2010) Predicting spatio-temporal patterns of species assemblages through integration of macroecological and species distribution models with assembly rules and source pool assignments. J Biogeogr 38: 1433–1444.
- 30. Pellissier L, Pradervand J-N, Pottier J, Dubuis A, Maiorano L, et al. (In review) Empirical modeling of butterfly assemblages shows more accurate predictions at high altitude and in plant rich grasslands. Ecography.
- 31. Rahbek C (1995) The elevational gradient of species richness a uniform pattern. Ecography 18: 200–205.
- 32. Elith J, Graham CH, Anderson RP, Dudík M, Ferrier S, et al. (2006) Novel methods improve prediction of species' distributions from occurrence data. Ecography 29: 129–151.
- 33. Jørgensen PM, León-Yánez S, editors. (1999) Catalogue of the vascular plants of Ecuador. 1181 p. Misouri Botanical Garden. Saint Louit. USA.
- 34. Kessler M (2001) Patterns of diversity and range size of selected plant groups along an elevational transect in the Bolivian Andes. Biodivers Conserv 10: 1897–1921.
- 35. Kessler M (2002) The elevational gradient of Andean plant endemism: varying influences of taxon-spedific traits and topography at different taxonomic levels. J Biogeogr 29: 1159–1165.
- 36. Araújo MB, New M (2007) Ensemble forecasting of species distributions. Trends Ecol Evol 22: 42–47.
- 37. Mateo RG, Felicísimo ÁM, Muñoz J (2010) Effects of the number of presences on reliability and stability of MARS species distribution models: the importance of regional niche variation and ecological heterogeneity. J Veg Sci 21: 908–922.
- 38. Papeş M, Gaubert P (2007) Modelling ecological niches from low numbers of occurrences: assessment of the conservation status of poorly known viverrids (Mammalia, Carnivora) across two continents. Divers Distrib 13: 890–902.
- 39. Hijmans RJ, Cameron SE, Parra JL, Jones PG, Jarvis A (2005) Very high resolution interpolated climate surfaces for global land areas. Int J Climatol 25: 1965–1978.
- 40. Austin M (2007) Species distribution models and ecological theory: A critical assessment and some possible new approaches. Ecol Modell 200: 1–19.
- 41. Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 29: 1189–1232.
- 42. McCullagh P, Nelder JA (1989) Generalized linear models. London: Chapman & Hall.
- 43. Friedman JH (1991) Multivariate adaptive regression splines. Ann Stat 19: 1–141.
- 44. Stockwell D, Peters D (1999) The GARP modelling system: problems and solutions to automated spatial prediction. International Journal of Geographical Information Science 13: 143–158.
- 45. Carpenter G, Gillison AN, Winter J (1993) DOMAIN: a flexible modelling procedure for mapping potential distrubitions of plants ans animals. Biodivers Conserv 2: 667–680.
- 46. Phillips SJ, Anderson RP, Schapire RP (2006) Maximum entropy modeling of species geographic distributions. Ecol Model 190: 231–259.
- 47. Mateo RG, Croat TB, Felicísimo ÁM, Muñoz J (2010) Profile or group discriminative techniques? Generating reliable species distribution models using pseudo-absences and target-group absences from natural history collections. Divers Distrib 16: 84–94.
- 48. Titeux N (2006) Modelling species distribution when habitat occupancy departs from suitability. Application to birds in a landscape context: Université catholique de Louvain.
- 49. Elith J, Leathwick JR (2007) Predicting species distributions from museum and herbarium records using multiresponse models fitted with multivariate adaptive regression splines. Divers Distrib 13: 265–275.
- 50. Pearson RG, Raxworthy CJ, Nakamura M, Townsend Peterson A (2007) Predicting species distributions from small numbers of occurrence records: a test case using cryptic geckos in Madagascar. J Biogeogr 34: 102–117.
- 51. Anderson RP (2003) Real vs. artefactual absences in species distributions: test for Oryzomys albigularis (Rodentia: Muridae) in Venezuela. J Biogeogr 30: 591–605.
- 52. Loiselle B, Howell CA, Graham CH, Goerck JM, Brooks T, et al. (2003) Avoiding pitfalls of using species distributions models in conservation planing. Conserv Biol 17: 1591–1600.
- 53. Muñoz J, Felicísimo AM (2004) A comparison between some statistical methods commonly used in predictive modeling. J Veg Sci 15: 285–292.
- 54. Hijmans RJ, Guarino L, Bussink C, Mathur P, Cruz M, et al. (2004) DIVA-GIS, version 4. A geographic information system for the analysis of biodiversity data. Manual. (Available at http://www.diva-gis.org).
- 55. Marmion M, Parviainen M, Luoto M, Heikkinen RK, Thuiller W (2009) Evaluation of consensus methods in predictive species distribution modelling. Divers Distrib 15: 59–69.
- 56. Liu C, Berry PM, Dawson TP, Pearson RG (2005) Selecting thresholds of occurrence in the prediction of species distributions. Ecography 28: 385–393.
- 57. Jiménez-Valverde A, Lobo JM (2007) Threshold criteria for conversion of probability of species presence to either-or presence-absence. Acta Ecol 31: 361–369.
- 58. Fielding AH, Bell JF (1997) A review of methods for the assessment of prediction errors in conservation presence/absence models. Environ Conserv 24: 38–49.
- 59. Ewens WJ (2003) On Estimating P Values by Monte Carlo Methods. The American Society of Human Genetics 72: 496–498.
- 60. North BV, Curtis D, Sham PC (2002) A Note on the Calculation of Empirical P Values from Monte Carlo Procedures. The American Society of Human Genetics 71: 439–441.
- 61. Guisan A, Broennimann O, Engler R, Vust M, Yoccoz NG, et al. (2006) Using Niche-Based Models to Improve the Sampling of Rare Species. Conserv Biol 20: 501–511.
- 62. Pellissier L, Anne Bråthen K, Pottier J, Randin CF, Vittoz P, et al. (2010) Species distribution models reveal apparent competitive and facilitative effects of a dominant species on the distribution of tundra plants. Ecography 33: 1004–1014.
- 63. Dubuis A, Rion V, Pottier J, Pellissier L, Theurillat J-P, et al. Predicting spatial patterns of plant species richness: a comparison of direct macroecological and species stacking approaches. Divers Distrib. In press.
- 64. Austin MP (2002) Spatial prediction of species distribution: an interface between ecological theory and statiscal modelling. Ecol Model 157: 101–118.
- 65. Segurado P, Araújo MB (2004) An evaluation of methods for modelling species distributions. J Biogeogr 31: 1555–1568.
- 66. Araújo MB, Thuiller W, Pearson RG (2006) Climate warming and the decline of amphibians and reptiles in Europe. J Biogeogr 33: 1712–1728.
- 67. Araújo MB, Whittaker RJ, Ladle RJ, Erhard M (2005) Reducing uncertainty in projections of extinction risk from climate change. Global Ecol Biogeogr 14: 529–538.