Maple syrup production is an important economic activity in north-eastern North-America. The beginning and length of the production season is linked to daily variation in temperature. There are increasing concerns about the potential impact of climatic change on this industry. Here, we used weekly data of syrup yield for the 1999–2011 period from 121 maple stands in 11 regions of Québec (Canada) to predict how the period of production may be impacted by climate warming. The date at which the production begins is highly variable between years with an average range of 36 days among the regions. However, the average start date for a given region, which ranged from Julian day 65 to 83, was highly predictable (r2 = 0.88) using the average temperature from January to April (TJ-A). A logistic model predicting the weekly presence or absence of production was also developed. Using the inputs of 77 future climate scenarios issued from global models, projections of future production timing were made based on average TJ-A and on the logistic model. The projections of both approaches were in very good agreement and suggest that the sap season will be displaced to occur 15–19 days earlier on average in the 2080–2100 period. The data also show that the displacement in time will not be accompanied by a greater between years variability in the beginning of the season. However, in the southern part of Québec, very short periods of syrup production due to unfavourable conditions in the spring will occur more frequently in the future although their absolute frequencies will remain low.
Citation: Houle D, Paquette A, Côté B, Logan T, Power H, Charron I, et al. (2015) Impacts of Climate Change on the Timing of the Production Season of Maple Syrup in Eastern Canada. PLoS ONE 10(12): e0144844. doi:10.1371/journal.pone.0144844
Editor: Gisèle LaPointe, University of Guelph, Canada, CANADA
Received: July 7, 2015; Accepted: November 24, 2015; Published: December 18, 2015
Copyright: © 2015 Houle et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: Third party data under confidentiality restrictions due to their private nature. Data are available from the "Fédération des Producteurs Acéricoles du Québec" upon request. Furthermore, the data was gathered from private producers under conditions of confidentiality. The Federation may be contacted at: http://www.siropderable.ca/accueil.aspx.
Funding: The costs associated with this research were covered by the “Ministère des Forêts, de la Faune et des Parcs du Québec” (DH) and “Le Fond Vert du Ministère du Développement Durable, Environnement, et Parc du Québec” within the framework of the Action Plan 2006-2012 on climate change in association with Natural Resources Canada (DH and BC) (http://www.mffp.gouv.qc.ca/accueil.jsp), (http://www.mddelcc.gouv.qc.ca/ministere/fonds-vert/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Maple syrup production from sap goes back to the first nation peoples of north-eastern North-America . With time, the methods were modernized and maple syrup production is now an important economic activity for the region. Sugar maple (Acer saccharum Marsh.), a dominant species throughout north-eastern North-America, is the most-used species because of its high sugar sap content (2–3%) . In addition to sap sweetness, there is increasing interest in the chemical composition of maple syrup, particularly the phenolic compounds, because of their antioxidant, antiradical and antimutagenic properties .
The period of syrup production  as well as the annual yield [5, 6] have been shown to depend on climatic conditions, and therefore vary between years and regions. Recently, sugar maple producers in the province of Québec (which is responsible for 75% of the world production) have expressed concerns about the high year to year variability in the timing of the season (Houle, unpublished data). Similarly, in a survey conducted among producers of Québec, Ontario, Atlantic Canada and northeastern USA, 73% mentioned that start of the season was showing increasing between years variability .
Sap volume and sugar content are associated to climatic conditions that prevail during the production season, as well as in the months preceding it [8–11]. Several processes are involved in initiating spring sap production, which is based on alternating positive and negative pressure in the trunk and branches which is favoured by freezing temperatures at night followed by above-zero temperatures during the day (freeze/thaw cycle) [8, 12, 13].
The physiological processes involved, as much for volume as for sugar content, can be related to a few determinant conditions. Some authors noted that the ideal climatic conditions for sap production are temperatures close to 0°C at night rising above 4°C during the day [11, 12, 14]. Others identified the maximum daily temperature  or the difference between the minima and maxima as factor determining production . Climatic conditions in the months preceding sap production can also be determinant . Precipitation (snow or rain) between October and April (inclusively) are positively correlated to syrup production in the following spring . Cold winters are also positively correlated to yield because they are associated with increased sugar content in sap . Warm temperatures in April may abruptly halt production by favouring bud break and the proliferation of microorganisms in the tap .
Because of the close links between climate and maple syrup production, climatic change is likely to have a strong impact on the industry [4, 6]. Predicted climate change effects for north eastern North-America include an increase in annual temperature and precipitation which will be particularly strong during winter, as well as a reduction in the duration of the snow cover . Below freezing winter temperatures must last long enough for the tree to begin the dehardening process necessary for the beginning of sap production ; should this period become too short, tree physiology and vigor could be affected which would reduce sap production. Although no significant trends are projected in the number of freeze/thaw cycles , the period of the year where the frequency of those cycles is at its peak is expected to happen sooner in the season. The possible impacts of these changes on maple syrup production are many. Because of its dependence on freeze/thaw cycles, the production season should occur earlier in time . Duchesne et al. suggested that the period of sugar maple production will have to be shifted 12 and 19 days earlier in 2050 and 2100 respectively, in order to capture the optimum climatic conditions necessary to maintain the syrup production at its current level.
This paper aims at investigating the impact of climate change on the timing and duration of the sap season. To date, the temporal variability of syrup yield has been studied mainly on an annual basis [1, 6], or on finer temporal scales (days) but for only one specific site at a time for a one-year period [11, 13]. As a result, models capable of taking into account the variability in fine temporal scales and regional differences in timing of the sap season are still lacking. Here, we use a weekly data set of maple syrup production from 121 sugar maple producers located in 11 regions of Québec for a period of 13 years along with climate data to build models of maple syrup production timing. These models are then used to make projections of the impact of climate change on the timing (beginning and end) of maple syrup production based on 77 climate change scenarios issued from global climate models. We hypothesize that the period of syrup production will occur sooner in spring and that it will become more variable between years.
Maple syrup production and climatic data
Weekly maple syrup production data (kg per tap) for the 1999–2011 period were obtained from surveys collected by the « Fédération des Producteurs Acéricoles du Québec » (FPAQ) from 121 producers scattered over 11 regions in Québec (Fig 1 and Table 1). Weekly data from all contributing producers from a given region were aggregated to obtain a total of 143 observations (13 years times 11 regions) for the beginning, end and length of the sap production period. Daily climate data from several weather stations in each region (Fig 1) were used to compute the weekly climate variables needed for the predictive model. The modeling was carried out with the objective of selecting a small number of variables known to be associated with one or several mechanisms influencing sap flow. One of the most important process identified, freeze/thaw cycles, was assessed by testing several temperature variation thresholds between -3 and +5°C as well as mean daily temperature intervals to obtain the best predictors of the timing of sap flow (see S1 Table for the complete list of variables used and their description). For consistency, we maintain the term freeze/thaw cycle for climate variable names even when the threshold temperatures was not 0°C. Similarly, for cumulated degrees days above (thawing) and below (freezing), the threshold is always calculated relative to the threshold temperature considered. Since the freeze/thaw cycle and cumulative degree day calculations are inherently sensitive to any smoothing of the temperature signals that result from the averaging of multiple locations, weekly climate variables were first calculated for individual weather stations and subsequently averaged for each of the 11 regions.
BSL: Bas-Saint-Laurent; CTS: Côte-du-Sud; BEA: Beauce; QUE: Québec; MAU: Mauricie; LAN: Lanaudière; EST: Estrie; LAU: Laurentides, Outaouais, Abitibi-Témiscamingue; CDQ: Centre-du-Québec; STY: Saint-Hyacinthe; VAL: Valleyfield.
Timing and duration of production season model
We modeled the duration of the production season, which was defined as the interval between the first (start) and the last (end) week of production for a given region and year. It is important to note that this definition may not always match exactly with the physiological sap flow period, but rather with the period during which maple sap is actively transformed into syrup. In some circumstances, the actual sap flow period may extend over the production season because the producers may cease to produce syrup because of low sap quality or volume, especially towards the end of the season. Our definition thus combines both the physiological and operational aspects of maple syrup production. Logistic regression was used to predict the duration, start and end of the production season (Eq 1). The outcome modelled in this case is whether production is achieved or not in a given week.(1)
Where is the probability of a given week to have some production, β1 to βn are the parameters to estimate, x1 to xn the independent explanatory variables, and ε the residual error of the model.
A categorical variable was created to discriminate the weeks that belong to the period of production. To select the explanatory variables, Pearson’s correlation was calculated between the categorical variable and the climatic variables. Climatic variables with the largest correlations with the categorical variable were tested individually in a logistic model. The Akaike criterion (AIC)  was used to compare the different models. The model with the smallest AIC was selected and the correlation between the residuals of the selected model and the climatic variables was calculated. Variables with high correlation with the residuals were added individually to the initial model in order to produce improved models. Each improved model was compared to the initial model with a likelihood ratio test. If the likelihood ratio test detected a significant difference between the original model and the improved model, the improved model was retained. Among all the retained improved models, the model with the smallest value of AIC was kept and the precedent steps were repeated in an attempt to improve the model. These steps were repeated until additional variables did not improve the model. Once a final model was obtained, a ten-fold cross-validation was used to test model dependency on the "training" dataset used to calibrate it .
The cut-point (the value between 0 and 1 over which the week was considered as a production week) was first established at 0.5 and adjusted iteratively to 0.51 in order to maximise the sensitivity (ability of the model to accurately classify the production weeks) and specificity (ability of the model to accurately classify the non-production weeks) of the model.
A set of 77 simulations from global climatic models (GCM) was used for syrup production season projections , belonging to three greenhouse gas (GHG) emission scenarios . Simulated daily data, necessary to compute changes in sap flow dates and total production, were obtained for three temporal horizons: 1971–2000 (reference), 2046–2065 (2050 horizon) and 2081–2100 (2090 horizon). To build local climatic scenarios adapted for the projection of future maple syrup production, a post-processing method (“daily translation”) was applied on the raw climate model data variables of daily min and max temperatures and daily precipitation . The required reference database of daily observations needed for the post-processing procedure was obtained from the ~10km x 10km gridded daily data described in Hopkinson et al.  and Hutchinson et al. .
Projecting the production season timing
The model previously obtained for predicting the start, end and length of the production season was run with the 77 climatic scenarios to predict the impact of climate change on the timing and duration of the maple syrup production for each of the 11 regions (Fig 1). Weekly predictive climate variables used in the timing and duration were first calculated for all simulated years. For each of the 77 climate scenarios, each simulated year of data is used to determine the start, end and length of the syrup production season using the timing and duration model.
Results and Discussion
Variability in production period between regions and years
The average day (Julian day) when the production of syrup started for the reference period ranged from 65 (VAL and STY) to 83 (BSL) between regions (Fig 2, Table 1). A similar range was also observed for the end of the production with average Julian days of 101 and 116 for the same regions, respectively. The average temperature for the period of January to April (TJ-A), that ranged from -3.7 (VAL) to -7.3°C (BSL), was a strong predictor of the start and end date (not shown) for each region (Fig 3). Although such a relationship may appear likely, this is the first time the temperature sensitivity (corresponding to the slope of the relationship shown on Fig 3) of the “phenology” of maple syrup production is quantified. Based on the latter equation, the onset of syrup production is expected to advance by about four days for each degree of warming. This value is in good agreement with reported values of changes in the date of flowering and leafing for many plant species that fall within 2.5 to 5 days for a warming of 1°C . Clearly, such a model based on average temperature cannot be used to predict the day at which the season will start for a given year but it can be used to predict the long term changes in the onset of the maple syrup production using only scenarios of annual temperature (see below).
Regions are ranked by increasing mean annual temperature (closed triangles, right axis).
The equation is shown on the figure along with the r2.
Despite the fact that the period of observations is not long in terms of absolute number of years (n = 13 years), the data set included strong between years and between regions variability in terms of weather and timing of maple syrup production. Weekly data for the years 2010 and 2008, the years with the earliest and the latest production periods, respectively, showed a 4–5 week difference in the timing of peak syrup production (data not shown). On a regional and yearly basis, the earliest date of onset of syrup production, Julian day 53, was observed in the STY region in 2010 while the latest (Julian day 104) was observed in LAU in 2003 (Table 1). Ends of the production period showed similar variability with the earliest and latest ends of production being observed on Julian day 87 (VAL, 2000) and 139 (LAU, 2003), respectively. Given that when the production starts later it normally ends later, the average length of the production season was much less variable than start and end dates (Fig 2; Table 1), ranging from 31 (MAU) to 38 Julian days (CTS and QUE).
Modelling the season of maple syrup production with the logistic model
The logistic model is made of the cumulated number of freeze/thaw events with a threshold of 3°C (FrThw3:NbCum) along with the same variable squared. It has often been mentioned that freeze-thaw cycles (with a 0°C threshold) are necessary to induce sap flow for sugar maple. The threshold of 3°C obtained here may indicate that fluctuations around a given temperature close to 0°C are sufficient for sap flow to occur. However, the 3°C threshold is the one measured at the meteorological stations disseminated within each region. It is possible that the sugar maple stands under study may be located at higher elevation and that they were exposed to temperature variations closer to 0°C than 3°C. The model also includes the cumulated number of growing degree-days starting on Julian Day 1 using a 5°C threshold (GDDCum). This latter variable has a negative effect on the number of weeks with maple syrup production. Its role in the model is likely for predicting the end of the production period when too much heat has been accumulated by the maple stands. Overall, the model was successful at classifying weeks in the proper bin (production or not). The global model accurately predicted 83% of the production weeks and 95% of the non-production weeks (data not shown).
Projections of future changes in the timing of the production season
The logistic model (Eq 2) was used with the climatic data of 77 scenarios to project future dates of start and end of the season of syrup production, as well as its length. The absolute values as well as the delta (changes as compared to the reference period 1971–2000) are shown in Table 2. Depending on the regions, the logistic model predicts that the start and end of the production season will occur 9–13 days, and 15–19 days earlier for the 2046–2065 and 2081–2100 periods respectively, as compared to the reference period (Table 2). Given that changes in season start and end of production dates are nearly similar, the simulations predict no changes in season length for the 2046–2065 period and only a small (1–2 days) but insignificant increase for the 2081–2100 period. Overall the magnitude of the changes predicted here are coherent with the results of Skinner et al.  who predicted shifts in the sap season in the order of 15 and 30 days for 2100 using only the B1 and A1fi climate change scenarios, respectively. The B1 scenario is more similar to the median scenario used in our simulations while the A1fi scenario is one of the most extreme in terms of increased temperature which explains the particularly strong changes (30 days) in season timing obtained with the latter scenario.
The projections obtained with the logistic model were compared with the projections of the model based on average TJ-A temperature. For this comparison, the emphasis was put on the start of the production season since the length is not projected to be affected in the future. Moreover, the start of the season is crucial from an operational point of view for the producers since they normally tap the maple trees a few weeks before they expect the season to begin. On some occasions, if sap flow starts much earlier than usual, the producers may not be ready to collect sap and may face economic losses.
The comparison between the projections of the two models is shown in Fig 4 for the first day of production (panel A) as well as for its displacement in time (panel B) for the 2081–2100 period (n = 847, 77 simulations x 11 regions). There was a strong agreement between the two models (r2 = 0.80, p < 0.001) regarding the first day of production which was mainly driven by the regional gradient (both models are ranking the regions fairly in the same order since there is an average annual temperature gradient between regions, Fig 2). The displacement in time of the first day of production (panel B) was also comparable in terms of dispersion (similar variability and range) and both models yielded identical average displacements of -17.5 ± 7 days (n = 847). A strong correlation between the numbers of days of displacement was not expected (as compared to day of start, panel A) since there is no major regional differences in the projection of displacement (Table 2). The large number of simulations as well as the very good agreement of the two models which are based on different and weakly interrelated variables, suggest a robust assessment of the projected changes in the future. The results mean that sugar maple trees, as well as syrup producers, must adapt to seasons that will start earlier than at present which appears plausible given that past observations included some very early and very late seasons.
The right panel (B) shows the distribution of the displacement (delta Julian day) of the 2081–2100 vs the 1971–2000 period.
In our study, the use of a great number of climatic scenarios is useful not only for obtaining a robust estimation of changes in the timing of the maple syrup production season, but also to assess the variability around the average estimates. Although the use of the median result of many climatic simulations is seen as robust , there is quite a lot of variation among the 77 simulations for a given region. An example of the detailed results obtained with the logistic model is illustrated on Fig 5 for the Valleyfield region (VAL). The density probability curves of each of the date of onset (panel A) or ends (panel B) of production for a given year obtained by each of the 77 individual simulations and for each period of time considered are shown as well as for season lengths (panel C). Overall, our projections for the start, end and length of the production season tend to suggest an increase in variability for the future, as shown by the density probability curves that show an increasing spread (panels B and C for date of end and season lengths) in future projections and also by the increasing standard deviation coefficient in the period 2041–2060 and 2081–2100 as compared to the 1971–2000 period (Table 2). However, this apparent increase could be simply due to the large number of climate scenarios used (based on multiple climate models, driven with different scenarios of GHG emissions), whereas only one "scenario" will be realized in the future. In fact, total climate projection uncertainty is known to increase into the future as families of GHG emissions (SRES families) diverge and by the fact that the various climate models have different sensitivities to a given amount of GHG forcing . To investigate the potential for a higher variability in the future, we computed the standard deviation in annual production for each period (n = 20 years each) and simulation. In other words, we compare the variation in the results obtained for each simulation between periods, not among simulations. We could not detect a significant change in variation for the future (Table 3). We thus concluded that the shift to an earlier sap season in the future will not be accompanied by an increase in between year variability in the timing of maple syrup production.
Each thin line represents the distribution of the different years within each of the 77 projections based on the 77 global climate scenarios.
The data for the VAL region also show that a few simulations for the 2081–2100 period are projecting years with short seasons (1–3 weeks), or even no season at all (Fig 5C; red lines crossing the Y axis—intercept = 0 means no season). These rare events will correspond to “extreme” years in a climate where the average start of the season for the VAL region will be displaced by 19 days (Table 2). These events will be more frequent for the southernmost regions (data not shown), where the climate is already warmer but since their absolute frequency is still projected to be small, no significant impacts on between year variability are projected. Interestingly, such effect (quasi-absence of a season resulting in a low syrup yield) was already observed in several US states  in the exceptionally warm spring of 2012, perhaps telling of what the future holds for these regions.
In this study, we built models capable of predicting the start and the end (and thereby length) of the maple syrup production period based on a unique data set of weekly observations made at 121 maple stands spread in 11 regions of the province of Québec (which is responsible for 75% of the world sugar maple syrup production). There was a strong spatial and temporal variability in the timing of the production period. In warmer regions, production began on average 17 days earlier as compared to colder regions. The average date of the beginning of production can be predicted with success with the average temperature from January to April. A logistic model using climatic variables associated with the physiological process of sap flow was also built from the 143 individual observations (13 years x 11 regions) for predicting the period of syrup production. When used in combination with 77 global climate scenarios, the models predict that the period of production will begin 9–13 and 15–19 days earlier for the 2046–2065 and 2081–2100 periods, respectively, but its length is not projected to change. The strong agreement between the two independent models suggests a robust assessment of the changes in timing. The results also show that there will be a higher frequency of extreme years with short season of production in the future, especially in the southern part of the province. However, according to our projections, this would not be sufficient to quantitatively increase the inter-annual variability in the dates of beginning and end of the production season. Given that predicting “extreme” years with very short season of production is more difficult than predicting “average years” in terms of production season timing, and considering that the data available for model calibration covered a relatively short period of time (13 years), caution is warranted when interpreting the projected occurrence of “short seasons” in the future. More research is needed to further investigate this possibility and to assess the potential impacts on maple syrup yield.
Overall, the results show that syrup producers will be facing sap seasons starting earlier than at present which means that they must adapt by being ready to tap the sugar maple trees earlier in the season. On the other hand, the projected stability of the inter-annual variability in the beginning of the sap season, indicate that the syrup producers will not be confronted to a greater between years uncertainty with regards to the moment of tapping the trees.
S1 Table. Description of climate variables used in the construction of statistical models.
We would like to thank Jean-Pierre Bellegarde and Simon Trépanier from the “Fédération des Producteurs Acéricoles du Québec” for their support and for giving us access to their unique data base of weekly sugar maple production. Special thanks also to Anne Blondlot from Ouranos for her invaluable help in starting this project. The costs associated with this research were covered by the “Ministère des Forêts, de la Faune et des Parcs du Québec” and “Le Fond Vert du Ministère du Développement Durable, Environnement, et Parc du Québec” within the framework of the Action Plan 2006–2012 on climate change in association with Natural Resources Canada. Regarding the GCM data, we acknowledge the modeling groups, the Program for Climate Model Diagnosis and Intercomparison (PCMDI) and the WCRP's Working Group on Coupled Modelling (WGCM) for their roles in making available the WCRP CMIP3 multi-model dataset. Support of this dataset is provided by the Office of Science, U.S. Department of Energy.
Conceived and designed the experiments: DH BC LD. Performed the experiments: HP BC DH TL. Analyzed the data: HP BC TL AP IC. Wrote the paper: DH AP BC HP TL LD IC. Drafting of manuscript for publication, translation to English, and critical reviewing: AP.
- 1. Tyminski WPJ. The utility of using sugar maple tree-ring data to reconstruct maple syrup production in New York. Greensboro: University of North Carolina; 2011.
- 2. Gabriel WJ. Phenotypic selection in sugar maple for superior sap sugar production. Upper Darby, PA: Department of agriculture, Forest service, Notheastern forest experiment station, Broomall, PA, USA; 1972. 12 p.
- 3. Perkins TD, van den Berg AK. Maple Syrup–Production, Composition, Chemistry, and Sensory Characteristics. In: Taylor SL, editor. Advances in Food and Nutrition Research. 56. Elsevier, New York2009. p. 102–44.
- 4. Skinner C, DeGaetano A, Chabot B. Implications of twenty-first century climate change on Northeastern United States maple syrup production: impacts and adaptations. Climat Change. 2010;100(3–4):685–702. doi: 10.1007/s10584-009-9685-0.
- 5. Duchesne L, Houle D. Interannual and spatial variability of maple syrup yield as related to climatic factors. PeerJ. 2014;2:e428. s doi: 10.7717/peerj.428. pmid:24949244
- 6. Duchesne L, Houle D, Côté MA, Logan T. Modelling the effect of climate on maple syrup production in Québec, Canada. For Ecol Manage. 2009;258:2683–9. doi: 10.1016/j.foreco.2009.09.035
- 7. Murphy BL, Chretien AR, Brown LJ. Non-timber forest products, maple syrup and climate change. The journal of Rural and Community Development. 2012;7(3):42–64.
- 8. Kim YT, Leech RH. Effects of climatic conditions on sap flow in sugar maple. For Chron. 1985;61(4):303–7. doi: 10.5558/tfc61303-4
- 9. Marvin JW, Erickson RO. A statistical evaluation of some of the factors responsible for the flow of sap from sugar maple. Plant Physiol. 1956;31:57–61. pmid:16654837 doi: 10.1104/pp.31.1.57
- 10. Plamondon AP, Bernier P. Modélisation de la coulée de l'érable à sucre (Acer saccharum Marsh.) à partir d'éléments météorologiques. Can J For Res. 1980;10:152–7. doi: 10.1139/x80-027
- 11. Pothier D. Effets des coupes d'éclaircie et des variations climatiques interannuelles sur la production et la teneur en sucre de la sève d'une érablière. Can J For Res. 1995;25:1815–20. doi: 10.1139/x95-196
- 12. Marvin JW. Physiology of maple sapflow (MR 64): University of Vermont; 1958. 29 p.
- 13. Plamondon AP. Analyse préléminaire de quelques facteurs écologiques influençant la production de la sève de l'Acer saccharum. Nat Can (Que). 1977;104:127–34.
- 14. Marvin JW. Investigation of the sugar content and flow mechanism of maple sap (MR 62): University of Vermont; 1957. 7 p.
- 15. Logan T, Charron I, Chaumont D, Houle D. Atlas de scénarios climatiques pour la forêt québécoise: Ouranos; Direction de la recherche forestière, MRNFQ; 2011. 55 p.
- 16. Norby RJ, Heartz-Rubin JS, Verbrugge MJ. Phenological responses in maple to experimental atmospheric warming and CO2 enrichment. Glob Chang Biol. 2003;9(12):1792–802. doi: 10.1111/j.1365-2486.2003.00714.x
- 17. Akaike H. Information theory as an extension of the maximum likelyhood principle. In: Petrov BN, Csaki F, editors. Second international symposium on information theory. Akademiai Kiado, Budapest1973. p. 267–81.
- 18. Bradley E, Gong G. A leisurley look at the bootstrap, the jacknife and cross validation. Am Stat. 1983;37:36–48.
- 19. Meehl GA, Covey C, Taylor KE, Delworth T, Stouffer RJ, Latif M, et al. THE WCRP CMIP3 Multimodel Dataset: A New Era in Climate Change Research. BAMS. 2007;88(9):1383–94. doi: 10.1175/bams-88-9-1383.
- 20. Nakicenovic N, Alcamo J, Davis G, deVries B, Fenhann J, Gaffin S, et al. Emissions scenarios. Special report by Working group III of the Intergovernmental Panel on Climate Change: Cambridge University Press; 2000.
- 21. Mpelasoka FS, Chiew FHS. Influence of Rainfall Scenario Construction Methods on Runoff Projections. J Hydrometeorol. 2009;10:1168–83. doi: 10.1175/2009jhm1045.1
- 22. Hopkinson RF, McKenney DW, Milewska EJ, Hutchinson MF, Papadopol P, Vincent LA. Impact of Aligning Climatological Day on Gridding Daily Maximum–Minimum Temperature and Precipitation over Canada. JAMC. 2011;50(8):1654–65. doi: 10.1175/2011jamc2684.1.
- 23. Hutchinson MF, McKenney DW, Lawrence K, Pedlar JH, Hopkinson RF, Milewska E, et al. Development and Testing of Canada-Wide Interpolated Spatial Models of Daily Minimum–Maximum Temperature and Precipitation for 1961–2003. JAMC. 2009;48(4):725–41. doi: 10.1175/2008jamc1979.1.
- 24. Menzel A, Sparks TH, Estrella N, Koch E, Aasa A, Ahas R, et al. European phenological response to climate change matches the warming pattern. Glob Chang Biol. 2006;12(10):1969–76. doi: 10.1111/j.1365-2486.2006.01193.x.
- 25. Hawkins E, Sutton R. The Potential to Narrow Uncertainty in Regional Climate Predictions. BAMS. 2009;90(8):1095–107. doi: 10.1175/2009BAMS2607.1.
- 26. USDA NASS. Maple Syrup 2012: 2012 maple season too warm. Concord, NH: New England Field Office; 2012 June 13, 2012. 8 p.