Payments for environmental services (PES) are often viewed as a way to simultaneously improve conservation outcomes and the wellbeing of rural households who receive the payments. However, evidence for such win-win outcomes has been elusive. We add to the growing literature on conservation program impacts by using primary household survey data to evaluate the socioeconomic impacts of participation in Costa Rica’s PES program. Despite the substantial cash transfers to voluntary participants in this program, we do not detect any evidence of impacts on their wealth or self-reported well-being using a quasi-experimental design. These results are consistent with the common claim that voluntary PES do not harm participants, but they beg the question of why landowners participate if they do not benefit. Landowners in our sample voluntarily renewed their contracts after five years in the program and thus are unlikely to have underestimated their costs of participation. They apparently did not invest additional income from the program in farm inputs such as cattle or hired labor, since both decreased as a result of participation. Nor do we find evidence that participation encouraged moves off-farm. Instead, semi-structured interviews suggest that participants joined the program to secure their property rights and contribute to the public good of forest conservation. Thus, in order to understand the social impacts of PES, we need to look beyond simple economic rationales and material outcomes.
Citation: Arriagada RA, Sills EO, Ferraro PJ, Pattanayak SK (2015) Do Payments Pay Off? Evidence from Participation in Costa Rica’s PES Program. PLoS ONE 10(7): e0131544. https://doi.org/10.1371/journal.pone.0131544
Editor: Paul Adam, University of New South Wales, AUSTRALIA
Received: September 23, 2014; Accepted: June 3, 2015; Published: July 10, 2015
Copyright: © 2015 Arriagada et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by the National Science Foundation (SES-0519194) (EOS), and Fondo Nacional de Financiamiento Forestal (FONAFIFO-Costa Rica) (EOS). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Over the last two decades, payments for ecosystem services (PES) have gained prominence as a strategy to protect ecosystem services and mitigate climate change through reduced emissions from deforestation and forest degradation (REDD) . PES programs typically make financial transfers to landholders conditional on their adoption of land use practices believed to generate ecosystem services [2–4], and they are recommended when the public net benefits of those practices are much larger than the private net costs . Because the financial transfers enable landholders to capture some of the external value of the ecosystem services that they produce , PES have also been viewed as a tool to increase the welfare of participating landholders, or at least ‘do no harm’ while inducing conservation, as called for under REDD safeguards [3,7–10]. As a result, many developing countries have incorporated PES programs into their “portfolio of rural development programs and projects” .
The impacts of PES on rural development depend on both who receives payments and how recipients are affected by participation in the program. There is a large literature describing who participates in PES programs (e.g. for Costa Rica, see [12–14]), including guidance on how to reduce barriers to participation by the poor . There have been fewer studies of how recipients are affected by participation in PES, perhaps because it seems obvious that recipients would not voluntarily participate if they did not benefit from the program.
When participation in PES is truly voluntary, one can plausibly assume that participants believe they benefit from participation (particularly when they renew their contracts). Nevertheless, clarifying how exactly participants benefit and how their livelihoods are affected by participation are important empirical issues, for both welfare and conservation outcomes [16,17]. Recent reviews by  and  conclude that there is insufficient evidence about the conditions under which PES has positive socioeconomic impacts.
To help build the evidence base, we examine how landowners were affected by participation in Costa Rica’s renowned Program of Payments for Environmental Services (Programa de Pagos por Servicios Ambientales, or PSA) in the first decade of its implementation. Using household data and a quasi-experimental design, we find no impact of PSA on household wellbeing, as measured by an asset index and self-reported wellbeing. We therefore consider other possible uses of the cash income that landowners receive from PSA, including investment in farm inputs or financing a move off-farm. However, we find that participation had negative effects on two key farm inputs in this region (size of the cattle herd and probability of hiring farm labor) and no effect on the probability of living off-farm. This leads us to consider other possible reasons why landowners enrolled their forestland in PSA by revisiting lessons from case studies conducted in our study site using mixed methods to understand program participation .
Materials and Methods
PES as implemented in Costa Rica
The Costa Rican government is well-known for its conservation policies, including its large protected area network, support for private reserves, efforts to control illegal logging, and PSA . Initiated in 1997, PSA has been financed by an earmarked gasoline tax, international donors and ecosystem service buyers . Since 1997, PSA has offered several different types of contracts to landowners, including some that support reforestation and forest management, continuing previous policies of financial incentives for forest management . However, PSA is best known for offering direct payments to private landowners for forest conservation, and we estimate the impacts of signing one of those contracts.
Forest conservation contracts are intended to remunerate landowners for the ecosystem services provided by their forests, including climate change mitigation, watershed functions, biodiversity and scenic beauty . Although landowners are paid for the area of forest under contract, rather than for service flows, the law establishing PSA was framed explicitly in terms of compensation for the provision of ecosystem services. Lawmakers believed this framing made the importance of forest conservation more obvious and relevant to stakeholders cf. . Another key motivation for establishing PSA was to increase rural income, especially of small and medium size landowners [23,25].
Implementation of PSA has varied over time and across regions [8,15,21,22,19,26]. Prior to 2000, application to the program required an official cadastral map from the National Land Registry, a cartographic map indicating the location of the forest parcel proposed for PSA payment, a forest management plan, and proof of land ownership . Applications were accepted on a “first come, first served” basis. Upon acceptance, a contract was signed for a designated forest parcel, obligating the landowner to preserve that area by fencing and posting signs, preventing forest fires and hunting, and refraining from any agricultural use or wood extraction. In return, the government makes annual payments per hectare for five years, with the potential for renewal. The government also bears significant transactions costs, although it has sought to limit those by offering a uniform annual payment per hectare on all forest conservation contracts .
There is an extensive and dynamic literature about PSA, largely focused on its conservation impacts but also considering how landholders are selected and affected by participation. Most evaluations have found that PSA promotes forest conservation, although the increase in forest cover that can be attributed to the program is much less than the area under contract [4,10,27]. Legrand et al.  concluded that PSA has positive environmental impacts, but has tended to exclude small landowners. In contrast,  determined that 58% of all PSA forest conservation contracts issued between 2001 and 2005 were directed to small and medium landowners. Milder et al.  argued that PSA provides important livelihood benefits to participating landowners through both cash payments and noncash benefits such as enabling the transition to more profitable and resilient land-use systems, securing land tenure, and strengthening social capital and supportive local institutions. Consistent with this,  concluded that PSA participation accelerated farmers’ exit from agriculture in the Osa Peninsula. Several authors have claimed that participation in PSA can improve tenure security by documenting that land kept under forest is being used to produce ecosystem services, rather than being ‘idle’ and therefore legally vulnerable to squatters [13,19].
Some authors have tried to quantify the importance of the payments within the household budgets of program beneficiaries. Based on a survey of households in the Central Volcanic Cordillera region,  estimate that payments comprise about 16% of household budgets, but they also note that the percentage is smaller (5%) for landowners with small areas under PSA contracts. Based on another survey,  estimates that payments make up about 10% of household budgets. In contrast,  reports much higher percentages in the Osa region, where landowners are poorer. Most of these studies draw their conclusions from small samples of landowners who are not necessarily representative of PSA participants in a given region, e.g. oversampling land owners who derive most of their income from off-farm sources.
In sum, the literature suggests a number of ways that participation in PSA can affect landowners, but there have been few attempts to quantify the causal impacts. In particular, no previous studies have employed a rigorous quasi-experimental design to address the fundamental evaluation question of what would have happened to participants if they had not signed a PSA contract?
In most landscapes undergoing deforestation, only a fraction of the forests will be cleared at any given time, reflecting the underlying heterogeneity in returns from deforestation. Fig 1 represents this heterogeneity by arranging all forest lands from least to highest returns to deforestation, or equivalently opportunity costs of conservation. Forested lands with the lowest returns are the least likely to be deforested and most likely to be placed under contract in a voluntary PES program with uniform payments [2,10,33–36]. Some payments thus inevitably go to contracts to conserve forests that would have been conserved without payments. Evidence for this phenomenon can be found in our study sample. Sample farms with PSA contracts are an average of 165 ha in total, with 76 ha under contract. Arriagada et al.  estimate that these contracts induced, on average, about 10 ha of additional forest cover during the first eight years of the program. PSA was clearly making payments on forested hectares that would not have been converted without payments. This implies that participants earn windfall gains, shown as the area of surplus in Fig 1.
These potential windfall gains can be reduced by contractual requirements of the program (e.g. developing a certified forest management plan, posting and clearing the boundaries of the forested parcel), which effectively reduce the net benefit per hectare of participation. However, with the additional (plausible) assumption that the supply curve (marginal cost curve) of land for PSA contracts is upward sloping, participants should earn a surplus from most hectares enrolled in any voluntary, uniform-payment PES program . These “excess payments” may be desirable as part of a rural development strategy, or as a political strategy to reduce opposition to land-use restrictions. Regardless, they represent a real, risk-free transfer to landowners who participate in the program. Participants may use these transfers for a variety of purposes, including to increase current consumption or to invest in durable consumer goods.
The likelihood of such transfers explains why PES programs are widely expected to improve the wellbeing of program participants. PES makes most sense as a policy for both conservation and rural development if it induces investment in household assets, such as durable consumer goods, that will increase well-being over the long-run. However, for any given household and any given parcel, PES may or may not be enough to compensate for lost income and contract compliance costs. If potential participants have imperfect information or face external pressures to participate, the result could be an increase, decrease, or no net change in household income. Further, any increase in income could be allocated differently by different households, with implications for their well-being and land use. For example, participants could use payments to finance (i) off-farm activities that reduce deforestation pressure cf. [17,31] or (ii) purchase of farm inputs such as livestock and hired labor, consistent with slippage of deforestation to land not under contract cf. . In addition to the implications for forest conservation, using payments for these types of investments may mean no detectable short-to-medium run impacts on household well-being.
Sampling and data collection
Using household-level data collected in 2005 (S1 File), we evaluated the impacts of PSA contracts in three (out of 4) cantons in the region of Sarapiquí located in northeastern Costa Rica: Sarapiquí, Guacimo, and Pococí. These are among the poorest cantons in Costa Rica, ranked 65th (Guacimo), 68th (Sarapiquí), and 69th (Pococí) out of 81 cantons in Costa Rica . Focusing on a particular region made it feasible to directly survey landowners rather than rely on secondary data. Sarapiquí is an ideal region for the study not only because of its economic development needs, but also because of the presence of the intermediary organization FUNDECOR. FUNDECOR has been actively involved in the design of the conservation and development strategy for the entire Cordillera Volcánica Central region , and maintains good records on participants, including farm locations.
Our unit of analysis is the household. Table 1 lists the outcomes that we consider, starting with changes in a standard asset index cf. [40,41]. Of course, participants could use the cash income from PSA to meet immediate consumption needs, rather than investing in assets. We expect both of these to be reflected in perceived changes in well-being. Alternatively, payments could be used to finance a move off-farm or to purchase farm inputs, so we also estimate impacts on the probability of living off-farm and on two key farm inputs in this region: cattle and hired labor. We note that these different potential uses of the payments have different implications for land use. For example, the conservation goals of the program could be furthered by households moving off-farm cf.  or undermined by expansion of the cattle herd.
Note: Groups are different at the 95% significance level whenever the t-stat is greater than 1.96 or the normalized difference is greater than 0.400 (Imbens and Wooldridge, 2009).
Changes in wellbeing: Asset ownership is frequently used to assess the welfare status of rural households in developing countries . In particular, when income and expenditure data are not available, household ownership of consumer durables may be employed to describe socio-economic wellbeing. Ownership of each asset can be examined separately or used to construct indices with either equal or variable weights on ownership of the component assets . In addition to measuring asset ownership, we also directly ask households about their subjective perceptions of changes in their quality of life. The specific variables are as follows:
- Changes in an asset index: the difference in household assets owned in 2005 and 1996 (in Spanish: de la siguiente lista que le voy a mencionar, ¿cuáles de ellas tiene usted actualmente que todavía funcionan? ¿Y cuales tenía en 1996?). Based on the responses, an asset index was calculated as the first principal component of indicators for ownership of different asset classes (i.e. car, motorcycle, bicycle, landline phone, mobile phone, television, microwave, refrigerator or radio).
- Changes in asset count: the difference in the sum (count) of the categories of assets owned by the family in 2005 and 1996.
- Changes in quality of life: self-reported change in the quality of life between 2005 and 1996 (better, same, or worse; in Spanish: pensando en la calidad de vida global de su familia, comparado a 1996, ¿usted cree que está mejor, igual o peor ahora?).
Changes in livelihoods: Sierra and Russman  suggested that one pathway for PSA to impact forest cover is by enabling farmers to move off their farms. On the other hand, there have been concerns raised that PES could generate leakage by allowing farmers to intensify production on farm parcels not under contract . In Sarapiqui, farmers could intensify production by investing in either cattle ranching or crops. Thus we measure:
- Residence: the difference in residence (whether live off-farm) in 2005 and 1996 (in Spanish: ¿usted vive en la finca actualmente?¿usted vivía en la finca en el año 1996?).
- Changes in cattle owned: the difference between the numbers of cattle owned in 2005 and 1996.
- Changes in hired labor: the difference in whether hired non-family labor in 2005 and 1996.
Treatment and control groups.
The sample of PSA participants comprises farmers who signed 5-year contracts for forest conservation during the first two years of the PSA and subsequently renewed their contracts. This sample gives us the longest possible period to assess impacts based on a survey conducted in 2005. Contracts could be established on properties of up to 300 ha. FUNDECOR served as an intermediary for 70 forest conservation contracts that were signed in 1997 or 1998 and were still in force in 2005. From that population of contracts, 50 were randomly selected. On average, each participating household received a PSA cash payment of over $3000 per year (forest conservation payment of $43/ha times average of 76 ha of forest land under PSA contract).
We obtained a similar sample of 150 farms without PSA contracts, in order to form a comparison group. To reduce the potential for selection bias in our estimators of impacts, we selected nearby farms using three methods: (1) geographic rule for interviewers to identify immediate neighbors of participants; (2) random sample stratified by district of participants, using the National Land Registry as the sampling frame; and (3) random sample stratified by buffer rings around each PSA property, using the National Land Registry to establish a sampling frame of all farms located in a buffer ring with inner radius of 1,920 meters and outer radius of 3,840 meters [27,45].
Landowners in the comparison group were screened out if they had since signed a PSA forest conservation contract or if they had been ineligible to receive a PSA forest conservation contract in 1997 (e.g., due to property size, tenure status, or lack of forest). Specifically, we excluded parcels in the National Registry that were smaller than 5 ha (the minimum contract size among our sample of participants for those years), parcels listed in FONAFIFO’s records as having PSA conservation contracts sometime between 1997 and 2005, and parcels owned by the state and large companies ineligible for PSA. For the district and buffer samples, three landowners were selected at random for each participant. If the interviewer failed to find the first landowner after three documented attempts or if the landowner was ineligible for a PSA contract, the next landowner on the list was sought until an interview was obtained (except for a few cases in the district stratified sample in which none of the three landowners could be located). Our final control group comprised 51 immediate neighbors, 58 landowners with properties located in buffers around each PSA property, and 43 landowners in the sample stratified by districts. Table 1 and the “unmatched” rows of Table 2 present summary statistics for the variables used in this analysis.
Note: The seventh and eighth columns present three measures of the differences in the covariate distributions between PSA and non-PSA farms. If matching is effective, all of these measures should move dramatically toward zero (Ho et al., 2007).
A key problem plaguing observational studies is that confounding factors may bias the estimates of treatment effects . Confounding factors affect both program participation and program outcomes. Previous research in Costa Rica has determined that participation in PSA is influenced by factors such as farm size, human capital, and household socio-economic status [13,14,28]. Similar factors are associated with the probability of participation in Sarapiquí . Specifically, FUNDECOR gave priority to areas based on watershed protection and recharge, existing protected areas, land use capacity, and biological corridors .
We designed the survey instrument to obtain data on these factors that we expected to explain both PSA participation and program outcomes. We obtained input from expert review, reviews of FUNDECOR and FONAFIFO records, pre-tests, and most critically, qualitative case studies . The final survey instrument elicited information about landowner socio-economic characteristics (e.g. age, education, city of origin, current residence, assets, household composition), property (e.g. size, location, soil quality, slope) and land management (e.g. land titling, previous farming experience, participation in previous forest programs, hired and family labor, area under different land uses, livestock, fencing). The survey protocol, including sampling methods, survey instrument, and oral informed consent procedure, was approved by administrative review of the IRB at North Carolina State University (#151-05-6). Survey participants also provided their verbal informed consent to participate in this study.
Interviewers asked about current conditions and conditions in 1996. We selected 1996 because it was the year prior to the launch of the PSA program and memorable to respondents due to its association with Hurricane Cesar and the World Cup in Mexico. While recall data are subject to biases , they do provide useful information on prior conditions , allowing us to net out unobservable differences across participants and non-participants. We also estimated impact on asset index in 2005, as a robustness check, and found same results regardless of whether we consider 2005 outcome, or change in outcome between 2005 and 1996.
To address incomplete responses, we employed a multiple multivariate imputation process [48–50]. Multiple imputation uses the available information on observations that contain missing values, which can lead to smaller confidence intervals. The imputation process does not depend on imputing the "right" values of the missing variables for individual observations, but rather on correctly modeling their distribution conditional on the observed data. Imputation was done in STATA (v12) using the “switching regression” method of multiple multivariate imputation and averaging across fifty imputed copies of the complete data set. The summary statistics presented in Tables 1 and 2 incorporate these imputed values.
We assess the impacts of PSA on several indicators of wellbeing and livelihoods using three strategies: (a) compare means, (b) conduct statistical matching, and (c) adjust for bias remaining after matching with multivariate regressions. These progressively eliminate any potential bias from confounders. They are described in detail after a brief summary of how the outcome indicators are constructed.
We follow established practice e.g. [40,41,51–53] to construct measures of changes in quality of life using asset ownership. Specifically, we use both the count and the first principal component of reported ownership of a car, motorcycle, bicycle, landline telephone, mobile phone, television, microwave, refrigerator and radio. We follow  by pooling the data for 1996 and 2005 before applying PCA to generate weights for the asset index. We use the polychoric PCA procedure introduced by  for discrete data. The first principal component, which captures the most variance in asset ownership across households, is used to construct the asset index: factor scores from the first component are used as weights for each asset, which are then combined into index scores for 1996 and 2005 cf. .
While assets are a commonly used measure of socioeconomic status, they may not be very sensitive to changes in farm income if households choose to adjust current consumption first. In our case, more than a third of PSA participants reported that they used the payments from PSA for consumption. To capture wellbeing changes not reflected in assets, we asked respondents to assess how their quality of life had changed since 1996.
To assess whether PSA payments influenced livelihood strategies, we also examined the proportion of landowners living off-farm before and after the program. PSA could encourage households to move off-farm, by providing a secure source of income during the transition and by limiting production activities on the farm. Alternatively, participants could invest in farm production activities, and in fact, nearly a quarter of participants in our survey said that they used the payments to invest in their farms. We focused on two indicators that respondents could reasonably be expected to recall from nine years prior to the survey: whether they hired workers and the size of their cattle herd.
First, we compare changes among PSA recipients (treated) with changes among a matched sample of landowners not participating in PSA (controls). The key identification assumption is that mean trend among the controls is equal to the (unobserved) mean trend among the treated in the absence of the PSA program. This is a plausible assumption because we sampled farms eligible for PSA based on geographic rules that ensured they faced similar biophysical and market conditions (a form of “pre-matching”). Nonetheless, there could still be systematic differences in characteristics correlated with both PSA participation and changes over time in livelihoods and welfare.
Second, to eliminate potential confounding, we employ statistical matching procedures, an increasingly common strategy in the impact evaluation literature [55,56]. That is, we identify a matched control group of non-participants that are observationally similar to the treatment group of PSA participants in terms of characteristics that not only drive PSA participation, but also affect program outcomes. The control group provides the basis for estimating livelihood and welfare without the PSA program (the counterfactual), while the treatment group reflects changes in livelihood and welfare due to the policy change. We followed  in matching on 1992 forest cover, farm size, participation in past forestry programs, distance to forestry office, percent of farm with steep slopes, whether their forest was fenced, and forest cover change 1986–1992. Further, we match on the baseline (1996) levels of all of the welfare outcomes: asset index, simple sum of assets, residence on or off farm, head of cattle, and whether hired labor to work on the farm.
Third, matching often does not eliminate all differences in the distribution of covariates among the treated and control observations. To reduce any remaining bias, we estimate multivariate regressions using the matched data. Because the covariate distributions are likely to be similar in the matched sample, we do not expect to find statistically significant coefficients on any covariates other than participation in PSA, and we do not use the results to extrapolate out of sample. This strategy of post-matching regression adjustment typically generates treatment effects estimates that are more accurate and more robust to misspecification than parametric regression alone [55,56].
Despite pre-matching by selecting non-participants in close proximity to participants in the PSA program, we find differences between the two sub-samples in 1996, as shown in the unmatched rows of Table 2. At the 5% significance level, landowners with PSA contracts had more forest (based on interpretation of aerial photographs from 1992), more steeply sloped land, and fewer cattle. In 1996, they were also more likely to have participated in other forest incentive programs, less likely to have fenced their forest, more likely to hire farm workers, and less likely to live on their farms. Turning to changes in welfare between 1996 and 2005, we find no statistically significant differences across participants and non-participants in PSA (Table 1). One possible explanation is that the differences between participants and non-participants (Table 2) mask any welfare gains from participation. Thus, to estimate the causal effect of participation, we need to control for these differences.
Estimation results from our three ways of measuring the impacts of PSA on welfare are presented in Table 3 and Fig 2. These are the differences in means in the full sample (repeated from Table 1), the differences in means in the matched sample, and the marginal effect estimated in a multivariate regression on the asset index and count (using OLS) and the change in quality of life (using ordered logit) in the matched sample. We consider the post-matching regression results to be the most reliable, because matching greatly reduces differences in the distributions of all covariates except the baseline levels of the asset index and count, as shown by the differences in the means, the raw eQQ, and the mean eCDF in Table 2 . However, differences in the asset index and count are not eliminated by matching, making it important to control for these in post-matching regression. These results are summarized in Fig 1, showing that PSA has no causal impact on any of the welfare measures.
Robust standard errors in parenthesis.
This raises the question of whether landowners instead use the cash payments to shift livelihoods in ways that either support or undermine the forest conservation goals of PSA. Therefore, we estimate the impacts of PSA on the probability that the landowner moves off the farm, the probability that the landowner starts to hire farm labor, and the number of cattle on the farm. The results from post-matching regression are presented in Table 4 and Fig 3. Participation in PSA did not affect the probability of moving off-farm and reduced both the number of cattle and the probability of hiring farm labor. In particular, the marginal effect on cattle is large (relative to average herd sizes) and important because of the role of cattle in deforestation and forest degradation . While this is consistent with the positive impact on forest cover found by , it does not suggest an increase in welfare and therefore still begs the question of why landowners voluntarily participate in the program.
Covariates in all regressions are all variables used in matching, including baseline 1996 measures of outcomes.
Discussion and Conclusions
Despite the PSA program reducing two key on-farm inputs (cattle and hired labor) and transferring a large amount of cash to each household, we do not detect any improvements in household assets or the probability of self-reported improvement in quality of life. There are two caveats on these findings. First, our sample design may not have sufficient statistical power to detect small changes in household wellbeing, especially those measured with binary indicators, although matching is believed to increase the minimum detectable effect size. Second, while our measure of forest cover (including mature and secondary forest) can change within just a few years over large portions of the enrolled farms , socio-economic outcomes such as wealth and wellbeing are more likely to change slowly and incrementally. Setting aside these caveats, our results are consistent with the common claim that voluntary PES can induce landowners to supply environmental benefits while doing no harm to their households. However, the Costa Rican PES also does not appear to have benefited participants in any of the dimensions of wellbeing measured in our survey.
Therefore, we must consider why farmers would participate in a voluntary program that does not offer any welfare benefits. Porras et al.  show that the costs of enrolling and complying with the program can be significant, and thus one possible explanation is that landowners underestimated those costs. However, we reject this explanation because our sample of participants all re-enrolled in the program after their first five-year contracts expired and thus are likely to have understood the costs. Furthermore, in our study region, FUNDECOR assisted landowners with enrollment, preparation and execution of forest management plans in exchange for a small, known and fixed proportion of the payments. Moreover, most participants (70%) reported in the household survey that they were satisfied with the program and would recommend it to their neighbors. In fact, the program was experiencing excess demand from landowners during our study period.
The more plausible explanation is that the wealth and self-report wellbeing indicators do not measure the full suite of program benefits. For example,  found that participation in the program enables households to move off-farm. We do not find any evidence of this in our study region. Thus, we return to some key findings in , who examined program participation using a mixed methods approach that combined in-depth case studies, household surveys, expert interviews, and literature reviews. In that study, participants reported joining the program to secure their property rights and to contribute to forest conservation. Interviews with forestry officials yielded similar claims: landowners with higher levels of environmental consciousness tended to enroll in the program and owners of large properties enrolled in PSA “to protect” their land from aggressive “land development” policies by the Costa Rican Institute of Agricultural Development (Instituto de Desarrollo Agrario, IDA). Specifically, key informants reported that during our study period, IDA officials believed that forests were “useless lands” and so should be available for seizure and agricultural development by farmers. Our survey also elicited motivations for participation in PSA. More than 50% of participants in the sample mentioned environmental protection as an important reason for enrolling in the program.
In sum, we respond to recent calls for more careful evaluation of conservation policies e.g. [58,59] making the following contributions to a slow-growing empirical literature on the impacts of conservation programs. First, in contrast to impact evaluations focused on deforestation, we focus on social outcomes that are also likely to explain program participation and conservation outcomes. Although PES is often viewed primarily as an environmental program, the potential for high spatial overlap of biological diversity and poor vulnerable populations across the tropics [60,61] has led to PES being widely discussed as a mechanism for promoting rural development [62,63]. However, there are relatively few empirical studies of the socio-economic impacts of PES. Second, unlike most evaluations relying on secondary and remotely sensed data, which could be subject to problems of ecological fallacy if used to describe farm households, we take a microeconomics perspective by conducting and analyzing data from a primary household survey. Third, the analyses and interpretations reported in this paper draw on and complement the findings from companion papers. For example, our estimates of reductions in farm investments reveal potential mechanisms through which PES could induce greater forest cover, thus providing more confidence in a previous claim that PES increased forest cover on participating farms . Similarly, we find that explaining the continued participation by farmers in PES (despite no detectable improvements in assets and wellbeing) requires looking beyond simple economic rationales and material outcomes. Combined with previous qualitative case studies, our survey results suggest that farmers participated in order to gain recognition of their conservation efforts, which both made them feel more secure about their land tenure and gave them a “warm glow” from conserving forests .
Thus, we find that the Costa Rican PES program “does no harm” in terms of traditional measures of welfare, such as asset indices, and may deliver less tangible benefits that require researchers to look beyond simple economic rationales and material outcomes in order to understand the social impacts of nature conservation.
Conceived and designed the experiments: RAA EOS PJF SKP. Performed the experiments: RAA. Analyzed the data: RAA EOS PJF SKP. Contributed reagents/materials/analysis tools: RAA EOS PJF SKP. Wrote the paper: RAA EOS PJF SKP.
- 1. Pattanayak SK, Wunder S, Ferraro PJ. Show me the money: do payments supply environmental services in developing countries? Rev Environ Econ Policy. 2010;4: 254–274.
- 2. Wunder S. The efficiency of payments for environmental services in tropical conservation. Conserv Biol. 2007;21: 48–58. pmid:17298510
- 3. Engel S, Pagiola S, Wunder S. Designing payments for environmental services in theory and practice: An overview of the issues. Ecol Econ. 2008;65: 663–674.
- 4. Persson UM, Alpízar F. Conditional cash transfers and payments for environmental services—A conceptual framework for explaining and judging differences in outcomes. World Dev. 2013;43: 124–137.
- 5. Pannell DJ. Public benefits, private benefits, and policy mechanism choice for land-use change for environmental benefits. Land Econ. 2008;84: 225–240.
- 6. Grieg-Gran M, Porras I, Wunder S. How can market mechanisms for forest environmental services help the poor? Preliminary lessons from Latin America. World Dev. 2005;33: 1511–1527.
- 7. Zilberman D, Lipper L, Mccarthy N. When could payments for environmental services benefit the poor? Environ Dev Econ. 2008;13: 255–278.
- 8. Zhang W, Pagiola S. Assessing the potential for synergies in the implementation of payments for environmental services programmes: an empirical analysis of Costa Rica. Environ Conserv. 2011;38: 406–416.
- 9. Larigauderie A, Prieur-Richard A-H, Mace GM, Lonsdale M, Mooney H, Brussaard L, et al. Biodiversity and ecosystem services science for a sustainable planet: the DIVERSITAS vision for 2012–20. Curr Opin Environ Sustain. 2012;4: 101–105. pmid:25104977
- 10. Robalino J, Pfaff A. Ecopayments and deforestation in Costa Rica : a nationwide analysis of PSA’s initial years. Land Econ. 2013;89: 432–448.
- 11. Muradian R, Corbera E, Pascual U, Kosoy N, May PH. Reconciling theory and practice: An alternative conceptual framework for understanding payments for environmental services. Ecol Econ. 2010;69: 1202–1208.
- 12. Ortiz E. Efectividad del programa de pago de servicios ambientales por protección del bosque (PSA-Protección) como instrumento para mejorar la calidad de vida de los propietarios de bosque en zonas rurales. Kurú Rev For. 2004;1: 1–11.
- 13. Miranda M, Porras IT, Moreno ML. The social impacts of payments for environmental services in Costa Rica. Report International Institute for Environment and Development. London; 2003. 75pp.
- 14. Zbinden S, Lee DR. Paying for environmental services: An analysis of participation in Costa Rica’s PSA program. World Dev. 2005;33: 255–272.
- 15. Pagiola S. Payments for environmental services in Costa Rica. Ecol Econ. 2008;65: 712–724.
- 16. Cole RJ. Social and environmental impacts of payments for environmental services for agroforestry on small-scale farms in southern Costa Rica. Int J Sustain Dev World Ecol. 2010;17: 208–216.
- 17. Uchida E, Rozelle S, Xu J. Conservation payments, liquidity constraints, and off-farm labor: impact of the Grain-for-Green Program on rural households in China. Am J Agric Econ. 2009;91: 70–86.
- 18. Samii C, Lisiecki M, Kulkarni P, Paler L, Chavis L. Effects of payments for environmental services and decentralized forest management on deforestation and poverty in low and middle income countries: a systematic review. Campbell Systematic Reviews: 11. New York, NY; 2014. 91pp.
- 19. Arriagada RA, Sills EO, Pattanayak SK, Ferraro PJ. Combining qualitative and quantitative methods to evaluate participation in Costa Rica’s program of payments for environmental services. J Sustain For. 2009;28: 343–367.
- 20. Snider AG, Pattanayak SK, Sills EO, Schuler JL. Policy innovations for private forest management and conservation in Costa Rica. J Sustain For. 2003;101: 18–23.
- 21. Blackman A, Woodward RT. User financing in a national payments for environmental services program: Costa Rican hydropower. Ecol Econ. 2010;69: 1626–1638.
- 22. Daniels AE, Bagstad K, Esposito V, Moulaert A, Rodriguez CM. Understanding the impacts of Costa Rica’s PES: Are we asking the right questions? Ecol Econ. 2010;69: 2116–2126.
- 23. Legrand T, Froger G, Le Coq J-F. Institutional performance of Payments for Environmental Services: An analysis of the Costa Rican Program. For Policy Econ. 2013;37: 115–123.
- 24. Mainka SA, McNeely JA, Jackson WJ. Depending on nature: ecosystem services for human livelihood. Environment. 2008;50: 42–55.
- 25. Locatelli B, Rojas V, Salinas Z. Impacts of payments for environmental services on local development in northern Costa Rica: A fuzzy multi-criteria analysis. For Policy Econ. 2008;10: 275–285.
- 26. Porras I, Barton DN, Chacón-Cascante A, Miranda M. Learning from 20 years of Payments for Ecosystem Services in Costa Rica. Report Internation Institutefor Environment and Development. London; 2013. 76pp.
- 27. Arriagada RA, Ferraro PJ, Sills EO, Pattanayak SK, Cordero-sancho S. Do payments for environmental services affect forest cover ? A farm-level evaluation from Costa Rica. Land Econ. 2012;88: 382–399.
- 28. Sánchez-Azofeifa GA, Pfaff A, Robalino JA, Boomhower JP. Costa Rica’s payment for environmental services program: intention, implementation, and impact. Conserv Biol. 2007;21: 1165–73. pmid:17883482
- 29. Hartshorn G, Ferraro P, Spergel B. Evaluation of the World Bank—GEF Ecomarkets Project in Costa Rica. Report prepared for the World Bank. North Carolina State University Raleigh, NC. 2005. 27pp.
- 30. Milder JC, Scherr SJ, Bracer C. Trends and future potential of payment for ecosystem services to alleviate rural poverty in developing countries. Ecol Soc. 2010;15: 1–19.
- 31. Sierra R, Russman E. On the efficiency of environmental service payments: A forest conservation assessment in the Osa Peninsula, Costa Rica. Ecol Econ. 2006;59: 131–141.
- 32. Muñoz Calvo R. Efectos del programa por servicios ambientales en las condiciones de vida de los campesinos de la Península de Osa. Master Thesis Universidad de Costa Rica. 2004. 300pp.
- 33. Ferraro PJ, Simpson RD. The cost-effectiveness of conservation payments. Land Econ. 2002;78: 339–353.
- 34. Robalino J. Land conservation policies and income distribution: who bears the burden of our environmental efforts? Environ Dev Econ. 2007;12: 521.
- 35. Pfaff A, Robalino J. Protecting forests, biodiversity, and the climate: Predicting policy impact to improve policy choice. Oxford Rev Econ Policy. 2012;28: 164–179.
- 36. Ferraro PJ. Asymmetric information and contract design for payments for environmental services. Ecol Econ. 2008;65: 810–821.
- 37. Alix-Garcia JM, Shapiro EN, Sims KRE. Forest conservation and slippage: evidence from Mexico’s national payments for ecosystem services program. Land Econ. 2012;88: 613–638.
- 38. Abarca P, Bonilla C, Miranda B, Ortega W, Saenz J, Ureña H, et al. Indice de desarrollo social 2007. Report Instituto Nacional de Estadísticas, Costa Rica. San José; 2007. 143pp.
- 39. Ortíz E, Lewandowski A, Castañeda F, Tattenbach F, Herrera C, Umaña R. Informe de avance estrategia global Area de Conservación Cordillera Volcánica Central. Report FUNDECOR. San José; 1992. 65pp.
- 40. Filmer D, Pritchett LH. Estimating wealth effects without data-or tears: an applications to educational enrollments in states of India. Demography. 2001;38: 115–132. pmid:11227840
- 41. Sahn D, Stifel D. Exploring alternative measures of welfare in the absence of expenditure data. Rev Income Wealth. 2003;49: 463–489.
- 42. Mullan K, Sills E, Bauch S. The reliability of retrospective data on asset ownership as a measure of past household wealth. Field methods. 2014;26: 223–238.
- 43. Kolenikov S, Angeles G. Socioeconomic status measurement with discrete proxy variables: is principal component analysis a reliable answer. Rev Income Wealth. 2009;55: 128–165.
- 44. Robalino J, Pfaff A. Contagious development: Neighbor interactions in deforestation. J Dev Econ. 2012;97: 427–436.
- 45. Arriagada RA. Private provision of public goods: applying matching methods to evaluate payments for ecosystem services in Costa Rica. PhD Tesis North Carolina State University.Raleigh, NC. 2008. 268pp.
- 46. Baser O. Too much ado about propensity score models? Comparing methods of propensity score matching. Value Heal. 2006;9: 377–385.
- 47. Pagiola S, Rios AR, Arcenas A. Poor household participation in payments for environmental services: Lessons from the Silvopastoral Project in Quindío, Colombia. Environ Resour Econ. 2010;47: 371–394.
- 48. Rubin DB. Multiple imputation for nonresponse in surveys. New York, NY: John Wiley and Sons; 1987.
- 49. Van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999;18: 681–94. Available: http://www.ncbi.nlm.nih.gov/pubmed/10204197 pmid:10204197
- 50. Royston P, White IR. Multiple imputation by chained equations (MICE): Implementation in Stata. J Stat Softw. 2011;45: 1–20.
- 51. Montgomery MR, Gragnolati M, Burke KA, Paredes E. Measuring living standards with proxy variables. Demography. 2000;37: 155–174. pmid:10836174
- 52. Andam KS, Ferraro PJ, Sims KRE, Healy A, Holland MB. Protected areas reduced poverty in Costa Rica and Thailand. Proc Natl Acad Sci U S A. 2010;107: 9996–10001. /-/DCSupplemental.www.pnas.org/cgi/doi/10.1073/pnas.0914177107 pmid:20498058
- 53. Weber JG, Sills EO, Bauch S, Pattanayak SK. Do ICDPs Work? An Empirical Evaluation of Forest-Based Microenterprises in the Brazilian Amazon. Land Econ. 2011;87: 661–681.
- 54. Bauch SC, Sills EO, Pattanayak SK. Have we managed to integrate conservation and development? ICDP impacts in the Brazilian Amazon. World Dev. 2014;xx.
- 55. Ho DE, Imai K, King G, Stuart ES. Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Polit Anal. 2007;15: 199–236.
- 56. Imbens GW, Wooldridge JM. Recent developments in the econometrics of program evaluation. J Econ Lit. 2009;47: 5–86.
- 57. McGinley K, Finegan B. The ecological sustainability of tropical forest management: evaluation of the national forest management standards of Costa Rica and Nicaragua, with emphasis on the need for adaptive management. For Policy Econ. 2003;5: 421–431.
- 58. Ferraro PJ, Lawlor K, Mullan KL, Pattanayak SK. Forest figures: Ecosystem services valuation and policy evaluation in developing countries. Rev Environ Econ Policy. 2011;6: 20–44.
- 59. Miteva D, Pattanayak SK, Ferraro PJ. Evaluation of biodiversity policy instruments: what works and what doesn’t? Oxford Rev Econ Policy. 2012;28: 69–92.
- 60. Fisher B, Christopher T. Poverty and biodiversity: Measuring the overlap of human poverty and the biodiversity hotspots. Ecol Econ. 2007;62: 93–101.
- 61. Sunderlin WD, Dewi S, Puntodewo A, Müller D, Angelsen A, Epprecht M. Why forests are important for global poverty alleviation : a spatial explanation. Ecol Soc. 2008;13: 1–21.
- 62. Ingram JC, Wilkie D, Clements T, McNab RB, Nelson F, Baur EH, et al. Evidence of Payments for Ecosystem Services as a mechanism for supporting biodiversity conservation and rural livelihoods. Ecosyst Serv. 2014;7: 10–21.
- 63. Greiner R, Stanley O. More than money for conservation: Exploring social co-benefits from PES schemes. Land use policy. 2013;31: 4–10.
- 64. Imbens GW. Better LATE Than Nothing: Some comments on Deaton (2009) and Heckman and Urzua (2009). J Econ Lit. 2010;48: 399–423.