Figures
Abstract
So far many optimization models based on Nash Bargaining Theory associated with reservoir operation have been developed. Most of them have aimed to provide practical and efficient solutions for water allocation in order to alleviate conflicts among water users. These models can be discussed from two viewpoints: (i) having a discrete nature; and (ii) working on an annual basis. Although discrete dynamic game models provide appropriate reservoir operator policies, their discretization of variables increases the run time and causes dimensionality problems. In this study, two monthly based non-discrete optimization models based on the Nash Bargaining Solution are developed for a reservoir system. In the first model, based on constrained state formulation, the first and second moments (mean and variance) of the state variable (water level in the reservoir) is calculated. Using moment equations as the constraint, the long-term utility of the reservoir manager and water users are optimized. The second model is a dynamic approach structured based on continuous state Markov decision models. The corresponding solution based on the collocation method is structured for a reservoir system. In this model, the reward function is defined based on the Nash Bargaining Solution. Indeed, it is used to yield equilibrium in every proper sub-game, thereby satisfying the Markov perfect equilibrium. Both approaches are applicable for water allocation in arid and semi-arid regions. A case study was carried out at the Zayandeh-Rud river basin located in central Iran to identify the effectiveness of the presented methods. The results are compared with the results of an annual form of dynamic game, a classical stochastic dynamic programming model (e.g. Bayesian Stochastic Dynamic Programming model, BSDP), and a discrete stochastic dynamic game model (PSDNG). By comparing the results of alternative methods, it is shown that both models are capable of tackling conflict issues in water allocation in situations of water scarcity properly. Also, comparing the annual dynamic game models, the presented models result in superior results in practice. Furthermore, unlike discrete dynamic game models, the presented models can significantly reduce the runtime thereby avoiding dimensionality problems.
Citation: Homayounfar M, Zomorodian M, Martinez CJ, Lai SH (2015) Two Monthly Continuous Dynamic Model Based on Nash Bargaining Theory for Conflict Resolution in Reservoir System. PLoS ONE 10(12): e0143198. https://doi.org/10.1371/journal.pone.0143198
Editor: Yong Deng, Southwest University, CHINA
Received: July 3, 2015; Accepted: November 1, 2015; Published: December 7, 2015
Copyright: © 2015 Homayounfar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The first author is grateful to the Government of Malaysia and the University of Malaya (UM) for financial support of the first author through the Bright Spark Fellowship Scheme. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Inefficiency of classical conflict resolution techniques [1–6] in dealing with conflicting issues in water allocation among different users have drawn attention to utilizing innovative alternatives for resolving conflict. A number of approaches such as Nonlinear Programing [7, 8], Compromise Programming [9–11], Analytic Hierarchy Process [12, 13] and Fuzzy Set Analysis [14–16] have been utilized to deal with conflict situations.
Game theory as another approach for conflict resolution has been broadly applied in water resource management [17–25]. The applicability of Game Theory to water resources management and conflict resolution was reviewed by Carraro et al. [26] and Madani [27] through a series of non-cooperative water resource games. Similar studies have been conducted by Parrachino et al. [28] and Zara et al. [29], evaluating the application of cooperative game theory to water resources and environmental issues. In another study by Madani and Dinar [30], a number of cooperative game theoretic solutions (i.e. the core, Nash-Harsanyi, Shapley, and nucleolus) are formulated and applied through a numerical groundwater example. Considering applied cooperative solutions, they evaluate how common pool resources users share the gains obtained from cooperation efficiently and fairly.
In the context of game theory, Nash bargaining is a typical game introduced by Nash [31] applicable to model conflict situations. Subsequently, a Nash Bargaining Solution (NBS) is a solution (i.e. Pareto efficient solution) to this game. Harsanyi [32] developed an equilibrium solution for an n-person bargaining problem based on an initial Nash equilibrium solution for the two-player case. According to Thomson [33], Nash’s solution is generally accepted as the typical framework for bargaining problems. So far, many researchers have utilized NBS to deal with conflict situations in different water-related problems. In the area of water quality NBS has been utilized in a number of studies [34–36]. Regarding optimal reservoir management also NBS has been used for conflict resolution [37–40]. Karamouz et al. [3] used Nash product for formulation of the objective function of a reservoir water allocation model and used resiliency and vulnerability indices to evaluate the performance of optimization algorithms. Results showed the significance of the application of conflict resolution models, such as the Nash theory in the regional scale especially in complicated water supply systems.
A number of discrete dynamic models based on Nash Bargaining Theory have been extended to provide an original way to overcome problems by taking into account the interaction between different objectives, behaviors and preferences of water users. Kerachian and Karamouz [35] created a stochastic dynamic model for conflict resolution in reservoirs and river basins. The objective function was defined based on the expected value of the Nash product. Another attempt based on the same approach was conducted by Ganji et al. [17, 18, 41] to develop a discrete stochastic dynamic model to simulate the competition between water users downstream of a reservoir. All these models are powerful in dealing with a dynamic game problem but suffer the setback of high computational effort in getting appropriate solutions [42]. Additionally, in the same context, most of the recent continuous approaches are known as powerful tools for generating operating policies. However, many of the developed models have been structured annually. Compared to the models which work on a monthly basis, this can lead to inefficiencies in reservoir operation.
In this study two continuous dynamic optimization models are developed using Nash bargaining theory. The principal aim is to introduce monthly continuous dynamic approaches applicable to single reservoir systems in order to maximize long-term utility associated with reservoir management and water users. Due to the continuous form of the state variable, these approaches will not suffer from the curse of dimensionality. Also they result in practical operating policies compared to annual dynamic structures. The first model employing constrained state formulation introduced previously by Fletcher and Ponnambalam, [43], provides an optimization approach for water allocation in arid and semi-arid regions. The objective function is structured based on NBS and optimized subject to the statistical moments (The first and second moments) of the storage state variable of a reservoir system. The second model is a dynamic approach structured based on continuous state Markov decision models. We employ the collocation method to solve this model. The presented model was developed based on a previous study by Homayounfar et al. [44]. The presented model results in monthly operating policies distributing limited available water among different users using NBS. The Zayandeh-Rud reservoir system in central Iran is selected to demonstrate the capabilities of the presented models in comparison with the results of the annual form of the dynamic game model, (i.e. second presented model) [42], a discrete stochastic dynamic game [18], and a Bayesian Stochastic Dynamic Programming (BSDP) [45] model of reservoir operation.
As an outline of the present research, first, the theory of Constricted state formulation is presented and the objective function and corresponding constraints of the dynamic model (first model) created based on this theory are introduced. Afterwards, the Markov decision Process is briefly presented as a dynamic solution to deal with conflict in water allocation in reservoir system. Then, the theoretical framework of the second model and corresponding solution (collocation method) is presented. The model adjustment for monthly use and the model structure associated with the second model will be explained as the final part of the methodology section.
Methodology
Optimization model for the dynamic of single reservoir
Theory of Constricted state formulation.
Fletcher and Ponnambalam, [43] introduced a stochastic optimization model to provide an efficient management in reservoir system operation with an acceptable level of reliability. The structure of the aforementioned method was similar to Stochastic Dynamic Programming. However, the state variables (reservoir storage) were non-discrete, thereby a continuous dynamic optimization method was formed. Statistical parameters, the first and second moment of the storage variable (mean and variance of the reservoir storage) play important roles in characterizing the probability distribution of the storage variable. Using these parameters as exerted constraints in the model not only provides an explicit consideration to the bounded storage variable in the reservoir system but also the model would not involve any discretization of the system variables.
Regarding the preceding study conducted by Fletcher and Ponnambalam, [43], the first and second moments of the storage stage are calculated and taken into account as constraints for an optimization problem. Considering the continuity equation for the reservoir system, Eq 1, and the indicator function, Eq 2, the first and second moments of the storage state variable, Eq 3 and Eq 4 respectively, are derived.
Where st and st-1 represent the water storage level in reservoir at time t and t-1 respectively. Rt is the water release decision, It is the long term average of monthly inflow into reservoir, smin(t) and smax(t) are, respectively, minimum and maximum amount of water storage in reservoir and ƞIt is the random component associated with the inflow at time t.
The symbols erf() and Var() are, respectively, the error function and variance and illustrated as follows:
(5)
(6)
In the Eq 3 and Eq 4, E(st) and E(st)2 are the first moment (Mean) and second moment (Variance) of the storage variable. Further detailed explanation regarding the extension of the first and second moment equations and constrained state formulation is available in studies done by Fletcher and Ponnambalam [43].
Objective Function of the continuous optimization model.
In this method, the long-term variation of the state variable are imposed on the optimization model through constraints stated by Eq 3 and Eq 4. Therefore, the optimal value of long-term utilities corresponding to water users and reservoir management are achieved from the optimization. Since the objective function should have a conflict resolution structure, we defined the function based on the Nash product. In order to maximize the long-term average of the Nash product function, the first moment of Nash function is calculated. (Eq 7).
where, E() is the expectation of the function and Ln() is the natural logarithm. Also xi and U(xi) are respectively allocated water to the water user i and the corresponding utility functions. St and U(st) are the reservoir storage in state t and the corresponding utility function. In order to estimate Eq 5 the ninth order Taylor series approximation is used.
Constraints on the continuous dynamic model.
Constraint of the minimum and maximum allocated water to each sector (Eq 8)
(8)
where xi and xi,max are respectively allocated water and maximum allocated water to each sector.
- Constraint of the maximum and minimum total released water.
where Rmin and Rmax are, respectively, minimum and maximum allowed release water and R is the total monthly release water.
- Constraint of total available water
- Constraints of the first and second moments related to the first and last months of the year.
These constraints guarantee that reservoir condition at the beginning of each year is similar to the end of the previous year.
where in Eq 11 and Eq 12, s1 and s13 are, respectively, reservoir storages in the last month and first month of every two consecutive year.
Continuous Dynamic Optimization model and corresponding collocation solution
Dynamic view of conflict in water allocation in reservoir system.
Problems dealing with conflict in water consumption among different users based on experts’ views can be defined as both static and dynamic cases. Even though applying a static frame for a problem makes it easier to solve, the dynamic nature of the problem will be ignored. In this content and regarding conflict in reservoir operation and water allocation, the sequential nature of the reservoir management decisions, together with the inherent randomness of natural water inflows explain the frequent modeling of reservoir management problems as Markov decision processes and their optimization by stochastic dynamic programing.
When an allocation problem along an infinite time horizon is under discussion, the life time utility function can be presented by Eq 13. The main goal is to maximize the overall water users’ utilities (Us). In this equation, vectors x = {xi, i = 1…, n} and U(xi) denote allocated water to different water users and the utilities produced by using the allocated water, respectively.
(13)
where: t shows the time step of the system, St and Rt are the reservoir storage and water release at time t and It is the inflow. Moreover, γ is the discount factor and Vt(St) states the indirect utility function (Value Function) at time t. On the right side, g(St, It, ɛt) states the transition equation (Eq 14) and εt is the factor by which the randomness associated with inflow discharge is imposed and is called exogenous random shock (this parameter is the same as ƞIt being already defined in section (2.2.1)). Also E() denotes the expectation of the value function.
Eq 13 is known as the Bellman equation. The first component in this equation represents the utility derived from immediate consumption at any given time whereas the second component represents the value of optimal lifetime consumption starting one period from state t.
In this context, the multiplicative form of utility functions of water users (Ux(xti)) and reservoir operator (Us(St)), which is known as the NBS, is considered as the intermediate objective function (Eq 15).
In this equation, dx and ds represent minimum allocated water to water users and minimum water level in the reservoir, respectively. The main aim is to maximize this product in every proper sub-game over the planning horizon.
Collocation method for continuous dynamic model.
The value function can be written as a linear combination of a set of m linearly independent basis functions (φ1, φ2, φ3,…, φj) associated with St (storage as the state variable) and unknown basis coefficients (c1, c2,…, cj):
(16)
Considering the collocation method, many interpolation schemes can be employed to approximate the functional equation. Here, one general and practical scheme, namely Chebychey Polynomial and approximation is applied to approximate the functional equation [46].
Chebychev approximation function.
Chebychev polynomials are associated with a family of orthogonal polynomials described by Judd [47]. Eq 17 is to normalize the domain to the interval [–1, 1], with the Chebychev polynomials defined as in Eq 18:
(17)
where,
(18)
The linear combination of m nonlinear equations and m unknowns (Eq 15) can be substituted for the value function in Eq 13. This replacement results in Eq 19:
(19)
To compute this optimization problem the Envelope Theorem can be applied [48, 49].
Miranda and Fackler [46] stated that the policy function is associated with the mean of the random variable in the polynomial optimal control model. Accordingly, in order to compute the expectation term practically in Eq 10, the mean of the random variable (εt) is taken into account in the state transition function. As a result, the transition equation associated with the stochastic problem turns into the form used in the deterministic model and consequently can be solved similarly.
There are a number of numerical solution methods to cope with nonlinear equation problems such as Newton and quasi-Newton methods [50–52]. In this study, we have used the Newton method to solve this problem.
Model adjustment: way to introduce a monthly structure.
Using the collocation method to solve Eq 19 results in annual operating policies for a reservoir system and does not evaluate changes in water level in reservoir during the year. In continuous frameworks, the reward functions, Us(xt1, …,xtn, Rt; t), associated with different months change over the course of the year. Therefore, the second part of the right-hand side, , cannot be used as an approximation for the rest of the year in its current form. To overcome this issue, the second part of the Eq 19 is modified and divided into two parts, as shown in Eq 19
(20)
In Eq 20, the left-hand side shows the optimal approximation of value functions for the time interval starting from state t+1 (M) up to the end of the year. On the right-hand side, the first part is the value function approximation related to state t+1 while the second part represents the value function approximation from state t+2 to the end of the year. Combining Eq 20 and Eq 19 results in Eq 21:
(21)
Model Structure.
In order to describe structure of the model, considering Fig 1, we first illustrate the steps to solve Eq 19 annually. Then, the algorithm with which different months will be connected together will be explained by Fig 2.
Fig 1 provides an illustration on the sequential steps to determine the aforementioned values (i.e. optimal value function and optimal operating policy) annually. The model is comprised of three interconnected cycles to determine the share of different water users, optimal water releases (x’s) and unknown coefficients (c’s) respectively. For this purpose, taking initial unknown coefficients into account, the optimal water releases are calculated and used in a recursive algorithm to update unknown coefficients (cycles 1 and 2, Fig 1). Meanwhile, to determine the optimal water releases by means of the Envelope Theorem, we need to know water shares associated with every user. Therefore, employing NBS the corresponding values (i.e. allocated water share to every user) are determined (cycle 3, Fig 1) and used to update x’s and determining optimal water releases in every trial.
Fig 2 shows the algorithm with which different months will be connected. As the first step, Eq 21 is solved for the last month of the year (December) thereby determining the optimal value function, Vt(St), and corresponding operating policy, xti* associated with December. Then, moving backward, the same parameters are calculated for other months of the year (Step 4, Fig 2) taking into account of value function approximations associated with later months and determined in previous steps. This procedure is continued up to the point when optimal water allocation policies associated with each month remain constant for two subsequent iterations. For example, allocation policies associated with the third month of year (March) calculated through sequential steps 22 and step 10. For this purpose, a predefined small value of tolerance is considered (see Tol in Fig 2).
Applying this approach makes it possible to use Eq 19 in reservoir system operation on a monthly basis and determine the optimal value function, Vt(St), and corresponding optimal operating policy, xti*, for each month of the year.
Results and Discussion
Case Study
In this study, the Zayandeh-Rud river basin (Fig 3), which is one of the major river basins in Iran with a catchment area of 4,200 square kilometers, is used as a case study to examine the proposed conflict resolution method. The Zayandeh-Rud reservoir with an effective capacity of 1,250 million cubic meters located at the upstream of the river basin provides water for approximately three million people who live in the city of Isfahan and surrounding suburb areas. In addition, the reservoir supplies water for the domestic, industrial and agricultural sectors as well. Apart from that, the reservoir is important in providing water for hydropower, recreational use, and in stream flow. The great demand from various sectors exerts pressure on the river basin especially during summer when the river basin fails to meet the demand. In addition, the effects of climate change have made this problem even worse in the recent decade.
A great deal of research has been conducted on the Zayandeh-Rud basin. Zahraie and Hosseini [53], developed an optimization model based on a genetic algorithm (GA) considering variations in water demands. The efficiency of their proposed model was assessed by performing a long-term simulation of the Zayandeh-Rud reservoir. Madani and Marino [54], applied a system dynamic framework to develop the Zayandeh-Rud Watershed Management and Sustainability Model (ZRW-MSM). Homayounfar et al. [44], developed an annual non-discrete stochastic dynamic game model for reservoir operation and its corresponding solution was based on the collocation method. In this study, the logarithms of the 30-year monthly inflows to the reservoir were modeled with the Thomas-Fiering model. The model reproduces the mean and variance of flows in each of the months and the month to month correlation of the flows. Using these statistical parameters, stream flows are reproduced for every month along the year and utilized for reservoir optimization. The model was structured based on two water user groups (the agriculture and the miscellaneous group which consists of industrial, domestic and environmental sectors), plus the reservoir operator.
Utility function development
The utility data of water users and the resource manager (reservoir operator) was obtained via previous research conducted by Ganji et al. [17, 18].
The water allocated to different water users is shown by xt = {xti, I = 1, 2} Subsequently, Ux(xti) and Us(St) denote the utilities associated with various users and the reservoir operator, respectively. Utility functions are structured based on quadratic equations. Table 1 presents the coefficients of the quadratic equations of utility values (a*, b* and c*) applied in Eq 22 for both users (agriculture sector and other sectors). Eq 23 also shows the quadratic statement applied for the reservoir operator. The value of a utility function reaches the maximum 1 (100%) when the volume of allocated water (xti) comes to the maximum water requirement. Conversely, the value of utility hit the lowest level (0.0%) when the vector (xti, i = 1, 2) reaches the boundaries as presented in Table 2. Moreover, the value given to the outside of the boundaries is zero.
Reliability Indices
In this study, reliability is the key deciding point to evaluate the performance of the model based on the decisions by the reservoir operator and water users. The volumetric reliabilities of the reservoir system is utilized to evaluate the capability and efficiency of the proposed model. For water allocation, the volumetric reliability of the reservoir system, called total reliability, is:
(24)
where, nyear shows the length of the planning horizon. Evaluation of the shortfall and the overflow in the reservoir can be carried out by calculating the reservoir volumetric reliability index (Eq 25):
(25)
Solving the optimization model based on constrained state formulation
In this part, as explained previously in the methodology section, applying the Constrained State formulation (introduced by [43]) and based on Nash Bargaining Theory an optimization model for conflict resolution in a limited water situation is presented.
Comparing the discrete dynamic optimization models, the principal feature of this model is to consider the state variable (water level in the reservoir) as a continuous variable thereby avoiding dimensionality problems and long runtime. In this model, the first and second moments of the storage variable, important to characterizing the probability distribution function of the storage variable, are determined and taken into account as constraints for an optimization problem.
The model run for two water users comprised of agriculture sector and other sectors consisting of industrial sector, domestic sector and environmental sector. Solving the model results in determining the first moment of the state variable (monthly long-term average of water storage in the reservoir), the second moment of the state variable (the variance of the changes in the water storage in the reservoir), and the monthly release of water from the reservoir and the water share for each water user (Table 3). The objective function is represented using Eq 7. The model converged after 389 iterations by trial and error.
In order to evaluate the applicability of the optimal policy associated with water release (fourth row in the Table 3) a 30-year simulation model is run and the reliability indices for the reservoir manager and water users are calculated subsequently (Table 4).
As can be seen in Table 4, the reliability values reduced by approximately forty percent over the first four months of the year for the agriculture sector. This was due to the considerable increase in water demand over this period. Although there is an average water demand of nearly 250 MCM in July, a considerable portion of the required water has been met.
Solving the continuous dynamic model using collocation method
Regarding the curvature of the value function, the appropriate number of collocation nodes (dimensions of the problem) and the basis-node scheme were chosen. In this study, various dimensions and basis-node schemes were evaluated to render it computationally efficient. Ultimately, the Chebychev approximation function was employed to serve as the basic function while the appropriate dimension of the problem was considered to be 10 terms of corresponding basic functions. As the next step, the collocation equations were solved by applying Newton's solution method. Applying the Chebychev approximation function, the program converged in 372 iterations. Once the collocation method is used to cope with dynamic problems, the residual function is employed to evaluate the quality of the approximation. The residual function represents the difference between the left and right sides of this equation at arbitrary states St. Fig 4 shows the changes in residual function over the range of the state variable for the considered approximation function. It appears that the applied approximation function enjoys an acceptable level of accuracy. There are some disturbances over the interval which can be due to the discontinuities of the derivatives of utility functions at those points.
Fig 5 represents the value functions of the solution provided for the applied scheme. Fig 6 illustrates the corresponding reservoir storages through which the maximum long-term utility of the water users and reservoir operator for each month is obtained. According to Fig 6, it is clear that over the summer season (from June to August) higher storage is required in the reservoir to obtain higher level of utility. Considering the high level of agricultural activity during this time of year, it is rendered appropriately.
(a), the first three months, (b), the second three months, (c), the third three months and, (d), the fourth three months.
Fig 7 illustrates the resulting policy function. It is obvious that, as long as the weather is moving toward the warm and dry season (July to September), the provided operating policy diagrams would go on a steeper gradient and consequently, it is logical that a higher level of release is obtained.
Considering the optimal reservoir operation rule, a simulation model based on a time period of 30 years is created to evaluate the optimal operating rule as well as the variation in water users' utilities. Subsequently, the reliability indices for reservoir manager and water users are calculated and presented in Table 5. Additional information associated with the simulation model and the optimization model including source code are available from authors upon the request.
Drawing a comparison between presented models and other dynamic alternatives
According to the results, it seems the presented models successfully take the dynamics of the reservoir system into account and maximized long term utility of the system. They resulted in optimal reservoir operating policies and optimal water allocation in the reservoir system. Moreover, the state variable (water level in the reservoir) is considered as a continuous variable in the models thereby avoiding the dimensionality problem. There are, however, differences between them in term of the model structure. In the optimization model based on constrained state formulation (first model), the long-term variation of the state variable is imposed in the optimization model through constraints of the model. Therefore, the optimal value of long-term utilities corresponding to water users and reservoir management are achieved from the optimization. While, in the second model in order to maximize long-term utility value of the system, a form of the Bellman Equation is employed.
Considering the values of reliability that resulted from the 30-year simulation, it seems that both models can successfully deal with water conflict issues which may occur in reservoir management. In comparison with the reliabilities of the water users from the first model, the reliability values in the second model suggest higher performance in the management of water allocation. Considering the total reservoir storage index also the second model produced more reliable values compared to the model based on the constrained state formulation. The higher performance of the second model in producing better reliability indices can be rooted in utilizing the structure of the Bellman Equation. Using this dynamic structure makes the modeling situation closer to the reality.
In comparison with the game model which works on an annual basis (Table 5), the second model results in better values (less values) of the total reservoir storage reliabilities (second row of Table 6). Regarding the water users, the reliabilities that resulted from the second model (fourth row of Table 6) precede the annual value. It should be noted that from the practical viewpoint, the results of models which work on a monthly basis, although providing lower reliabilities in a few cases, are more realistic when compared to annual methods.
In addition, the efficiency of the presented models can be further compared, using the information on the system reliability index of the BSDP model [45], PSDNG model [18], and an annual form of dynamic game [42] in Table 7. According to the results, in comparison with the BSDP and PSDNG, the presented models result in lower reliability values (Fig 8). Also, compared to the discrete dynamic games (i.e. PSDNG), runtime is considerably reduced. The discrete nature of the PSDNG model may be the main reason for the better results and longer runtime. The PSDNG is a stochastic conflict resolution model, which makes possible achievement of higher precision in optimization, using a fine discretization of state variables. Furthermore, the PSDNG model uses the Simulated Annealing (SA) procedure to search for the static equilibrium point in each state of n stages of the model. A fine discretization and using the SA procedure increases the runtime and causes dimensionality problems [18]. In addition, according to the results, when compared with the annual dynamic game models, the presented models provide superior results. Indeed, the operating policies resulting from the second model are more practical than those of the annual models [42, 44].
Conclusion
In this study two monthly continuous dynamic models based on NBS were developed to tackle water allocation conflicts in a reservoir system. The first model, utilizing constrained state formulation, computed the first and second moments of the state variable and used them as constraints in maximizing long-term utility of the reservoir operators and water users. The second model was a monthly continuous dynamic game model which was solved by the collocation method. Applying this model, operating policies were generated for every month. Considering the optimal reservoir operation rule, a 30-year simulation model is developed and corresponding reliability indices for reservoir manager and water users were calculated. According to the results, it seems the continuous dynamic model solved by the collocation method (second model) provided superior results compared to the model based on the constrained state formulation. The volumetric reliabilities resulted from the second model are greater than the corresponding values associated with the first one along the year. This can be due to incorporating the Bellman Equation into model structure. Using this dynamic structure make the modeling situation closer to the reality.
Regarding the solution method of the second model, the collocation method was used to find a polynomial approximation to an unknown function and generate operating policies in the reservoir system. Meanwhile, the Chebychev basis-node scheme was employed as the basis function in the collocation method. The results showed that the collocation method and applied basis function are quite appropriate and accurate in approximating the functional equations and their derivatives.
In order to evaluate the efficiency of the presented models, the reliability values were compared with the information on the system reliability index of the BSDP model, the PSDNG model and an annual form of dynamic game. In this regard, the PSDNG and BSDP models resulted in higher level of volumetric reliability index in comparison with the corresponding values resulted from the presented models. This can be due to the discrete nature of the BSDP and PSDNG. In addition, the PSDNG model employs the Simulated Annealing (SA) procedure to achieve the static equilibrium point in each state. Although a fine discretization of state and decision variable and the SA can result in higher precision in the optimization process, it often increases runtime and causes dimensionality problems.
Regarding the results, the proposed models increased the overall storage reliabilities of the reservoir system compared to the annual alternative. In addition, volumetric reliabilities improved over the year. Also, in comparison with annual alternatives, the operating rules resulted from the presented models are more useful in practice. In term of applicability of the presented approaches, it shows that conflict on water consumption in a river basin under a reservoir system can be stated based on the monthly continuous dynamic approaches. Due to the continuous form of the variable, these approaches will not suffer from the dimensionality problems. It also makes possible consideration of uncertainty in input values (inflows) in reservoir operation. Incorporating the inflow uncertainty may not represent reality, but it is getting closer to real world conditions.
Acknowledgments
The authors are grateful to Bright Spark Unit, and Faculty of Engineering, University of Malaya for all the facilities provided.
Author Contributions
Conceived and designed the experiments: MH SHL. Performed the experiments: MH MZ SHL. Analyzed the data: MH MZ CJM SHL. Contributed reagents/materials/analysis tools: MZ MH. Wrote the paper: MH MZ.
References
- 1. Bellman RE, Dreyfus SE. Applied dynamic programming. 1962.
- 2. Foued BA, Sameh M. Application of goal programming in a multi-objective reservoir operation model in Tunisia. European Journal of Operational Research. 2001;133(2):352–61.
- 3. Karamouz M, Houck MH. Annual and monthly reservoir operating rules generated by deterministic optimization. Water Resources Research. 1982;18(5):1337–44.
- 4. Loganathan G, Bhattacharya D. Goal-programming techniques for optimal reservoir operations. Journal of Water Resources Planning and Management. 1990;116(6):820–38.
- 5. Mousavi H, Ramamurthy A. Optimal design of multi-reservoir systems for water supply. Advances in water resources. 2000;23(6):613–24.
- 6. Yeh WWG. Reservoir management and operations models: A state‐of‐the‐art review. Water resources research. 1985;21(12):1797–818.
- 7. Kaviani S, Hassanli A, Homayounfar M. Optimal Crop Water Allocation Based on Constraint-State Method and Nonnormal Stochastic Variable. Water Resources Management. 2015;29(4):1003–18.
- 8. Homayounfar M, Lai SH, Zomorodian M, Sepaskhah AR, Ganji A. Optimal crop water allocation in case of drought occurrence, imposing deficit irrigation with proportional cutback constraint. Water resources management. 2014;28(10):3207–25.
- 9. Abrishamchi A, Ebrahimian A, Tajrishi M, Mariño MA. Case study: application of multicriteria decision making to urban water supply. Journal of Water Resources Planning and Management. 2005;131(4):326–35.
- 10. Behzadian M, Kazemzadeh RB, Albadvi A, Aghdasi M. PROMETHEE: A comprehensive literature review on methodologies and applications. European journal of Operational research. 2010;200(1):198–215.
- 11. Hajkowicz S, Higgins A. A comparison of multiple criteria analysis techniques for water resource management. European journal of operational research. 2008;184(1):255–65.
- 12.
De Steiguer J, Duberstein J, Lopes V, editors. The analytic hierarchy process as a means for integrated watershed management. Kenneth G Renard, First Interagency Conference on Research on the Watersheds; 2003.
- 13. Srdjevic B. Linking analytic hierarchy process and social choice methods to support group decision-making in water management. Decision Support Systems. 2007;42(4):2261–73.
- 14. Chang N- B, Wen C, Chen Y. A fuzzy multi-objective programming approach for optimal management of the reservoir watershed. European Journal of Operational Research. 1997;99(2):289–302.
- 15. Dong C, Huang G, Cai Y, Liu Y. An inexact optimization modeling approach for supporting energy systems planning and air pollution mitigation in Beijing city. Energy. 2012;37(1):673–88.
- 16. Lee C-S, Chang S-P. Interactive fuzzy optimization for an economic and environmental balance in a river system. Water Research. 2005;39(1):221–31. pmid:15607180
- 17. Ganji A, Karamouz M, Khalili D. Development of stochastic dynamic Nash game model for reservoir operation II. The value of players’ information availability and cooperative behaviors. Advances in water resources. 2007;30(1):157–68.
- 18. Ganji A, Khalili D, Karamouz M. Development of stochastic dynamic Nash game model for reservoir operation. I. The symmetric stochastic model with perfect information. Advances in Water Resources. 2007;30(3):528–42.
- 19. Lee C-S. Multi-objective game-theory models for conflict analysis in reservoir watershed management. Chemosphere. 2012;87(6):608–13. pmid:22284980
- 20. Loáiciga HA. Analytic game—theoretic approach to ground-water extraction. Journal of Hydrology. 2004;297(1):22–33.
- 21. Madani K. Hydropower licensing and climate change: insights from cooperative game theory. Advances in Water Resources. 2011;34(2):174–83.
- 22. Madani K, Hipel KW. Non-cooperative stability definitions for strategic analysis of generic water resources conflicts. Water resources management. 2011;25(8):1949–77.
- 23. Mahjouri N, Ardestani M. Application of cooperative and non-cooperative games in large-scale water quantity and quality management: a case study. Environmental monitoring and assessment. 2011;172(1–4):157–69. pmid:20135217
- 24. Martin WE, Patrick RH, Tolwinski B. A dynamic game of a transboundary pollutant with asymmetric players. Journal of Environmental Economics and Management. 1993;25(1):1–12.
- 25. Suzuki M, Nakayama M. The cost assignment of the cooperative water resource development: a game theoretical approach. Management Science. 1976;22(10):1081–6.
- 26. Carraro C, Marchiori C, Sgobbi A. Applications of negotiation theory to water issues. 2006.
- 27. Madani K. Game theory and water resources. Journal of Hydrology. 2010;381(3):225–38.
- 28.
Parrachino I, Dinar A, Patrone F. Cooperative game theory and its application to natural, environmental, and water resource issues: 3. application to water resources. Application to Water Resources (November 2006) World Bank Policy Research Working Paper. 2006(4074).
- 29.
Zara S, Dinar A, Patrone F. Cooperative game theory and its application to natural, environmental, and water resource issues: 2. application to natural and environmental resources. Application to Natural and Environmental Resources (November 1, 2006) World Bank Policy Research Working Paper. 2006(4073).
- 30. Madani K, Dinar A. Cooperative institutions for sustainable common pool resource management: application to groundwater. Water Resources Research. 2012;48(9).
- 31. Nash J. Two-person cooperative games. Econometrica: Journal of the Econometric Society. 1953:128–40.
- 32.
Harsanyi JC. A Simplified Bargaining Model for the n-Person Cooperative Game. Papers in Game Theory: Springer; 1982. p. 44–70.
- 33. Thomson W. On the axiomatic method and its recent applications to game theory and resource allocation. Social Choice and Welfare. 2001;18(2):327–86.
- 34. Kampas A, White B. Selecting permit allocation rules for agricultural pollution control: a bargaining solution. Ecological Economics. 2003;47(2):135–47.
- 35. Kerachian R, Karamouz M. A stochastic conflict resolution model for water quality management in reservoir–river systems. Advances in Water Resources. 2007;30(4):866–82.
- 36. Rafipour-Langeroudi M, Kerachian R, Bazargan-Lari MR. Developing operating rules for conjunctive use of surface and groundwater considering the water quality issues. KSCE Journal of Civil Engineering. 2014;18(2):454–61.
- 37. Hajiabadi R, Zarghami M. Multi-Objective Reservoir Operation with Sediment Flushing; Case Study of Sefidrud Reservoir. Water Resources Management. 2014;28(15):5357–76.
- 38. Homayounfar M, Lai SH, Zommorodian M, Oroji A, Ganji A, Kaviani S. Developing a Non-Discrete Dynamic Game Model and Corresponding Monthly Collocation Solution Considering Variability in Reservoir Inflow. Water Resources Management. 2015;29(8):2599–618.
- 39. Kerachian R, Karamouz M. Optimal reservoir operation considering the water quality issues: A stochastic conflict resolution approach. Water Resources Research. 2006;42(12).
- 40. Nikoo MR, Kerachian R, Karimi A, Azadnia AA, Jafarzadegan K. Optimal water and waste load allocation in reservoir–river systems: a case study. Environmental Earth Sciences. 2014;71(9):4127–42.
- 41. Ganji A, Khalili D, Karamouz M, Ponnambalam K, Javan M. A fuzzy stochastic dynamic Nash game analysis of policies for managing water allocation in a reservoir system. Water resources management. 2008;22(1):51–66.
- 42. Homayoun-far M, Ganji A, Khalili D, Harris J. Two solution methods for dynamic game in reservoir operation. Advances in Water Resources. 2010;33(7):752–61.
- 43. Fletcher S, Ponnambalam K. A new formulation for the stochastic control of systems with bounded state variables: An application to a single reservoir system. Stochastic Hydrology and Hydraulics. 1996;10(3):167–86.
- 44. Homayounfar M, Ganji A, Martinez C. A novel solution for stochastic dynamic game of water allocation from a reservoir using collocation method. Water resources management. 2011;25(13):3427–44.
- 45. Karamouz M, Vasiliadis HV. Bayesian stochastic optimization of reservoir operation using uncertain forecasts. Water Resources Research. 1992;28(5):1221–32.
- 46.
Miranda MJ, Fackler PL. Applied Computational Economics and Finance MIT Press. Cambridge MA. 2002.
- 47.
Judd KL. Numerical methods in economics: MIT press; 1998.
- 48. Grafton RQ, Kompas T, Lindenmayer D. Marine reserves with ecological uncertainty. Bulletin of Mathematical Biology. 2005;67(5):957–71. pmid:15998490
- 49. LaFrance JT, Barney LD. The envelope theorem in dynamic optimization. Journal of Economic Dynamics and Control. 1991;15(2):355–85.
- 50. Dunn JC, Bertsekas DP. Efficient dynamic programming implementations of Newton's method for unconstrained optimal control problems. Journal of Optimization Theory and Applications. 1989;63(1):23–38.
- 51. Murray D, Yakowitz S. Differential dynamic programming and Newton's method for discrete optimal control problems. Journal of Optimization Theory and Applications. 1984;43(3):395–414.
- 52.
Tolwinski B. Newton-type methods for stochastic games. Differential games and applications: Springer; 1989. p. 128–44.
- 53. Zahraie B, Hosseini SM. Development of reservoir operation policies considering variable agricultural water demands. Expert Systems with Applications. 2009;36(3):4980–7.
- 54. Madani K, Mariño MA. System dynamics analysis for managing Iran’s Zayandeh-Rud river basin. Water resources management. 2009;23(11):2163–87.