Application of Stochastic Dual Dynamic Programming Using Markovian Stochastic Modeling for Formulating Long-term Operation Policies of Hydropower Systems

Document Type : Original Article

Authors

1 School of Civil Engineering, College of Engineering, University of Tehran

2 Assistant Professor, Department of Engineering, Islamic Azad University-Central Tehran Branch

Abstract

In the last decades, various methods have been proposed for stochastic operation optimization of reservoirs out pf which one is Stochastic Dual Dynamic Programming (SDDP). Reviewing the literature shows in most previous studies, inflow uncertainties have been mostly modeled by auto-regressive AR(1) or seasonal aut-regressive PAR(2) models when using SDDP. Another approach toward inflow uncertainty modeling by SDDP uses Markov Chain which has received less attention. In this study, MSDDP model has been developed which uses Markov chain concept. Furthermore, applicability of SDDP in developing long-term operation policies has not been tested before. In this study, after presenting an algorithm for using SDDP and MSDDP for formulating long-term operation policies, their performances have been compared in weekly operation optimizaition of Karoun multi-reservoir hydropower system. The benefits estimated for operation of the system based on MSDDP policies has shown 35 percent improvement compared with SDDP results. The results have shown absolute superiority of MSDDP in formulating long-term operation policies. Furthermore, operation policies obtained from SDDP have shown highest compatibility with the best possible operation policy when there is no uncertainty (deterministic conditions).

Keywords

Main Subjects


Bellman R (1957) Dynamic programming. Princeton Univ. Press
Behan Sad (2013) Studies for updating water master plan of Iran: Karoon River watershed (In Persian)
Dezab (2009) Systemic studies for Karoon and Dez River basins. Hydrology report (In Persian)
Espanmanesh V, Zahraie B, Poorsepahy-Samian H (2013) Application of SDDP optimization method in optimization of the mid-term operation of Karoon multireservoir hydropower system. In: Proc. of 12th Iranian Hydraulic Conference, Agriculture and Natural Resources Campus, University of Tehran, Iran (In Persian)
Gjelsvik A Mo B, Haugstad A (2010) Long- and medium-term operations planning and stochastic modeling in hydro-dominated power systems based on stochastic dynamic programming. Handbook of Power Systems I. Energy Systems, pp. 33-55, Springer, Berlin
Goor Q, Kelman R, Tilmant A (2010) Optimal multipurpose-multireservoir operation model with variable productivity of hydropower plants. Journal of Water Resources Planning and Management 137(3):258-267
Helseth A, Braaten H (2015) Efficient parallelization of the stochastic dual dynamic programming algorithm applied to hydropower scheduling. Energies, 8(12): 14287-14297
Karamouz M, Szidarovszky F, Zahraie B (2003) Water Resources Systems Analysis. CRC press
Karamouz M, Houck M H, Delleur G W (1992) Optimization and simulation of multiple reservoir systems. ASCE J. Water Resources Planning and Management, 118(1):71–81
Madani K, Lund J R (2009) Modeling California's high-elevation hydropower systems in energy units. Water Resources Research 45(9):W09413
Pereira M V F, Pinto L M V G (1985) Stochastic optimization of a multireservoir hydroelectric system: a decomposition approach. Water resources research 21(6):779-792
Pereira M V, Pinto L M (1991) Multi-stage stochastic optimization applied to energy planning. Mathematical programming 52(1-3):359-375
Philpott A B, De Matos V L (2012) Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion. European Journal of Operational Research 218(2):470-483
Poorsepahy-Samian H, Espanmanesh V, Zahraie B (2014) Optimization of the mid-term operation in multireservoir hydropower systems considering the hourly variations in power prices. In: Proc. of the 5th Iranian Water Resources Management Conference, Iranian Water Resources Association, Shahid Beheshti University, Tehran, Iran. http://www. civilica .com/ Paper-WRM05-WRM05_445.html (In Persian)
Poorsepahy-Samian H, Espanmanesh V, Zahraie B (2016) Improved inflow modeling in stochastic dual dynamic programming. ASCE Journal of Water Resources Planning and Management, 142(12): 04016065
Sadeghi F (2016) Application of stochastic dual dynamic programming in Optimal operation of hydropower reservoirs. (Unpublished master's thesis), University of Tehran, Tehran, Iran
Safavi H R (2009) Enginnering Hydrology. 2nd edition, Arkan Danesh, Esfahan, Iran, 604 pages (In persian)
Shapiro A (2011) Analysis of stochastic dual dynamic programming method. European Journal of Operational Research, 209(1):63-72
 Tilmant A, Beevers L, Muyunda B (2010) Restoring a flow regime through the coordinated operation of a multireservoir system: The case of the Zambezi River basin. Water Resources Research 46(7):W07533
Tilmant A, Kelman R (2007) A stochastic approach to analyze trade‐offs and risks associated with large‐scale water resources systems. Water Resources Research 43(6):W06425
Tilmant A, Pinte D, Goor Q (2008) Assessing marginal water values in multipurpose multireservoir systems via stochastic programming. Water Resources Research 44(12):W12431
Vedula S, Mujumdar P P (1992) Optimal reservoir operation for irrigation of multiple crops. Water Resources Research 28(1):1-9