Including an Industrial Optimization Day

HEC Montréal, May 7 - 9, 2012


HEC Montréal, May 7 — 9, 2012

Schedule Authors My Schedule
Cal add eabad1550a3cf3ed9646c36511a21a854fcb401e3247c61aefa77286b00fe402

TB5 Énergie et Environnement 3 / Energy and Environment 3

May 8, 2012 10:30 AM – 12:10 PM

Location: Raymond Chabot Grant Thornton

Chaired by Michèle Breton

3 Presentations

  • Cal add eabad1550a3cf3ed9646c36511a21a854fcb401e3247c61aefa77286b00fe402
    10:30 AM - 10:55 AM

    Optimal Carbon Sequestration when Reservoirs are Leaky

    • Alain Jean-Marie, presenter, Institut national de recherche en informatique et automatique
    • Michel Moreaux, Toulouse School of Economics
    • Mabel Tidball, INRA, UMRLameta

    We provide a complete solution to a model of optimal carbon sequestration and storage in a pollution-emitting economy. Atmospheric pollution is kept below a certain threshold. The CO2 storage is leaking at a constant rate. The solution includes some situations very different from those previously described.

  • Cal add eabad1550a3cf3ed9646c36511a21a854fcb401e3247c61aefa77286b00fe402
    10:55 AM - 11:20 AM

    A Multi-Agent Reinforcement Learning Approach to Develop the Water Value Function for a Multireservoir Hydroelectric Systems

    • Amr Ayad, presenter, University of British Columbia
    • Ziad Shawwash, University of British Columbia
    • Alaa Abdalla, BC Hydro

    We present the application of a new algorithm (MARLOMMR) used to establish the marginal value of water and value of water-in-storage for multireservoir hydroelectric power systems. The new algorithm relies on recent advances in the multiagent reinforcement learning (MARL) technique combined with function approximations and other approximation techniques. To develop optimal release policies within the proposed multiagent environment framework, decentralized agents, each representing a reservoir on a river system, cooperate via indirect communication channels. A second level of communication exists between different river systems to achieve the global goal of maximizing present revenue as well as future value of the water stored in the reservoir system. The advantages of the new algorithm are: less computational effort, flexibility and better representation of the operation of actual hydro system (e.g., the BC Hydro system). To validate the results of the new model, a stochastic dynamic programming algorithm (SDPOM2R) was developed and used to benchmark the MARLOMMR model. Both models use the same input data sets for the two largest reservoirs in the BC Hydro system, the Williston and the Kinbasket. We plan to compare the efficiency and accuracy of the MARLOMMR model with other models that are already-in-use or are under-development at BC Hydro, such as the Reinforcement Learning Reservoir Optimization Model and a Stochastic Dual Dynamic Programming model.

  • Cal add eabad1550a3cf3ed9646c36511a21a854fcb401e3247c61aefa77286b00fe402
    11:20 AM - 11:45 AM

    Foresight Approach for International Environmental Agreements

    • Samar Garrab, presenter, HEC Montréal
    • Michèle Breton, GERAD, HEC Montréal

    In this paper, we consider a group of countries, where a subset of them (the signatories) agree to adhere to an environmental agreement to reduce pollution emissions, while the remaining countries are non-signatories. We assume that the number of signatories evolves over time according to a discrete-time replicator dynamics. In our model, both the stock of pollution and the number of signatories are state variables. We look for both Nash and Stacklberg equilibria strategies by using numerical methods.