Maximising well-being with AI under deep climate turmoil – MA’AT

We’re a studio in Berlin with an international practice in architecture, urban planning and interior design. We believe in sharing knowledge and promoting dialogue to increase the creative potential of collaboration.

Summary

As climate change alters the physical, built, and social environment that humans depend on for resources, tools to aid climate change adaptation planning are increasingly urgent. In response, MA’AT proposes to combine machine learning with health and environmental modelling to develop a fully functional prototype for a multi-modular AI framework to aid climate change adaptation planning under deep climate uncertainty.

Focusing on climate adaptation policies for rain events within the Copenhagen capital region as a case study, the MA’AT Proof-of-Concept will learn an optimal policy that maximises delayed rewards in the form of societal wellbeing, within an agent-based modelling (ABM) environment.

Using the shared socioeconomic pathways (SSPs) as the basis for probabilistic priors for projecting different exogenous variables over time, this 2-year project will demonstrate a fully integrated probabilistic modelling framework that captures the dynamic interactions between climate change-induced flooding and other stressors due to heavy rain, future adaptation plans, and human wellbeing.

The voyage had begun, and had begun happily with a soft blue sky, and a calm sea.

They followed her on to the deck. All the smoke and the houses had disappeared, and the ship was out in a wide space of sea very fresh and clear though pale in the early light. They had left London sitting on its mud. A very thin line of shadow tapered on the horizon, scarcely thick enough to stand the burden of Paris, which nevertheless rested upon it. They were free of roads, free of mankind, and the same exhilaration at their freedom ran through them all.

The ship was making her way steadily through small waves which slapped her and then fizzled like effervescing water, leaving a little border of bubbles and foam on either side. The colourless October sky above was thinly clouded as if by the trail of wood-fire smoke, and the air was wonderfully salt and brisk. Indeed it was too cold to stand still. Mrs. Ambrose drew her arm within her husband’s, and as they moved off it could be seen from the way in which her sloping cheek turned up to his that she had something private to communicate.

Oceanic Inspiration


Winding veils round their heads, the women walked on deck. They were now moving steadily down the river, passing the dark shapes of ships at anchor, and London was a swarm of lights with a pale yellow canopy drooping above it. There were the lights of the great theatres, the lights of the long streets, lights that indicated huge squares of domestic comfort, lights that hung high in air.

No darkness would ever settle upon those lamps, as no darkness had settled upon them for hundreds of years. It seemed dreadful that the town should blaze for ever in the same spot; dreadful at least to people going away to adventure upon the sea, and beholding it as a circumscribed mound, eternally burnt, eternally scarred. From the deck of the ship the great city appeared a crouched and cowardly figure, a sedentary miser.

Forest.

Even a child knows how valuable the forest is. The fresh, breathtaking smell of trees. Echoing birds flying above that dense magnitude. A stable climate, a sustainable diverse life and a source of culture. Yet, forests and other ecosystems hang in the balance, threatened to become croplands, pasture, and plantations.

Close-up of dried, cracked earth.

What’s the problem?

Trees are more important today than ever before. More than 10,000 products are reportedly made from trees. Through chemistry, the humble woodpile is yielding chemicals, plastics and fabrics that were beyond comprehension when an axe first felled a Texas tree.

Why MA’AT?

Climate-induced wellbeing loss can occur in the immediate aftermath of a flood as individuals exposed to the event reckon with the damage and trauma of experiencing a natural disaster, or as a gradual, latent loss of the capabilities necessary to lead a fulfilling and meaningful life. Transport systems play a vital role in ensuring individuals’ resilience to climate events both in the short- and long-term, and MA’AT is designed to help identify the pathways that can enable transport systems to keep on playing this role as climate change disrupts human flourishing in both minor and major ways.

The cross-cutting effects of climate change force us to think outside of our disciplinary silos. By employing a system-of-systems approach, MA’AT can showcase how the effects of a changing climate percolate through both physical and social systems to produce divergent outcomes. Our focus on reinforcement learning, meanwhile, allows researchers, policymakers, and stakeholders alike to query which sequences of actions contribute to producing desired results over long periods of time.

How?

Identifying a suitable framework for deriving a climate adaptation policy, heavily depends on the parameters of the ABM environment. A tradeoff between accuracy and efficiency must be made to derive a good policy, that is not too computationally complicated and expensive. Our aim is to compare different approaches such as optimization, Bayesian optimization and different deep reinforcement learning (DRL) frameworks. As model size and complexity increase the most viable approach is to generalize through DRL. The goal is the find the sequence of policy changes that protect Copenhagen in the most socioeconomic way.

This requires the agent to have foresight and the ability to weigh current decision versus future decisions. To best implement this approach, multiple DRL approaches will be compared, both standard approaches, but also more new and sophisticated algorithms that are designed to learn from distributed systems with independent agents. 

Using parallelized agents and synchronize the agent experience from multiple agents on to one learner, the CPU and the GPU power of agents learning and interacting with the environment can be distributed over multiple machines and be synchronized onto one learner. This framework should allow for scaling both on action variety, environment complexity (for instance, considering a bigger area than Copenhagen), and larger timeseries or finer grained timesteps.

Team

Current team

Meet the members of the team who are actively contributing to MAAT:

Francisco C. Pereira
Technical University of Denmark
Karyn Morrissey
University of Galway
Martin Drews
Technical University of Denmark
Miguel Costa
Technical University of Denmark
Arthur Vandervoort
Technical University of Denmark
Beatriz Braga de Carvalho
Technical University of Denmark
João Miranda
Technical University of Denmark

Former members

Meet the team members who have contributed to MAAT in the past:

Morten W. Petersen
Saint-Gobain Distribution Denmark
Carolin Schmidt
Technical University of Munich
Emilie G. Kristensen
Technical University of Denmark

Publications

1.

Climate Adaptation with Reinforcement Learning: Experiments with Flooding and Transportation in Copenhagen
Miguel Costa, Morten W. Petersen, Arthur Vandervoort, Martin Drews, Karyn Morrissey, Francisco C. Pereira
TACKLING CLIMATE CHANGE WITH MACHINE LEARNING WORKSHOP AT NEURIPS 2024

2.

Using Reinforcement Learning to Integrate Subjective Wellbeing into Climate Adaptation Decision Making
Arthur Vandervoort, Miguel Costa, Morten W. Petersen, Martin Drews, Sonja Haustein, Karyn Morrissey, and Francisco C. Pereira
TACKLING CLIMATE CHANGE WITH MACHINE LEARNING WORKSHOP AT ICLR 2025

Funding

This work is supported by a research grant (VIL57387) from VILLUM FONDEN.