Uncertainty Quantification for Efficient and Risk-Sensitive Reinforcement Learning - Mines Saint-Étienne Access content directly
Conference Papers Year : 2023

Uncertainty Quantification for Efficient and Risk-Sensitive Reinforcement Learning

Abstract

In complex real-world decision problems, ensuring safety and addressing uncertainties are crucial aspects. In this work, we present an uncertainty-aware Reinforcement Learning agent designed for risk-sensitive applications in continuous action spaces. Our method quantifies and leverages both epistemic and aleatoric uncertainties to enhance agent's learning and to incorporate risk assessment into decision-making processes. We conduct numerical experiments to evaluate our work on a modified version of Lunar Lander with variable and risky landing conditions. We show that our method outperforms both Deep Deterministic Policy Gradient (DDPG) and TD3 algorithms by reducing collisions and having significant faster training. In addition, it enables the trained agent to learn a risk-sensitive policy that balances performance and risk based on a specific level of sensitivity to risk required for the task.
No file

Dates and versions

emse-04378533 , version 1 (08-01-2024)

Identifiers

Cite

Mohamed-Harith Ibrahim, Stéphane Lecoeuche, Jacques Boonaert, Mireille Batton-Hubert. Uncertainty Quantification for Efficient and Risk-Sensitive Reinforcement Learning. 2023 IEEE Symposium Series on Computational Intelligence (SSCI), Dec 2023, Mexico City, France. pp.1429-1434, ⟨10.1109/SSCI52147.2023.10372067⟩. ⟨emse-04378533⟩
13 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More