Multi-agent actor-critic method for joint duty-cycle and transmission power control - CEA - Commissariat à l’énergie atomique et aux énergies alternatives Access content directly
Conference Papers Year :

Multi-agent actor-critic method for joint duty-cycle and transmission power control

Abstract

In energy-harvesting Internet of Things (EH-IoT) wireless networks, maintaining energy neutral operation (ENO) is crucial for their perpetual operation and maintenance-free property. Guaranteeing this ENO condition and optimal powerperformance trade-off under transient harvested energy and wireless channel quality is particularly challenging. This paper proposes a multi-agent actor-critic reinforcement learning for modulating both the transmitter duty-cycle and output power based on the state-of-buffer (SoB) and the state-of-charge (SoC) information as a state. Thanks to these buffers, differently from the state-of-the-art, our solution does not require any model of the wireless transceiver nor any direct measurement of both harvested energy and wireless channel quality for adapting to these uncertainties. Simulation results of a solar powered EH-IoT node using real-life outdoor solar irradiance data show that the proposed method achieves better performance without system failures throughout a year compared to the state-of-the-art that suffers some system downtime. Our approach also predicts almost no system fails during five years of operation.
Fichier principal
Vignette du fichier
DATE2020_ver_final_sawaguchi.pdf (336.05 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

cea-03271255 , version 1 (25-06-2021)

Identifiers

Cite

Sota Sawaguchi, Jean-Frédéric Christmann, Anca Molnos, Carolynn Bernier, Suzanne Lesecq. Multi-agent actor-critic method for joint duty-cycle and transmission power control. DATE 2020 - 2020 Design, Automation & Test in Europe Conference & Exhibition, Mar 2020, Grenoble, France. pp.1015-1018, ⟨10.23919/DATE48585.2020.9116518⟩. ⟨cea-03271255⟩
69 View
79 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More