Skip to Main content Skip to Navigation
Conference papers

Multi-agent actor-critic method for joint duty-cycle and transmission power control

Abstract : In energy-harvesting Internet of Things (EH-IoT) wireless networks, maintaining energy neutral operation (ENO) is crucial for their perpetual operation and maintenance-free property. Guaranteeing this ENO condition and optimal powerperformance trade-off under transient harvested energy and wireless channel quality is particularly challenging. This paper proposes a multi-agent actor-critic reinforcement learning for modulating both the transmitter duty-cycle and output power based on the state-of-buffer (SoB) and the state-of-charge (SoC) information as a state. Thanks to these buffers, differently from the state-of-the-art, our solution does not require any model of the wireless transceiver nor any direct measurement of both harvested energy and wireless channel quality for adapting to these uncertainties. Simulation results of a solar powered EH-IoT node using real-life outdoor solar irradiance data show that the proposed method achieves better performance without system failures throughout a year compared to the state-of-the-art that suffers some system downtime. Our approach also predicts almost no system fails during five years of operation.
Document type :
Conference papers
Complete list of metadata
Contributor : Carolynn Bernier Connect in order to contact the contributor
Submitted on : Friday, June 25, 2021 - 3:05:17 PM
Last modification on : Thursday, September 30, 2021 - 10:04:02 AM
Long-term archiving on: : Sunday, September 26, 2021 - 10:18:04 PM


Files produced by the author(s)



Sota Sawaguchi, Jean-Frédéric Christmann, Anca Molnos, Carolynn Bernier, Suzanne Lesecq. Multi-agent actor-critic method for joint duty-cycle and transmission power control. DATE 2020 - 2020 Design, Automation & Test in Europe Conference & Exhibition, Mar 2020, Grenoble, France. pp.1015-1018, ⟨10.23919/DATE48585.2020.9116518⟩. ⟨cea-03271255⟩



Record views


Files downloads