Skip to Main content Skip to Navigation
Conference papers

Multi-agent actor-critic method for joint duty-cycle and transmission power control

Abstract : In energy-harvesting Internet of Things (EH-IoT) wireless networks, maintaining energy neutral operation (ENO) is crucial for their perpetual operation and maintenance-free property. Guaranteeing this ENO condition and optimal powerperformance trade-off under transient harvested energy and wireless channel quality is particularly challenging. This paper proposes a multi-agent actor-critic reinforcement learning for modulating both the transmitter duty-cycle and output power based on the state-of-buffer (SoB) and the state-of-charge (SoC) information as a state. Thanks to these buffers, differently from the state-of-the-art, our solution does not require any model of the wireless transceiver nor any direct measurement of both harvested energy and wireless channel quality for adapting to these uncertainties. Simulation results of a solar powered EH-IoT node using real-life outdoor solar irradiance data show that the proposed method achieves better performance without system failures throughout a year compared to the state-of-the-art that suffers some system downtime. Our approach also predicts almost no system fails during five years of operation.
Document type :
Conference papers
Complete list of metadata

https://hal-cea.archives-ouvertes.fr/cea-03271255
Contributor : Carolynn Bernier <>
Submitted on : Friday, June 25, 2021 - 3:05:17 PM
Last modification on : Sunday, June 27, 2021 - 3:27:57 AM

File

DATE2020_ver_final_sawaguchi.p...
Files produced by the author(s)

Identifiers

Citation

Sota Sawaguchi, Jean-Frédéric Christmann, Anca Molnos, Carolynn Bernier, Suzanne Lesecq. Multi-agent actor-critic method for joint duty-cycle and transmission power control. DATE 2020 - 2020 Design, Automation & Test in Europe Conference & Exhibition, Mar 2020, Grenoble, France. pp.1015-1018, ⟨10.23919/DATE48585.2020.9116518⟩. ⟨cea-03271255⟩

Share

Metrics

Record views

30

Files downloads

19