|
Aggregation aware distributed channel access in internet of things networks using reinforcement learning under partial observability
|
A. Rezvani   , A. Mirzaei , N. Mikaeilvand , B. Nouri-Moghaddam , S. Jahanbakhsh Gudakahriz |
| Department of Computer Science and Mathematics, CT.C., Islamic Azad University, Tehran, Iran |
|
|
Abstract: (4 Views) |
The rapid growth of Internet of Things (IoT) networks has transformed data aggregation and medium access control into a large-scale sequential decision-making problem under uncertainty, where distributed nodes operate with incomplete and noisy observations. In dense and heterogeneous IoT environments, classical medium access protocols fail to efficiently balance channel utilization, collision avoidance, and aggregation delay. In this paper, aggregation-aware dynamic channel access is formulated as a partially observable Markov decision process, explicitly capturing imperfect sensing and environmental uncertainty. To enable practical distributed learning, the original model is approximated by a surrogate Markov decision process defined over an information state constructed from local observations and past actions. Based on this formulation, a reinforcement learning–based cognitive medium access framework is developed, in which each node autonomously learns an access policy by optimizing a reward function that jointly accounts for successful transmission, collision probability, idle channel usage, and aggregation-related delay. Simulation results obtained in dynamic multi-channel environments demonstrate that the proposed framework significantly outperforms classical schemes. In dense network scenarios, it achieves a channel utilization of up to 85.3%, while reducing the collision probability to approximately 0.08, compared with ALOHA and SDSA. Moreover, the average response delay is reduced to 12.4 ms, confirming the effectiveness of the proposed approach for aggregation-aware and uncertainty-aware IoT networks.
|
|
| Keywords: Internet of Things Networks, Data Aggregation under Uncertainty, Partially Observable Markov Decision Process, Surrogate Markov Decision Model, Reinforcement Learning Based Medium Access Control, Distributed Channel Access Optimization, Sequential Decisio |
|
|
Full-Text [PDF 632 kb]
(2 Downloads)
|
Type of Study: Research |
Subject:
General
Received: 2026/07/2 | Accepted: 2026/09/23 | Published: 2026/09/28
|
|
|
|
|
|
|
| Send email to the article author |
|
|
|
| Add your comments about this article |
|
|
|
