Use of Q-learning approaches for practical medium access control in wireless sensor networks

• DOI: 10.1016/j.engappai.2016.06.012
• Publication Date: 2016-07-06T23:31:57Z
• Authors: Selahattin Kosunalp; Yi Chu; Paul D. Mitchell; David Grace; Tim Clarke
• Keywords: Aloha

This paper studies the potential of a novel approach to ensure more efficient and intelligent assignment of capacity through medium access control (MAC) in practical wireless sensor networks. Q-Learning is employed as an intelligent transmission strategy. We review the existing MAC protocols in the context of Q-learning. A recently-proposed, ALOHA and Q-Learning based MAC scheme, ALOHA-Q, is considered which improves the channel performance significantly with a key benefit of simplicity. Practical implementation issues of ALOHA-Q are studied. We demonstrate the performance of the ALOHA-Q through extensive simulations and evaluations in various testbeds. A new exploration/exploitation method is proposed to strengthen the merits of the ALOHA-Q against dynamic the channel and environment conditions.