Rate Adaptation with Q-Learning in CSMA/CA Wireless Networks


Soohyun Cho, Journal of Information Processing Systems Vol. 16, No. 5, pp. 1048-1063, Oct. 2020  

10.3745/JIPS.03.0148
Keywords: CSMA/CA, ns-3, ns3-gym, Q-learning, Reinforcement Learning
Fulltext:

Abstract

In this study, we propose a reinforcement learning agent to control the data transmission rates of nodes in carrier sensing multiple access with collision avoidance (CSMA/CA)-based wireless networks. We design a reinforcement learning (RL) agent, based on Q-learning. The agent learns the environment using the timeout events of packets, which are locally available in data sending nodes. The agent selects actions to control the data transmission rates of nodes that adjust the modulation and coding scheme (MCS) levels of the data packets to utilize the available bandwidth in dynamically changing channel conditions effectively. We use the ns3-gym framework to simulate RL and investigate the effects of the parameters of Q-learning on the performance of the RL agent. The simulation results indicate that the proposed RL agent adequately adjusts the MCS levels according to the changes in the network, and achieves a high throughput comparable to those of the existing data transmission rate adaptation schemes such as Minstrel.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.




Cite this article
[APA Style]
Soohyun Cho (2020). Rate Adaptation with Q-Learning in CSMA/CA Wireless Networks. Journal of Information Processing Systems, 16(5), 1048-1063. DOI: 10.3745/JIPS.03.0148.

[IEEE Style]
S. Cho, "Rate Adaptation with Q-Learning in CSMA/CA Wireless Networks," Journal of Information Processing Systems, vol. 16, no. 5, pp. 1048-1063, 2020. DOI: 10.3745/JIPS.03.0148.

[ACM Style]
Soohyun Cho. 2020. Rate Adaptation with Q-Learning in CSMA/CA Wireless Networks. Journal of Information Processing Systems, 16, 5, (2020), 1048-1063. DOI: 10.3745/JIPS.03.0148.