A Q-Learning approach with collective contention estimation for bandwidth-efficient and fair access control in IEEE 802.11p vehicular networks

Pressas, Andreas, Sheng, Zhengguo, Ali, Falah and Tian, Daxin (2019) A Q-Learning approach with collective contention estimation for bandwidth-efficient and fair access control in IEEE 802.11p vehicular networks. IEEE Transactions on Vehicular Technology. ISSN 0018-9545

[img] PDF - Accepted Version
Download (3MB)
[img] PDF - Draft Version
Restricted to SRO admin only

Download (3MB)

Abstract

Vehicular Ad hoc Networks (VANETs) are wireless networks formed of moving vehicle-stations, that enable safety-related packet exchanges among them. Their infrastructure-less, unbounded nature allows the formation of dense networks that present a channel sharing issue, which is harder to tackle than in conventional WLANs, due to fundamental differences of the protocol stack. Optimising channel access strategies is important for the efficient usage of the available wireless bandwidth and the successful deployment of VANETs. We present a Q-Learning-based approach to wirelessly network a big number of vehicles and enable the efficient exchange of data packets among them. More specifically, this work focuses on a IEEE 802.11p-compatible contention-based Medium Access Control (MAC) protocol for efficiently sharing the wireless channel among multiple vehicular stations. The stations feature algorithms that "learn" how to act optimally in a network in order to maximise their achieved packet delivery and minimise bandwidth wastage. Additionally, via a Collective Contention Estimation (CCE) mechanism which we embed on the Q-Learning agent, faster convergence, higher throughput and short-term fairness are achieved.

Item Type: Article
Schools and Departments: School of Engineering and Informatics > Engineering and Design
Research Centres and Groups: Advanced Communications, Mobile Technology and IoT (ACMI)
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK5101 Telecommunication Including telegraphy, telephone, radio, radar, television
Depositing User: Zhengguo Sheng
Date Deposited: 12 Jul 2019 10:46
Last Modified: 08 Aug 2019 16:00
URI: http://sro.sussex.ac.uk/id/eprint/84867

View download statistics for this item

📧 Request an update
Project NameSussex Project NumberFunderFunder Ref
Bionic communications and networking for connected vehiclesG2114ROYAL SOCIETYIE160920
Doing More with Less Wiring: Mission-Critical and Intelligent Communication Protocols for Future Vehicles Using Power LinesG2132EPSRC-ENGINEERING & PHYSICAL SCIENCES RESEARCH COUNCILEP/P025862/1
Intelligent and decentralized cyber security and privacy for 5G vehicular networksG2628UnsetUnset