Second-best Beam-Alignment via Bayesian Multi-Armed Bandits

by   Muddassar Hussain, et al.

Millimeter-wave (mm-wave) systems rely on narrow-beams to cope with the severe signal attenuation in the mm-wave frequency band. However, susceptibility to beam mis-alignment due to mobility or blockage requires the use of beam-alignment schemes, with huge cost in terms of overhead and use of system resources. In this paper, a beam-alignment scheme is proposed based on Bayesian multi-armed bandits, with the goal to maximize the alignment probability and the data-communication throughput. A Bayesian approach is proposed, by considering the state as a posterior distribution over angles of arrival (AoA) and of departure (AoD), given the history of feedback signaling and of beam pairs scanned by the base-station (BS) and the user-end (UE). A simplified sufficient statistics for optimal control is derived, in the form of preference of BS-UE beam pairs. By bounding a value function, the second-best preference policy is derived, which strikes an optimal balance between exploration and exploitation by selecting the beam pair with the current second-best preference. Through Monte-Carlo simulation with analog beamforming, the superior performance of the second-best preference policy is demonstrated in comparison to existing schemes based on first-best preference, linear Thompson sampling, and upper confidence bounds, with up to 7 improvements in alignment probability, respectively.


Energy-Efficient Interactive Beam-Alignment for Millimeter-Wave Networks

Millimeter-wave (mm-wave) will be the key enabling technology in the nex...

Cell Discovery in Millimeter Wave Systems: Physical Layer Implementations

Cell discovery is the procedure in which an user equipment (UE) in a cel...

Best Arm Identification Based Beam Acquisition in Stationary and Abruptly Changing Environments

We study the initial beam acquisition problem in millimeter wave (mm-wav...

Bayesian Optimization-Based Beam Alignment for MmWave MIMO Communication Systems

Due to the very narrow beam used in millimeter wave communication (mmWav...

Coded Energy-Efficient Beam-Alignment for Millimeter-Wave Networks

Millimeter-wave communications rely on narrow-beam transmissions to cope...

UB3: Best Beam Identification in Millimeter Wave Systems via Pure Exploration Unimodal Bandits

Millimeter wave (mmWave) communications have a broad spectrum and can su...

Silent Tracker: In-band Beam Management for Soft Handover for mm-Wave Networks

In mm-wave networks, cell sizes are small due to high path and penetrati...

Please sign up or login with your details

Forgot password? Click here to reset