TY - GEN
T1 - Contextual-Bandit based MIMO Relay Selection Policy with Channel Uncertainty
AU - Gupta, Ankit
AU - Balasubramanya, Naveen Mysore
AU - Sellathurai, Mathini
PY - 2020/7/27
Y1 - 2020/7/27
N2 - In this work, we exploit the potential benefits of multi-arm bandit scheme in cooperative multiple-input multiple output (MIMO) wireless networks. In particular, we consider an online-policy for amplify-and-forward MIMO relay selection (RS), where relays are provided with uncertain channel state information (CSI). We design the RS policy as a sequential experience-driven learning algorithm with a contextual bandit (CB) approach, where the algorithm learns to select an optimal relay node using the imperfect CSI provided as a context vector and the past experience of rewards procured with current policy, with the aim of maximizing the cumulative mean reward over time. Further, with extensive simulation result, we demonstrate that proposed CB based RS policy achieves superior performance gains compared to conventional Gram-Schmidt method.
AB - In this work, we exploit the potential benefits of multi-arm bandit scheme in cooperative multiple-input multiple output (MIMO) wireless networks. In particular, we consider an online-policy for amplify-and-forward MIMO relay selection (RS), where relays are provided with uncertain channel state information (CSI). We design the RS policy as a sequential experience-driven learning algorithm with a contextual bandit (CB) approach, where the algorithm learns to select an optimal relay node using the imperfect CSI provided as a context vector and the past experience of rewards procured with current policy, with the aim of maximizing the cumulative mean reward over time. Further, with extensive simulation result, we demonstrate that proposed CB based RS policy achieves superior performance gains compared to conventional Gram-Schmidt method.
UR - http://www.scopus.com/inward/record.url?scp=85089434837&partnerID=8YFLogxK
U2 - 10.1109/ICC40277.2020.9148879
DO - 10.1109/ICC40277.2020.9148879
M3 - Conference contribution
AN - SCOPUS:85089434837
T3 - IEEE International Conference on Communications
BT - 2020 IEEE International Conference on Communications (ICC)
PB - IEEE
T2 - 2020 IEEE International Conference on Communications
Y2 - 7 June 2020 through 11 June 2020
ER -