Regenerative multi-way relaying: Joint transceiver design in space-time domain

In this paper, we study the regenerative multi-way relaying (MWR) network where single-antenna users exchange data with each other via a multi-antenna relay. By considering the broadcast phase as a particular space-time channel, we jointly design the relay transmitter and user receivers, aiming to minimize the total mean square error (T-MMSE). As a consequence, an effective multiple-input multiple-output (MIMO) channel with full rank has been established between the relay and each user. Due to the coupled transceiver structure, we propose an iterative algorithm to obtain a converged transceiver. Finally, simulation results evidence that the jointly designed transceiver performs well, even in the overloaded scenario.