Joint Multi-Filter Design for Full-Duplex MU-MIMO Relaying

In full-duplex multiuser multiple-input multiple-output (MU-MIMO) relaying in which a base station (BS) communicates with mobile stations (MSs) via a relay station (RS) using multiple antennas, in addition to the inter-antenna/multi- stream interference issue, the loop interference caused by simultaneously transmitting and receiving signals at the RS is also a concern. This paper proposes joint multi-filter design schemes that design the inter-antenna/multi-stream interference suppression and loop interference cancellation filters to minimize the total mean squared error of the received signal at the MSs. Simulation results confirm that the proposed schemes outperform the conventional scheme in which the inter-antenna/multi-stream interference suppression and loop interference cancellation filters are designed independently.