Optimal Design of Cosine Modulated Nonuniform Linear Phase FIR Filter Bank via Both Stretching and Shifting Frequency Response of Single Prototype Filter

This paper designs an optimal cosine modulated nonuniform linear phase finite impulse response (FIR) filter bank. The frequency responses of all the analysis filters and the synthesis filters of the filter bank are derived based on both stretching and shifting the frequency response of a single prototype filter. The total aliasing error of the filter bank is minimized subject to specifications on the maximum magnitude distortion of the filter bank and the maximum ripple magnitudes of the prototype filter over both the passband and the stopband. This paper proposes a joint constraint transcription and modified filled function method for solving the optimization problem. In particular, the functional inequality constraints are converted to discrete constraints via the constraint transcription method. The globally optimal solution of the nonconvex optimization problem can be found efficiently via the modified filled function method. Computer numerical simulation results show that our design outperforms existing designs.