Multi-sensor data fusion based on dynamic fuzzy neural network

In this paper, a multi-sensor data fusion method based on dynamic fuzzy neural network (DFNN) for object recognition is proposed.DFNN is composed of two individual fuzzy neural networks. During the practical recognition process, one fuzzy neural network is used for recognition while the other is tracking trained. At the appropriate time the role of the two networks can be exchanged according to certain switching rule. The fusion recognition system is composed of two layers. At the first layer, the features extracted from middle wave and long wave infrared images are fused by DFNN to detect potential regions which may contain objects. And then the features extracted from visible image are utilized to make recognition in these potential regions based on DFNN at the second layer. The experiment demonstrates the efficiency of the proposed method.