A Modified Invasive Weed Optimization Algorithm for training of feed- forward Neural Networks

Invasive Weed Optimization Algorithm (IWO) is an ecologically inspired metaheuristic that mimics the process of weeds colonization and distribution and is capable of solving multi-dimensional, linear and nonlinear optimization problems with appreciable efficiency. In this article a modified version of IWO has been used for training the feed-forward Artificial Neural Networks (ANNs) by adjusting the weights and biases of the neural network. It has been found that modified IWO performs better than another very competitive real parameter optimizer called Differential Evolution (DE) and a few classical gradient-based optimization algorithms in context to the weight training of feed-forward ANNs in terms of learning rate and solution quality. Moreover, IWO can also be used in validation of reached optima and in the development of regularization terms and non-conventional transfer functions that do not necessarily provide gradient information.