Automatic evaluation of adaptive algorithms over the Internet

We describe a system for the automatic evaluation of adaptive algorithms over the Internet. We motivate our discussion by setting up a system to evaluate region of interest finding algorithms. This is a signal processing/pattern recognition problem that occurs in many different application domains, and for which neural network solutions have been proposed as highly flexible and trainable solutions. However, we are not aware of any comprehensive empirical studies identifying the strengths and weaknesses of each method. The system we describe is able to automate such a study, and has the potential to be of great benefit to algorithm developers and the research community as a whole