Median K-Flats for hybrid linear modeling with many outliers

We describe the Median K-flats (MKF) algorithm, a simple online method for hybrid linear modeling, i.e., for approximating data by a mixture of flats. This algorithm simultaneously partitions the data into clusters while finding their corresponding best approximating ¿₁ d-flats, so that the cumulative ¿₁ error is minimized. The current implementation restricts d-flats to be d-dimensional linear subspaces. It requires a negligible amount of storage, and its complexity, when modeling data consisting of N points in ¿^D with K d-dimensional linear subspaces, is of order O(n_s · K · d · D + n_s · d² · D), where n_s is the number of iterations required for convergence (empirically on the order of 10⁴). Since it is an online algorithm, data can be supplied to it incrementally and it can incrementally produce the corresponding output. The performance of the algorithm is carefully evaluated using synthetic and real data.