Drosophila eye nuclei segmentation based on graph cut and convex shape prior

The rapid advance in three-dimensional (3D) confocal imaging technologies is rapidly increasing the availability of 3D cellular images. However, the lack of robust automated methods for the extraction of cell or organelle shapes from the images is hindering researchers ability to take full advantage of the increase in experimental output. The lack of appropriate methods is particularly significant when the density of the features of interest in high, such as in the developing eye of the fruit fly. Here, we present a novel and efficient nuclei segmentation algorithm based on the combination of graph cut and convex shape prior. The main characteristic of the algorithm is that it segments nuclei foreground using a graph cut algorithm and splits overlapping or touching cell nuclei by simple convex and concavity analysis, using a convex shape assumption for nuclei contour. We evaluate the performance of our method by applying it to a library of publicly-available two-dimensional (2D) images that were hand-labeled by experts. Our algorithm yields a substantial quantitative improvement over other methods for this benchmark. For example, our method achieves a decrease of 3.2 in the Hausdorff distance and an decrease of 1.8 per slice in the merged nuclei error.