• DocumentCode
    17587
  • Title

    Improved Graph Clustering

  • Author

    Yudong Chen ; Sanghavi, Sujay ; Huan Xu

  • Author_Institution
    Dept. of Electr. Eng. & Comput. Sci., Univ. of California at Berkeley, Berkeley, CA, USA
  • Volume
    60
  • Issue
    10
  • fYear
    2014
  • fDate
    Oct. 2014
  • Firstpage
    6440
  • Lastpage
    6455
  • Abstract
    Graph clustering involves the task of dividing nodes into clusters, so that the edge density is higher within clusters as opposed to across clusters. A natural, classic, and popular statistical setting for evaluating solutions to this problem is the stochastic block model, also referred to as the planted partition model. In this paper, we present a new algorithm-a convexified version of maximum likelihood-for graph clustering. We show that, in the classic stochastic block model setting, it outperforms existing methods by polynomial factors when the cluster size is allowed to have general scalings. In fact, it is within logarithmic factors of known lower bounds for spectral methods, and there is evidence suggesting that no polynomial time algorithm would do significantly better. We then show that this guarantee carries over to a more general extension of the stochastic block model. Our method can handle the settings of semirandom graphs, heterogeneous degree distributions, unequal cluster sizes, unaffiliated nodes, partially observed graphs, planted clique/coloring, and so on. In particular, our results provide the best exact recovery guarantees to date for the planted partition, planted k-disjoint-cliques and planted noisy coloring models with general cluster sizes; in other settings, we match the best existing results up to logarithmic factors.
  • Keywords
    convex programming; graph colouring; maximum likelihood estimation; social networking (online); stochastic processes; convex optimization; edge density; graph clustering; heterogeneous degree distributions; maximum likelihood estimation; planted clique; planted k-disjoint-cliques; planted noisy coloring models; planted partition model; semirandom graphs; stochastic block model; Algorithm design and analysis; Clustering algorithms; Computational modeling; Maximum likelihood estimation; Partitioning algorithms; Standards; Stochastic processes; Graph clustering; convex optimization; maximum likehood estimator; stochastic block model;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2014.2346205
  • Filename
    6873307