• DocumentCode
    12619
  • Title

    From Small-World Networks to Comparison-Based Search

  • Author

    Karbasi, Amin ; Ioannidis, Stratis ; Massoulie, Laurent

  • Author_Institution
    Sch. of Eng. an Appl. Sci. (SEAS), Yale Univ., New Haven, CT, USA
  • Volume
    61
  • Issue
    6
  • fYear
    2015
  • fDate
    Jun-15
  • Firstpage
    3056
  • Lastpage
    3074
  • Abstract
    The problem of content search through comparisons has recently received considerable attention. In short, a user searching for a target object navigates through a database in the following manner. The user is asked to select the object most similar to her target from a small list of objects. A new object list is then presented to the user based on her earlier selection. This process is repeated until the target is included in the list presented, at which point the search terminates. This problem is known to be strongly related to the small-world network design problem. However, contrary to prior work, which focuses on cases where objects in the database are equally popular, we consider here the case where the demand for objects may be heterogeneous. We show that, under heterogeneous demand, the small-world network design problem is NP-hard. Given the above negative result, we propose a novel mechanism for small-world design and provide an upper bound on its performance under heterogeneous demand. The above mechanism has a natural equivalent in the context of content search through comparisons, and we establish both an upper bound and a lower bound for the performance of this mechanism. These bounds are intuitively appealing, as they depend on the entropy of the demand as well as its doubling constant, a quantity capturing the topology of the set of target objects. They also illustrate interesting connections between comparison-based search to classic results from information theory. Finally, we propose an adaptive learning algorithm for content search that meets the performance guarantees achieved by the above mechanisms.
  • Keywords
    learning (artificial intelligence); query processing; small-world networks; NP-hard problem; adaptive learning algorithm; comparison-based search; content search; heterogeneous demand; information theory; performance guarantees; small-world network design problem; Databases; Entropy; Extraterrestrial measurements; Navigation; Search problems; Topology; Nearest neighbor searches; greedy algorithms; information entropy; routing protocols;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2015.2418284
  • Filename
    7078845