• DocumentCode
    1320223
  • Title

    f -Divergence Estimation and Two-Sample Homogeneity Test Under Semiparametric Density-Ratio Models

  • Author

    Kanamori, Takafumi ; Suzuki, Taiji ; Sugiyama, Masashi

  • Author_Institution
    Dept. of Comput. Sci. & Math. Inf., Nagoya Univ., Nagoya, Japan
  • Volume
    58
  • Issue
    2
  • fYear
    2012
  • Firstpage
    708
  • Lastpage
    720
  • Abstract
    A density ratio is defined by the ratio of two probability densities. We study the inference problem of density ratios and apply a semiparametric density-ratio estimator to the two-sample homogeneity test. In the proposed test procedure, the f-divergence between two probability densities is estimated using a density-ratio estimator. The f -divergence estimator is then exploited for the two-sample homogeneity test. We derive an optimal estimator of f-divergence in the sense of the asymptotic variance in a semiparametric setting, and provide a statistic for two-sample homogeneity test based on the optimal estimator. We prove that the proposed test dominates the existing empirical likelihood score test. Through numerical studies, we illustrate the adequacy of the asymptotic theory for finite-sample inference.
  • Keywords
    probability; statistical testing; asymptotic theory; asymptotic variance; empirical likelihood score test; f-divergence estimation; finite-sample inference; inference problem; optimal estimator; probability density; semiparametric density-ratio estimator; two sample homogeneity test; Convergence; Estimation; Manganese; Optimized production technology; Probability distribution; Random variables; Asymptotic expansion; density ratio; divergence; semiparametric model; two-sample test;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2011.2163380
  • Filename
    6018305