• DocumentCode
    3746718
  • Title

    Searching for effects in big data: Why p-values are not advised and what to use instead

  • Author

    Marko A. Hofmann

  • Author_Institution
    ITIS, University of the Federal Armed Forces Munich, Werner-Heisenberg-Weg 39, Neubiberg 85577, Germany
  • fYear
    2015
  • Firstpage
    725
  • Lastpage
    736
  • Abstract
    P-values of null hypothesis significance testing have long been the standard and decisive measure of deductive statistics. However, for decades, top statistical methodologists have argued that focusing on p-values is not conducive to science, and that these tests are regularly misunderstood. The standard replacement or at least complement proposed for p-values by those critics are confidence intervals and statistical effects sizes. Regrettably, analyzing and comparing huge data sets (from data mining or simulation based data farming) with two measures is awkward. As a single-value measure of first interpretation for the scanning of Big Data this article proposes statistically secured effect sizes either based on exact, mathematically sophisticated confidence intervals for effect sizes or simplified approximations. It is further argued that simplified secured effect sizes are among the most instructive single measures of statistical interpretation completely perspicuous for the layman.
  • Keywords
    "Standards","Data models","Big data","Sociology","Statistics","Cognition","Testing"
  • Publisher
    ieee
  • Conference_Titel
    Winter Simulation Conference (WSC), 2015
  • Electronic_ISBN
    1558-4305
  • Type

    conf

  • DOI
    10.1109/WSC.2015.7408210
  • Filename
    7408210