• DocumentCode
    3117483
  • Title

    SmartClean: An Incremental Data Cleaning Tool

  • Author

    Oliveira, Paulo ; Rodrigues, Fátima ; Henriques, Pedro

  • Author_Institution
    Comput. Sci. Dept., Inst. of Eng. - Polytech. of Porto, Porto, Portugal
  • fYear
    2009
  • fDate
    24-25 Aug. 2009
  • Firstpage
    452
  • Lastpage
    457
  • Abstract
    This paper presents the SmartClean tool. The purpose of this tool is to detect and correct the data quality problems (DQPs). Compared with existing tools, SmartClean has the following main advantage: the user does not need to specify the execution sequence of the data cleaning operations. For that, an execution sequence was developed. The problems are manipulated (i.e., detected and corrected) following that sequence. The sequence also supports the incremental execution of the operations. In this paper, the underlying architecture of the tool is presented and its components are described in detail. The tool´s validity and, consequently, of the architecture is demonstrated through the presentation of a case study. Although SmartClean has cleaning capabilities in all other levels, in this paper are only described those related with the attribute value level.
  • Keywords
    data handling; software tools; SmartClean tool; data quality problems; execution sequence; incremental data cleaning tool; Cleaning; Computer science; Data analysis; Data engineering; Multidimensional systems; Performance analysis; Performance evaluation; Software quality; Software tools; Testing; Architecture; Correction; Data Cleaning; Data Quality Problems; Detection; Tool;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Quality Software, 2009. QSIC '09. 9th International Conference on
  • Conference_Location
    Jeju
  • ISSN
    1550-6002
  • Print_ISBN
    978-1-4244-5912-4
  • Type

    conf

  • DOI
    10.1109/QSIC.2009.67
  • Filename
    5381543