• DocumentCode
    1824349
  • Title

    Problems and available solutions on the stage of Extract, Transform, and Loading in near real-time data warehousing (a literature study)

  • Author

    Wibowo, Ardianto

  • Author_Institution
    Dept. of Inf. Eng., Politek. Caltex Riau, Pekanbaru, Indonesia
  • fYear
    2015
  • fDate
    20-21 May 2015
  • Firstpage
    345
  • Lastpage
    350
  • Abstract
    In the traditional ETL (Extract Transform Loading), refreshment of data warehouse must be done in off peak hours. It means that all operational and analysis stopped from their all activities. It cause the level of freshness of data in the data warehouse is not indicating the latest operational transaction. This problem is called by data latency. Near real time data warehousing is used to be a solution for this problem. It update data warehouse in near real time manner, immediately after change data detected in data source. Thus, data latency can be minimized. In development, near real time data warehousing have problems where previously not found on the traditional ETL. This paper aims to convey the problems and available solutions at each stage in the near real time data warehousing, i.e. extraction, transformation, and loading. The problems and available solutions are based on literature review from other research that focusing on near real time data warehousing problem.
  • Keywords
    data integration; data warehouses; ETL; data latency; data source; extract transform loading; real-time data warehousing; Data mining; Data warehouses; Loading; Real-time systems; Taxonomy; Transforms; Warehousing; Data Latency; Data Warehouse; ETL; Near Real Time Data Warehousing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Technology and Its Applications (ISITIA), 2015 International Seminar on
  • Conference_Location
    Surabaya
  • Print_ISBN
    978-1-4799-7710-9
  • Type

    conf

  • DOI
    10.1109/ISITIA.2015.7220004
  • Filename
    7220004