DocumentCode
1824349
Title
Problems and available solutions on the stage of Extract, Transform, and Loading in near real-time data warehousing (a literature study)
Author
Wibowo, Ardianto
Author_Institution
Dept. of Inf. Eng., Politek. Caltex Riau, Pekanbaru, Indonesia
fYear
2015
fDate
20-21 May 2015
Firstpage
345
Lastpage
350
Abstract
In the traditional ETL (Extract Transform Loading), refreshment of data warehouse must be done in off peak hours. It means that all operational and analysis stopped from their all activities. It cause the level of freshness of data in the data warehouse is not indicating the latest operational transaction. This problem is called by data latency. Near real time data warehousing is used to be a solution for this problem. It update data warehouse in near real time manner, immediately after change data detected in data source. Thus, data latency can be minimized. In development, near real time data warehousing have problems where previously not found on the traditional ETL. This paper aims to convey the problems and available solutions at each stage in the near real time data warehousing, i.e. extraction, transformation, and loading. The problems and available solutions are based on literature review from other research that focusing on near real time data warehousing problem.
Keywords
data integration; data warehouses; ETL; data latency; data source; extract transform loading; real-time data warehousing; Data mining; Data warehouses; Loading; Real-time systems; Taxonomy; Transforms; Warehousing; Data Latency; Data Warehouse; ETL; Near Real Time Data Warehousing;
fLanguage
English
Publisher
ieee
Conference_Titel
Intelligent Technology and Its Applications (ISITIA), 2015 International Seminar on
Conference_Location
Surabaya
Print_ISBN
978-1-4799-7710-9
Type
conf
DOI
10.1109/ISITIA.2015.7220004
Filename
7220004
Link To Document