DocumentCode :
3321286
Title :
Real Time Delta Extraction Based on Triggers to Support Data Warehousing
Author :
Valencio, Carlos Roberto ; Marioto, Matheus Henrique ; Donega Zafalon, Geraldo Francisco ; Machado, Jose Marcio ; Momente, Julio Cesar
Author_Institution :
Dept. de Cienc. de Comput. e Estatistica, Sao Paulo State Univ., São José do Rio Preto, Brazil
fYear :
2013
fDate :
16-18 Dec. 2013
Firstpage :
293
Lastpage :
297
Abstract :
Nowadays large corporations require integrated data from diverse sources, leading to the use of data warehouse architectures for this purpose. To bypass problems related to the use of computational resources to process large volumes of data, an ETL (Extract, Transform and Load) technique with zero latency can be used, that works by constantly processing small data loads. Among the extraction techniques of the zero latency ETL are the use of logs, triggers, materialized views and timestamps. This paper proposes a structure capable of performing this task by means of triggers and a tool developed for the automatic generation of the SQL (Structured Query Language) code to create these trigger, besides showing its performance and comparing it to other techniques. Said method is relevant for the extraction of portions of selected information as it permits to combine conventional and real time ETL techniques.
Keywords :
SQL; data warehouses; program compilers; ETL technique; automatic SQL code generation; data warehouse architectures; extract-transform-load technique; integrated data; real time delta extraction; small data load processing; structured query language; zero latency; Computer architecture; Data mining; Data warehouses; Databases; Real-time systems; Scalability; Warehousing; CDC (Change Data Capture); ETL (Extract; Transform and Load); automatic code generation; data warehouse; trigger;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Parallel and Distributed Computing, Applications and Technologies (PDCAT), 2013 International Conference on
Conference_Location :
Taipei
Print_ISBN :
978-1-4799-2418-9
Type :
conf
DOI :
10.1109/PDCAT.2013.52
Filename :
6904269
Link To Document :
بازگشت