Research on Improved Increment Maintenance in Data Wearhouse

Today, In this paper, we describe a new increment maintenance algorithm, which is “increment maintenance algorithm based on multiple delta files”. It makes the smallest result sets of data warehouse loading and maintenance as real. In addition, it adopts multiple tiers infrastructure; by using data warehouse base, it links operation model OLTP environment and DDS/OLAP environment together. In both data warehouse base side and data warehouse side, we all use multiple version control mechanism to get the size of result sets dynamically and in data warehouse side, We use “increment maintenance methodology” at same time. Thereby, during the backend processes maintenance, we can use the smallest result sets for batch loading. Based on this design, it does not affect the data warehouse query operation, and in the meantime, it affects the OLAP and OLTP environment very slightly. This methodology and its infrastructure are very easy to implement and has very useful engineering reference values.