Incremental update for data warehouse analysis!

增量数据同步与Oracle Streams
本文探讨了增量数据同步的两种主要策略:触发器和挖掘日志,并详细介绍了Oracle Streams的功能及其在数据仓库加载中的应用。CDC(变更数据捕获)技术通过异步方式实现数据的高效提取,而Oracle Streams则提供了更为灵活的数据共享机制。

For incremental update the popular strategy is trigger and mining log.

The materialized view and synchronous CDC is replicating data utilizing the trigger strategy.

Stream and asynchronous utilizing the mining log.

CDC(Change Data Capture) is designed for the incremental extract for ETL which can be divided by Asynchronous and synchronous. We need not synchronous. So let us analyze the asynchronous. CDC also provide the interface to stream.

CDC

Oracle Streams enables information sharing. Using Oracle Streams, each unit of shared

information is called a message, and you can share these messages in a stream. The

stream can propagate information within a database or from one database to another.

The stream routes specified information to specified destinations. The result is a

feature that provides greater functionality and flexibility than traditional solutions for

capturing and managing messages, and sharing the messages with other databases

and applications. Streams provides the capabilities needed to build and operate

distributed enterprises and applications, data warehouses, and high availability

solutions.

Stream

We can use stream for data warehouse loading.Data warehouse loading is a special case of data replication. Some of the most criticaltasks in creating and maintaining a data warehouse include refreshing existing data,and adding new data from the operational databases. Streams components can capture

changes made to a production system and send those changes to a staging database or

directly to a data warehouse or operational data store. Streams capture of redo data

avoids unnecessary overhead on the production systems. Support for data

transformations and user-defined apply procedures enables the necessary flexibility to

reformat data or update warehouse-specific data fields as data is loaded. In addition,

Change Data Capture uses some of the components of Streams to identify data that

has changed so that this data can be loaded into a data warehouse.

The difference between the CDC and stream.

CDC encapsulate the complex details for replication so it is simpler than stream.

Stream give you more option to meet you needs and provide the interface for user definition procedures.

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值