What is the difference between Full load and Incremental load

In most OBIA projects we create both incremental and full load mappings for each tables in Date Warehouse target. Below you can find the difference between both.

Full Load is the entire data dump load taking place the very first time. In this we give the last extract date as empty so that all the data gets loaded

Incremental - Where difference between target and source data is dumped at regular intervals.Here we give the last extract date such that only records after this date are loaded.

Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
Full Load: Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded.
Incremental Load: Last_Extract_Date = The date from which you need the data (to get latest record).

Why Incremental:
  • Speed.
  • Preserving history


Full Load vs Incremental Load:


Full Load
Incremental Load
Truncates all rows and loads from scratch.
New records and updated ones are loaded
Requires more time.
Requires less time.
Can easily be guaranteed
Difficult. ETL must check for new/updated rows.
Can be lost.
Retained.

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值