hi,
i want to know how can we implement the type-2 SCD in datasatge server jobs.
you pls tell me the stages used while implenting the type 2 SCD
implementation of type 2 scd
Moderators: chulett, rschirm, roy
-
- Charter Member
- Posts: 130
- Joined: Mon Sep 06, 2004 3:05 am
- Location: Dubai,UAE
Hello nkreddy_3,
A Type 2 SCD can be implemented in many ways in both the DWH as well as in the ETL tool.
Typically when you get a new column value in the SCD you will need to check it against it's value in the database; if it has changed you will need to update the old value and also to insert the new one.
Doing this lookup into the database can be slow, so often a hashed file is used to speed up this process. Thus you can successfully implement a simple SCD with just a transform and a hashed file stage (with one read and one update and one insert link going into it).
Depending on which tool and version you have, DataStage offers different stages for your use. For example there are CDC (changed data capture) stages available that can simplify your development and detection of changes in dimension values.
A Type 2 SCD can be implemented in many ways in both the DWH as well as in the ETL tool.
Typically when you get a new column value in the SCD you will need to check it against it's value in the database; if it has changed you will need to update the old value and also to insert the new one.
Doing this lookup into the database can be slow, so often a hashed file is used to speed up this process. Thus you can successfully implement a simple SCD with just a transform and a hashed file stage (with one read and one update and one insert link going into it).
Depending on which tool and version you have, DataStage offers different stages for your use. For example there are CDC (changed data capture) stages available that can simplify your development and detection of changes in dimension values.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 41
- Joined: Wed Mar 05, 2003 1:28 am