Add a "DataStage Project Stories" Folder
Posted: Thu Aug 18, 2005 11:22 am
I would enjoy seeing a new Forum on this site into which posters can put down some of their DataStage achievements - not necessarily as personal ones, but showing what results they have achieved with DataStage in their projects recently. I for one love to read about what has been done, how it was achieved and perhaps also how long it took to produce and run.
I hope to hear from the other forumites on whether or not they think this is a good idea...
What triggered it was something we just finished here / perhaps an example post to the forum:
Transferred 3.5 Terabytes from mainframe DB/2 to AIX Oracle using DataStage PX. This included new partitioning algorithms, null handling and data conversions and some column re-mapping; every single column had to be modified; a total of 350 tables and about 22,000 columns. Instead of writing a job per table manually, we wrote a Server Job which in turn created one PX job per Table using table-driven rules and exceptions (i.e. DB/2 Column called "YEAR", Oracle called "IDYEAR"). Total time for this ended up being 2 person-consulting-weeks; the DBAs had originally specd this (using database dumps and custom SQL) at over 1 month plus 1500 hours runtime (that's over 60 days!)
I hope to hear from the other forumites on whether or not they think this is a good idea...
What triggered it was something we just finished here / perhaps an example post to the forum:
Transferred 3.5 Terabytes from mainframe DB/2 to AIX Oracle using DataStage PX. This included new partitioning algorithms, null handling and data conversions and some column re-mapping; every single column had to be modified; a total of 350 tables and about 22,000 columns. Instead of writing a job per table manually, we wrote a Server Job which in turn created one PX job per Table using table-driven rules and exceptions (i.e. DB/2 Column called "YEAR", Oracle called "IDYEAR"). Total time for this ended up being 2 person-consulting-weeks; the DBAs had originally specd this (using database dumps and custom SQL) at over 1 month plus 1500 hours runtime (that's over 60 days!)