How to calculate dataset size created during job execution

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
yjoshi
Premium Member
Premium Member
Posts: 1
Joined: Tue Nov 13, 2007 1:46 pm

How to calculate dataset size created during job execution

Post by yjoshi »

Need to estimate disk space required at any give point for DS job dataset created.Any formula or thumb fo rule to estimate
yjoshi
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

If you save the metadata for the column names in the link for the dataset then there is a routine in my downloads on my tips page to estimate disk space based on the length on records saved in DataStage. The source code is included so you can tweak the calculations. I think I used 80% of a varchar length. You need to make sure RCP is turned off going to this link otherwise you have columns which you may not know are there.
Mamu Kim
Post Reply