How can I get rid of duplicates on columns using datastage?
![Question :?:](./images/smilies/icon_question.gif)
My file looks like this:
ArmConvOpt,ArmIndexCode,ArmNegAmrFlag,ArmRoundFlag,BorrSelfEmpFlag,BorrSex,CoBorrSex,DocumentCode,DwellTypeCode,LimitDocFlag
NONE,100,,N/A,,,,,AUCTION,WHO KNOWS
NONE,100,,N/A,,,,,AUCTION,0
NONE,0,,N/A,,,,,0,0
NONE,0,,0,,,,,FAM,0
NONE,0,,0,,,,,FAM,NO INCOME/ FULL ASSET
N/A,ERROR,,0,,,,,0,XX
N/A,ERROR,,0,,,,,0,0
Needs to look like this:
ArmConvOpt,ArmIndexCode,ArmNegAmrFlag,ArmRoundFlag,BorrSelfEmpFlag,BorrSex,CoBorrSex,DocumentCode,DwellTypeCode,LimitDocFlag
NONE,100,,N/A,,,,,AUCTION,WHO KNOWS
N/A,ERROR,,,,,,,FAM,NO INCOME/ FULL ASSET
,,,,,,,,,100
,,,,,,,,,XX
the row order does not matter, just need to get rid of duplicates in each column.
Your help is much apprechated!!
![Smile :)](./images/smilies/icon_smile.gif)
Thanks