Search found 30 matches

by Lucky
Tue Oct 03, 2006 8:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

1. Agree with you that there is no need to use Sorter Stage as all the records are being collected into an intermediate file which is then being used as a Source. 2. I should process one file at a time and the file will have one Header and one Trailer record. 3. Platform being used is Windows. So I ...
by Lucky
Tue Oct 03, 2006 7:12 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

Ray, Yes I meant Sort stage. I agree with your suggestion about the performance issues if we use a sort stage, but I am very new to data stage and still getting used it and still exploring the options available in DS. I have worked on Informatica so I am using that knowledge to create jobs in data s...
by Lucky
Tue Oct 03, 2006 6:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

Hi Ray/Shane, I have just finished working on this job. The logic I have followed: 1. Read all the columns in a row as a string into a transformer ( as suggested in the earlier posts by Shane). 2. Use a stage variable to get the Trailer/ Details rec types (the first field in each string record is th...
by Lucky
Tue Oct 03, 2006 5:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

Hi All, There is some more logic to be implemented in this job. 1. Need to check if both Trailer (T) and Header (H) records are present in the file. 2. The Detail (D) records should be processed only if the file consists of both Header and Trailer records. 3. The Trailer will have date, time and ID ...
by Lucky
Tue Oct 03, 2006 1:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

Hi Shane, Kirti,loveojha2,

Thanks a lot for your quick responses.

I have got the job to perform what I wanted.

Shane: I have simply followed your solution and included my logic and it worked straight away.

Thank you all for your time.
by Lucky
Tue Oct 03, 2006 12:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

I think I should have stressed more on the Reading Data from the file than the logic which follows after reading the data. The issue I am facing now is reading data from the file with rows consisting of different number of fields. H -> 7 Fields D -> 4 Fields T -> 8 Fields Please let me know if ther...
by Lucky
Mon Oct 02, 2006 11:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

Hi,

The issue is when you take 5 columns into the transformer and if one of the records consists of less than 5 or more than 5 columns then data stage issues an error. I am looking for an option where data stage can read rows consisting different number of columns from a file.
by Lucky
Mon Oct 02, 2006 11:12 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: extract data from file different num of fields in each row
Replies: 22
Views: 7600

extract data from file different num of fields in each row

Hi, I have a situation where I have to extract data from a file with rows in the file contain independent set of fields. ex: row1 -> rec_type, id,name,qualification row2 -> rec_type,country,state,place,location row3 -> rec_type,num_of_rows,file_date,file_time Depending the rec_type , I have to load ...
by Lucky
Thu Sep 28, 2006 4:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unziping file from Windows environment
Replies: 25
Views: 11641

Thanks Craig and ArndW,

I m sure that there is no existing files in the directory, also i have corss checked and there is no file with that name to ask for replacing the existing file.


Regards,
by Lucky
Thu Sep 28, 2006 3:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unziping file from Windows environment
Replies: 25
Views: 11641

It is not prompting anything when i run from command line and working fine

Regards,
by Lucky
Thu Sep 28, 2006 2:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unziping file from Windows environment
Replies: 25
Views: 11641

Hi ArndW , I have searched c:\ and d:\ ,files are not extracted any where else, And I m able to do copying file form one location to another location using ExecDOS from Before job subroutine and also using the command "d:\progra~1\winzip\winzip32.exe -min -e c:\File_Name.zip c:\ |dir" from...
by Lucky
Wed Sep 27, 2006 10:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unziping file from Windows environment
Replies: 25
Views: 11641

Hi ArndW, Ray , DSGuru2B
Thanks for u r responses,
I think i m giving complete path in the command, will u pl tell me where i have to give paths other than d:\progra~1\winzip\ , c:\ in "d:\progra~1\winzip\winzip32.exe -min -e c:\File_Name.zip c:\ |dir


Regards
by Lucky
Wed Sep 27, 2006 1:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unziping file from Windows environment
Replies: 25
Views: 11641

Hi,

I have the compatible command line support installed on the machine and as I have already mentioned, the command works when executed from the command prompt.

But I am not successfull in doing the same from DS.
by Lucky
Wed Sep 27, 2006 12:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unziping file from Windows environment
Replies: 25
Views: 11641

Hello All, Any idea about this problem??? We are using DataStage version 7.1, O/S: Windows 2000, WinZIP version: 9.0 with command line support. If anyone has ever tried this one, please let me know how to go about this problem. I have tried all the options 1. Calling ExecDOS in before Job Routine by...
by Lucky
Tue Sep 26, 2006 11:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to remove additional zeros in a record using Transformer
Replies: 12
Views: 13277

Hi,

As far as I know Trim function works for Varchar data type. You cannot use Trim for fields which are of Char data type.

Please correct me if I am wrong.