Search found 6797 matches

by DSguru2B
Fri Dec 15, 2006 11:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Large file to split
Replies: 15
Views: 3913

True. Use this amazing post by vmcburney to handle partition numbers and number of partitions. Constraint it accordingly.
by DSguru2B
Fri Dec 15, 2006 11:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: a file contains characters with high ascii values
Replies: 9
Views: 1607

Shifting of values with two delimiters will not increase the delimiters. SOmething else is happening. For some reason you are getting more delimiters.
by DSguru2B
Fri Dec 15, 2006 11:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Bypassing notification activity in a sequencer
Replies: 35
Views: 9528

What are you trying to do here. Are you trying to see if there are any files present. Then you need to provide

Code: Select all

ls /fully/qualified/path | wc -l

this will tell you all the files. Well not all. Files that start with a dot (.) will not be counted.
by DSguru2B
Fri Dec 15, 2006 11:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSSendMail Does Not Execute or Hangsl
Replies: 5
Views: 2627

Got to the routine itself and try sending an email. Test it from there. See if that hangs as well.
by DSguru2B
Fri Dec 15, 2006 11:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: lookup on hash file
Replies: 7
Views: 1268

Build the hashed file again. This way it will be refreshed by the most currect records.
by DSguru2B
Fri Dec 15, 2006 10:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: populating date column to table
Replies: 5
Views: 931

TIMESTAMP() converts Internal Date format to Timestamp format (YYYY-MM-DD 00:00:00). You were not providing it internal format. If you really want to use TIMESTAMP() then do this

Code: Select all

TIMESTAMP(ICONV(in.Col,"DMDY[2,2,4]"))

by DSguru2B
Fri Dec 15, 2006 10:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: a file contains characters with high ascii values
Replies: 9
Views: 1607

Ok your confusing me now. What file had correct number of records before and after the conversion? and what is this raw file? you mean one file has unprintable characters and the other one does not?
by DSguru2B
Fri Dec 15, 2006 10:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: a file contains characters with high ascii values
Replies: 9
Views: 1607

Read about OCONV with MCP. It does exactly what it says. Changes the unprintable characters to a dot (.) Can you split the records that have more than 127 delimiters after the conversion and examine what changed before and after the conversion. Thats the best advice i can give you from here.
by DSguru2B
Fri Dec 15, 2006 10:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Large file to split
Replies: 15
Views: 3913

If your on server engine then use a link partitioner to achieve this. If your on PX then your condition should work. for the first link have @INROWNUM < 10000 for second have @INROWNUM >= 10000 and @INROWNUM <20000 and so on.... What error are you getting ? You can also split the file at the os leve...
by DSguru2B
Fri Dec 15, 2006 9:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: a file contains characters with high ascii values
Replies: 9
Views: 1607

So according to what i understood, you are supposed to have 127 columns, but when you run OCONV with MCP on the file, you have columns greater than 127 in a few rows. How do you know you are getting columns greater than 127 ? Are you doing a count on the delimiter or the view data on the sequential ...
by DSguru2B
Fri Dec 15, 2006 9:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Large file to split
Replies: 15
Views: 3913

Re: Large file to split

vsi wrote:Now in order to split this file into separate files i don't know the metadata.

Please help me to solve this issue.


Remember. Datastage is metadata driven. Even file split logic will be metadata driven. If you have no idea about the meta data, how are you going to split the file :roll: ?
by DSguru2B
Fri Dec 15, 2006 9:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: populating date column to table
Replies: 5
Views: 931

Depends upon whats the oracle date field. Is it just date or timestamp If its date use this OCONV(ICONV(in.Col,"DMDY[2,2,4]"),"D-YMD[4,2,2]") If its timestamp then use this OCONV(ICONV(in.Col,"DMDY[2,2,4]"),"D-YMD[4,2,2]"):"...
by DSguru2B
Fri Dec 15, 2006 9:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Validating email id field
Replies: 13
Views: 3643

Dont know if that could be done with DS. But here is what i could come up. Contains validation checks only. Validation checks as follows -Check for Zero Length/NULL Email Address -Makes sure Length of email address is greater than 6 as the shortest email address to be found on the net is of length 6...
by DSguru2B
Fri Dec 15, 2006 7:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Validating email id field
Replies: 13
Views: 3643

Hmm. Interesting. Lets think about the logic and how to verifty the validity. But i am sure this is above the requirement of the OP, but a very interesting task. Dont know if its possible though without actually emailing the person, resulting in a lot of non-sense mail to the mailing addresses every...
by DSguru2B
Fri Dec 15, 2006 7:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Save doublon
Replies: 22
Views: 5972

If you get any key violation, the warning will be created. Thats why you need to explicitly handle it by the method devised, and capture the duplicates in a seperate file. This way you dont send any duplicates. Says who. I did, right there thurmy34: Go to Sequential file stage, go to properties, on...