Search found 42189 matches

by chulett
Fri Jul 19, 2013 6:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Create output file names based on data in a column
Replies: 21
Views: 7827

That's the problem - "all my lines". Ray responded as he did because you said you needed your output to be: 1;2;3;4;5;6;8 You showed a subset of your input fields in the output. Everything before this point assumed a simple concatenation of one record to the next without any 'intelligence'...
by chulett
Thu Jul 18, 2013 9:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: What does 'output row only once' will do in filter
Replies: 15
Views: 5419

Perhaps you should mention the actual error or issue. Ah... Please do not put needed information in the subject when replying as others will not be able to see it unless they start a reply, like I just did. "Re: It will not pass the record to second where condition..." Is this your "f...
by chulett
Thu Jul 18, 2013 7:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Validation with reference tables
Replies: 4
Views: 1842

Or just use five lookups.
by chulett
Thu Jul 18, 2013 7:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Random number generation
Replies: 11
Views: 4558

You are missing the fundamental issue: random does not equal unique. Yes, using a unique seed each run will ensure that the sequence of random numbers generated is always different but there's no guarantee that they will be unique within a run and certainly not across runs. It seems that the latter ...
by chulett
Thu Jul 18, 2013 7:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Timestamp to Varchar conversion
Replies: 1
Views: 1496

Can you post your actual (full) unedited error? And your example shows "MMDDYYYY" format, why are you using "YYYYMMDD" in your conversion? If your input is an actual timestamp you should be able to use TimestampToString() directly.
by chulett
Wed Jul 17, 2013 11:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How can we import data from RT_LOG files
Replies: 7
Views: 3976

One of my rules is to never run anything with unlimited errors. Keep the warning limit small so you can get some error information logged but you don't blow out the logs in the process.
by chulett
Wed Jul 17, 2013 11:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: issue using sequential file
Replies: 3
Views: 1138

Your metadata needs to match the file format. For example, in a "csv" file you'll need to tell it the field delimiter is a comma. Since you haven't, everything goes into the first column.
by chulett
Wed Jul 17, 2013 7:40 am
Forum: General
Topic: Repository structure folders on a routine
Replies: 6
Views: 2466

Others may know more better than me on the DSGetJobInfo() thing as I can't test as I have no DataStage access. I do seem to recall that the command line dsjob version does include that information but you don't really want to be shelling out to the O/S on every row. Otherwise a lookup to a Universe ...
by chulett
Wed Jul 17, 2013 7:23 am
Forum: General
Topic: Repository structure folders on a routine
Replies: 6
Views: 2466

I'm not aware of any DSGetJobInfo InfoType that would return the category, you may need to query the repository directly if you need that.
by chulett
Wed Jul 17, 2013 6:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Random number generation
Replies: 11
Views: 4558

Details please. A single number each run or several over the course of the run? And does it really need to be 'random', meaning would a surrogate (unique but sequential) not work?
by chulett
Wed Jul 17, 2013 6:33 am
Forum: General
Topic: Repository structure folders on a routine
Replies: 6
Views: 2466

How is your job designed, what sources and/or API are you using? The 'folder' is called CATEGORY in the DS_JOBS table, by the way.
by chulett
Tue Jul 16, 2013 9:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data from Log File
Replies: 11
Views: 4123

So that's what you meant by "make it some number". Based on your description and the subject of your post I thought you wanted to extract it as "data from the log file" and convert it from a string to a number, not mask it. Always helps to fully explain what you are trying to do ...
by chulett
Tue Jul 16, 2013 4:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: transform data based upon columns and date
Replies: 1
Views: 904

Start by spelling out your requirements - your transformation rules - in words.
by chulett
Tue Jul 16, 2013 4:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data from Log File
Replies: 11
Views: 4123

You never mentioned that part in your original post, I was under the impression all you wanted were the SSN values which is why I provided the answer that I did. Can you be more specific with regards to exactly what your end result should be?
by chulett
Tue Jul 16, 2013 2:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data from Log File
Replies: 11
Views: 4123

Read the records as one long string field, filter out any that do not start with 'SSN:' and then use Field() to get the second field from that ":" delimited string. Convert.