Search found 15603 matches

by ArndW
Wed Nov 11, 2009 7:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: seqential file issue
Replies: 2
Views: 1262

It looks like you specified "binary" for the decimal output field in your column attributes.
by ArndW
Wed Nov 11, 2009 6:03 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Generating a DS sequence job
Replies: 12
Views: 5734

If you create a minimalistic template sequence, how many changes would each one need? If they are simple, you could write a small program to make those changes on an exported copy (.dsx or .xml as you prefer) that would include renaming the sequence and then importing that changed version.
by ArndW
Wed Nov 11, 2009 5:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Generating a DS sequence job
Replies: 12
Views: 5734

The Job control code is autogenerated but written in DS/Basic. Are the jobs similar enough that you could just write one generic job and pass everything in as parameters, including your SQL?
by ArndW
Wed Nov 11, 2009 5:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Generating a DS sequence job
Replies: 12
Views: 5734

this might be a bit out of the scope of normal DataStage, but the backbone of the Server engine is the DS/BASIC language on top of what used to be the UniVerse DB. This language should allow you to generate the programs in question. It is more of a matter of defining what needs to be done and what i...
by ArndW
Wed Nov 11, 2009 1:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: main_program: Internal Error: (0):util/pathutils.C: 403
Replies: 4
Views: 2972

add the command "ulimit -a" as a before-job shell call, then see what your open files limit is displayed as at runtime.
by ArndW
Wed Nov 11, 2009 1:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: a complex requirment.
Replies: 9
Views: 1925

Use stage variables to store the distinct column headers from the first row, i.e. SvarCol2 is "IF NOT(In.Col2) THEN In.Col2 ELSE SvarCol2". Then derive your output columns from the data and your stage variables. Manually add a line terminator after the column value and write to a sequentia...
by ArndW
Tue Nov 10, 2009 10:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: unable to remove non printable characters
Replies: 10
Views: 8466

Do you have NLS enabled - 0xA0 is a small a egu character and is, I think, a printable character but you would have to check your NLS.LC.TYPE file (I think that was the name), or just write a 1-line BASIC routine that returns LEN(OCONV(SEQ(160),'MCP')).
by ArndW
Tue Nov 10, 2009 10:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning with dataset.
Replies: 1
Views: 1132

As part of the deletion process, DataStage renames the actual data files linked to by the descriptor to "...being_deleted", and then actually removes them at a later part of the delete. This usually only takes milliseconds but for same reason the last attempt was unsuccessful in removing t...
by ArndW
Tue Nov 10, 2009 9:02 am
Forum: General
Topic: Files in /tmp
Replies: 2
Views: 1054

Craig's suggestion should to the trick.
by ArndW
Tue Nov 10, 2009 9:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warinings from a Routine
Replies: 2
Views: 1294

If the routine generates warnings then it contains calls to DSLogWarn() which you can modify to just call DSLogInfo(). I would hesitate to recommend doing that unless you are certain that the warning are unavoidable and won't affect your job run.
by ArndW
Tue Nov 10, 2009 6:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to initialize plug-in
Replies: 33
Views: 22793

The prefix of "." and a space before the "./dsenv" script call is very important, otherwise the script is executed in a different shell and the values set are lost; that seems to be happening in your case.
by ArndW
Tue Nov 10, 2009 3:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SLOW CHANGE DIMENSION
Replies: 1
Views: 1030

babuselvan, looking at your posts over the past few days they are all 1 liners whose answers are to be found either directly in the documentation or are general ETL questions that can be googled... This really looks like you are looking for answers to interview questions. Have you read the Parallel ...
by ArndW
Tue Nov 10, 2009 3:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Convert Binary to Decimal in PX 8.0.1
Replies: 6
Views: 1896

The issue might be urgent for you, but not to DSXchange. Ray puts it into a much nicer wording than I do. "Binary" just means non-ascii unless you specify what format it is in. Without knowing what format it is, no conversion is possible. But my first guess is that you are looking at more ...
by ArndW
Tue Nov 10, 2009 2:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Performance improvements tips
Replies: 13
Views: 5548

My point is that if the data is already partially sorted coming then writing to a dataset will lose that "work", so in that case another storage method should be used.
by ArndW
Tue Nov 10, 2009 2:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Degree ° symbol issue from DB2 on AS/400
Replies: 4
Views: 5963

The 0x90 character is not mapped as part of standard EBCDIC, but is present in some variations. I don't know exactly which version is in use on your AS/400 system, but if you get that information and use that character map in APT_EBCDIC_VERSION the degree sign (and possibly other extended characters...