Search found 53125 matches

by ray.wurlod
Wed May 11, 2011 3:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with getting table row counts using DataStage
Replies: 6
Views: 7457

My preferred mechanism is to use a tr command at the end of the UNIX command pipeline to translate the newlines into something else (usually pipe, but comma is OK if there are no commas in your data). For example ls -1 filepattern | tr '\n' '|' Of course, this may have an empty line at the end, but ...
by ray.wurlod
Tue May 10, 2011 8:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with getting table row counts using DataStage
Replies: 6
Views: 7457

My experience is that, when the final item in the list fails, it is usually for this reason. You can add an extra command to your UNIX command pipeline to remove empty final line, or you can interpolate a user variables activity to achieve the same end.
by ray.wurlod
Tue May 10, 2011 8:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copying Surrogate state files - Will the values remain?
Replies: 10
Views: 4163

What do you think will happen, and why? Have you examined one of your extant state files?
by ray.wurlod
Tue May 10, 2011 4:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with getting table row counts using DataStage
Replies: 6
Views: 7457

Do you have an empty line at the end of the list?
by ray.wurlod
Tue May 10, 2011 4:23 pm
Forum: General
Topic: scheduling the job using UNIX script
Replies: 10
Views: 3865

If you're using the dsjob command, then the project name is specified on the command line. If you are using the same project names in both versions, then specify the full pathname of the dsjob command (that is, from the correct engine) and make sure that the correct dsenv script has been executed an...
by ray.wurlod
Tue May 10, 2011 4:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate key generator generating improper sequence
Replies: 7
Views: 2322

But it doesn't matter.

A surrogate key provides uniqueness, just uniqueness, and nothing but uniqueness. There's neither guarantee nor requirement that the numbers will form any kind of sequence.
by ray.wurlod
Tue May 10, 2011 12:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: data stage job running more time.
Replies: 13
Views: 8907

What's different between the two environments?

Don't answer "nothing" because that's clearly not the case.

For example, are the tables indexed on the key in dev and not in sit? Or is the database local to dev and remote from sit? There are several other possibilities.
by ray.wurlod
Tue May 10, 2011 12:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Failure
Replies: 3
Views: 4450

You have not enabled multiple record return from the reference link.
by ray.wurlod
Tue May 10, 2011 12:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate key generator generating improper sequence
Replies: 7
Views: 2322

This is perfectly expected behaviour where block size is set to 1000.
by ray.wurlod
Mon May 09, 2011 7:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is it possible to load 94 diff files into 94 diff tables?
Replies: 3
Views: 2339

Actually, it doesn't. But it does mean that you have to name the columns to which transformations need to be applied - all the other columns can still be propagated. If these columns are the same across various tables then some generic jobs may still be possible.
by ray.wurlod
Mon May 09, 2011 7:24 pm
Forum: General
Topic: IBM InfoSphere Warehouse version 9.7.3 Announced
Replies: 1
Views: 1013

IBM InfoSphere Warehouse version 9.7.3 Announced

IBM has announced "IBM InfoSphere Warehouse 9.7.3, with Terabyte pricing, new virtual image and Cognos 10 BI reporting".

Should we be worried about "Terabyte pricing"? Is this yet another new pricing model, or is it simply that the cost is $1T ? :lol:
by ray.wurlod
Mon May 09, 2011 2:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Table Name as Parameters in all the jobs
Replies: 4
Views: 1933

Size in the hundreds should not be a problem.
by ray.wurlod
Mon May 09, 2011 2:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is it possible to load 94 diff files into 94 diff tables?
Replies: 3
Views: 2339

If you have no transformations you can write one generic job. The Sequential File stage will use Runtime Column Propagation and a schema file to describe the layout. The pathname of the schema file will be passed as a job parameter, as will the target table name. Provided the date/time formats in th...
by ray.wurlod
Mon May 09, 2011 2:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Comparing two integers in transformer constraints
Replies: 1
Views: 1447

It should work if Max_files is truly integer. Try one of the comparison functions.