Search found 53125 matches

by ray.wurlod
Mon Oct 21, 2013 3:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: getting import error for date field
Replies: 6
Views: 3516

You still have to set the date format string in your metadata to "%yyyy%mm%dd" - you have provided no evidence that you have done so.
by ray.wurlod
Mon Oct 21, 2013 3:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: All records not loading into hash file
Replies: 8
Views: 3421

No more server job stage types of which I'm aware.
by ray.wurlod
Mon Oct 21, 2013 3:09 pm
Forum: General
Topic: Automation run time column propagation
Replies: 6
Views: 1889

Somehow you need a list of table names. You may be able to read it using a simple command (rather than a script). Maybe you can even hard-code it in the StartLoop activity. Use a "list of things" loop in the StartLoop activity to step through your list.
by ray.wurlod
Mon Oct 21, 2013 2:23 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Could not load drsoci.so
Replies: 6
Views: 3589

There must be at least one other stage (a server job must have at least two). I suspect that the other stage is a DRS stage set to connect to Oracle (hence the drsoci reference in the error message). You have to make sure that the parent directory of drsoci.so is in your shared library search list (...
by ray.wurlod
Mon Oct 21, 2013 1:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Text data type in sql server is not working in DataStage
Replies: 2
Views: 1821

ODBC does not handle unbounded VarChar or Long VarChar. Prescribe a maximum length in the Precision column.

This is not a DataStage issue; it turns on the SQL grammar for ODBC.
by ray.wurlod
Sun Oct 20, 2013 11:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: getting import error for date field
Replies: 6
Views: 3516

Your default date format is ten characters (YYYY-MM-DD) but the dates in your data contain only eight characters (YYYYYMMDD). You need to adjust your metadata, specifically the format for that date column.
by ray.wurlod
Sun Oct 20, 2013 11:20 am
Forum: General
Topic: Job abort message as an attachement in email notification
Replies: 9
Views: 2063

The second paragraph of Craig's post tells you what you need to do.
by ray.wurlod
Fri Oct 18, 2013 2:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Delete and Insert in ODBC
Replies: 5
Views: 1224

You can get the set of keys from the source data. The keys would ordinarily be indexed in the target so the cost of the deletes will be small.
by ray.wurlod
Fri Oct 18, 2013 2:26 pm
Forum: General
Topic: datastage jobs migration from 8.1 to 9.1
Replies: 15
Views: 20967

jdinero wrote:I was told by IBM that certain functions behave different from 8.7 and 9.1.
Can you get any more information about these? It's a terribly vague assertion not really backed up by "what's new in this release" documentation.
by ray.wurlod
Fri Oct 18, 2013 2:23 pm
Forum: General
Topic: COMPARE TWO PROJECT: PROD AND TEST
Replies: 5
Views: 1292

You can compare ONE job across projects. There is no tool that will do them all. Some will suggest exporting the jobs from each project and comparing the DSX files with a command such as diff.
by ray.wurlod
Fri Oct 18, 2013 2:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Delete and Insert in ODBC
Replies: 5
Views: 1224

It would be. Each row generates a DELETE followed by an INSERT.

You need a different strategy, for example gather the keys of the affected rows and create a job that runs simple DELETE. Then run INSERT or UPDATE in a second job.
by ray.wurlod
Thu Oct 17, 2013 7:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage
Replies: 5
Views: 1575

Welcome aboard. This is not really an ETL task, but you can readily use stage variables in a Transformer stage to keep track of the previous row's value(s) in order to effect your comparison(s). Another stage variable can be used to monitor your "first to last" (begin true, set to false on...
by ray.wurlod
Thu Oct 17, 2013 3:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Flat File with Parent Child relation
Replies: 5
Views: 2662

Read the entire record as a single VarChar and parse it within the Transformer stage. Use stage variables to detect the arrival of a new parent and to accumulate the output record. Use a downstream RemoveDuplicates stage to preserve the last of each group (with the same parent record). You didn't me...
by ray.wurlod
Thu Oct 17, 2013 1:52 am
Forum: IBM QualityStage
Topic: Cleansing Data before Standardization
Replies: 7
Views: 5485

Have you tried running four Standardization stages, passing the unhandled data from each to the next, perhaps adding in the postcode and state ahead of the second AUAREA standardization?

Code: Select all

  --->  AUAREA  -->  AUADDR  -->  AUAREA  -->  AUADDR  -->
by ray.wurlod
Thu Oct 17, 2013 1:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: truncate table in unsuccessful load
Replies: 5
Views: 1969

That's truncation before loading. I tried to answer the question about truncation after loading - unfortunately perhaps one can not make the After SQL in a Connector conditional. Therefore, unless you can determine a means in SQL of determining that the load failed, you will not have a solution &quo...