Search found 30 matches

by wblack
Sat Oct 06, 2012 5:18 am
Forum: General
Topic: Oracle Stage after SQL
Replies: 3
Views: 1555

Re: Oracle Stage after SQL

OK. if you don't have access to the incoming schema and what you need could be pulled from what you just wrote to TableA could you do something like

Example:
UPDATE TableB SET MyField = (select MAX(ORCHESTRATE.ColumnA) from TableA)
by wblack
Tue Jun 05, 2012 7:34 am
Forum: General
Topic: DB2 STAGE - Difference between user defined sql and insert
Replies: 1
Views: 1286

DB2 STAGE - Difference between user defined sql and insert

What is the main difference in using the the user defined sql and a regular insert statement. I was debugging a job that wasn't working as expected and noticed that the developer had the write mode set to 'USER DEFINED SQL' for a very basic insert using job parameters. While using the same insert sq...
by wblack
Mon Feb 27, 2012 8:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage, Stage Collector sort
Replies: 25
Views: 9612

Is allowing the join to insert a tsort better or any worse than adding a sort stage yourself and then setting the partitioning to SAME in the join stage.
by wblack
Mon Feb 27, 2012 6:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage, Stage Collector sort
Replies: 25
Views: 9612

I have a rather elementary question. If a join expects sorted data and the data isn't sorted it adds a tsort. Is this correct? Also, if a sort stage is added before a join where the data isn't sorted will this make a join perform better?
by wblack
Mon Feb 27, 2012 6:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage, Stage Collector sort
Replies: 25
Views: 9612

Try to get it out of your head that everything must happen on a single node. Are you seeing something that leads you to believe these things are running on a single node? It is possible to force sequential behavior in a parallel job, but it's not often going to be desirable. I don't have it in my h...
by wblack
Sun Feb 26, 2012 12:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage, Stage Collector sort
Replies: 25
Views: 9612

Ok a join requires sorted input but does that mean if it's not sorted a sort is entered for you? Also does a join require that the sorted input be on a single node? In other words when a join happens does it get repartitioned to a single node?
by wblack
Sat Feb 25, 2012 3:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage, Stage Collector sort
Replies: 25
Views: 9612

You say "A Join stage requires sorted inputs. If the join inputs are DB2 ordered outputs, then you can set the properties to tell it don't sort; it's already sorted. " Ok a join requires sorted input but does that mean if it's not sorted a sort is entered for you? Also does a join require ...
by wblack
Sat Feb 25, 2012 11:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort Stage, Stage Collector sort
Replies: 25
Views: 9612

Sort Stage, Stage Collector sort

I have some general questions regarding the sort stage the the collector sort properties of stages. Is it safe to assume that using the sort stage to sort on a key is equivalent to using the collector stable sort of lets say the transformer stage? What are the main differences/similarities of the tw...
by wblack
Tue Jan 24, 2012 6:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel Shared Container and Runtime Column Propagation
Replies: 3
Views: 3146

I believe there's a shortcut for all stages inside the shared container. If you open the job properties and check or uncheck the option for RCP on new links it will prompt you at that time to apply the change to existing stages.
by wblack
Tue Jan 24, 2012 5:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel Shared Container and Runtime Column Propagation
Replies: 3
Views: 3146

Parallel Shared Container and Runtime Column Propagation

I have a generic question regarding parallel shared containers and runtime column propagation. Do all input columns that go into a shared container's input automatically get passed through to the shared container's output? Does RCP have to be enabled to make this happen? RCP can be enabled on the sh...
by wblack
Thu Dec 22, 2011 5:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ascii to ebcdic or ebcdic to ascii translation
Replies: 5
Views: 3056

The first byte of the column in question has a binary indicator (description of the field), followed by a byte for the binary length of the data segment followed by the ebcdic data segment where the length byte tells the length.
by wblack
Wed Dec 21, 2011 6:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ascii to ebcdic or ebcdic to ascii translation
Replies: 5
Views: 3056

No, the file isn't from a mainframe/
by wblack
Wed Dec 21, 2011 6:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ascii to ebcdic or ebcdic to ascii translation
Replies: 5
Views: 3056

I'm saying that some fields are ascii and some are ebcdic, but there's one field that's a combination of ascii and ebcdic. The first byte is the description of the field followed by a length byte of the data followed by the data segment. The first two bytes are ascii and the data segment is ascii.
by wblack
Wed Dec 21, 2011 4:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ascii to ebcdic or ebcdic to ascii translation
Replies: 5
Views: 3056

ascii to ebcdic or ebcdic to ascii translation

I'm using a column import that takes a schema file and reads in a file that's partially ascii and partially ebcdic. Most columns are either ascii or ebcdic and can be specified which in the schema file but I have one that consist of both ascii and ebcdic characters so I have to read it in that way. ...
by wblack
Mon Nov 07, 2011 1:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Trim a string
Replies: 1
Views: 1352

Trim a string

Is it possible to call Trim using a list of characters to trim? I haven't been successfully parsing the Documentation.