Search found 504 matches

by ShaneMuir
Fri Jun 25, 2021 1:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Stage - load file to API with REST
Replies: 1
Views: 31542

Hierarchical Stage - load file to API with REST

Hi All Does anybody know how to view the actual call that the Hierarchical stage is passing to an API when performing a HTTP POST command with the REST Step? I am trying to pass a file to an API. I am able to successfully call the API passing the file from the command line using cURL or via other ap...
by ShaneMuir
Wed Jul 26, 2017 2:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC Connector Calling Stored Procedure
Replies: 2
Views: 3721

The multinode/parallel settings were the first thing I checked. Its definitely executing sequentially. More so it executes the multiple calls sequentially also, 3 times, one after the other. I have a theory that its going something to do with RCP and the connector calling the DB to get the metadata....
by ShaneMuir
Tue Jul 25, 2017 9:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC Connector Calling Stored Procedure
Replies: 2
Views: 3721

JDBC Connector Calling Stored Procedure

Hi All I am having a strange issue when using the JDBC Connector to call a Stored Procedure. The job design itself is relatively simple: JDBC ----> Tfm -----> Unstructured (Excel) The only "tricky" part is that it is fully RCP and parameterised. To execute the process I pass one of about 3...
by ShaneMuir
Tue Jan 10, 2017 9:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding the occurence of a substring in a string
Replies: 7
Views: 6659

Personally I would tackle it as follows: 1. Split off your column names and create a single delimited string of them all ordered alphabetically CBD|GTI|FUND|SC_ID 2. Join that delimited string of column names back to your original data eg 22 CBD 123 CBD|GTI|FUND|SC_ID 3. Use stage variables to do a ...
by ShaneMuir
Tue Nov 08, 2016 7:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dynamically selecting columns(and its data type)
Replies: 6
Views: 4326

I can only offer the following regarding RCP, and how its worked in my experience. It would seem that it does indeed create everything in the spreadsheet as General (Except dates to which it gives a custom style). However values that were decimals seem to be treated as numbers, and values that were ...
by ShaneMuir
Mon Oct 31, 2016 10:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help required in logic
Replies: 5
Views: 5347

Surely you can just sort your data appropriately and take the first record?

Eg Sort by:
1. Account Number (Asc)
2. Account Status (Desc)

Use a remove duplicates stage with the key Field of Account Number and keep the first record.

This should cater for all outcomes?
by ShaneMuir
Fri Sep 09, 2016 8:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Limit on multiple uses of same lookup fileset in a job?
Replies: 2
Views: 3243

Limit on multiple uses of same lookup fileset in a job?

Hi All Does anybody know if there is any limit on the number of times a single lookup fileset can be used in the one job, be it an numerical limit (eg 10 times) or a limit enforced by system constraints (eg memory). I ask as we have a couple of jobs which fail periodically, each time the failure is ...
by ShaneMuir
Fri Sep 09, 2016 8:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Target Excel File renaming column names
Replies: 3
Views: 4478

Thanks for the thoughts. I too am looking at the generate the column headers first route as it would seem the only logical way to get around it. But rather than modify the existing file, feed it in via a funnel, its just a matter of determining how to generate the column headers from the input SQL/s...
by ShaneMuir
Tue Sep 06, 2016 9:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Target Excel File renaming column names
Replies: 3
Views: 4478

Target Excel File renaming column names

Hi All I am having an issue whereby when using a target Unstructured File Stage to write to an Excel file, with RCP enabled on all stages, that the target stage is renaming the column names. The job itself is quite simple: DB -----> TFM ------> EXCEL The DB executes a query The TFM is a placeholder ...
by ShaneMuir
Tue May 17, 2016 6:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: modify stage question
Replies: 2
Views: 3876

Parameterise the specification value and pass either your required keep statement or the phrase NOWARN
by ShaneMuir
Fri May 06, 2016 2:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Vertical Pivot Dynamic Array Size
Replies: 5
Views: 7210

As per chulett's suggestion, this can be done relatively easily with a transformer and looping. You will however need to be able to provide the number of columns required to the output (also any column names if required). Using that number of columns you just build up a delimited list of values for ...
by ShaneMuir
Fri May 06, 2016 2:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aggregation and fetch values based on the logic
Replies: 2
Views: 3656

Broadly speaking, you could do the following: 1. Sort your data by the ID and the Date (Desc). 2. Determine when the key field changes. 3. Set up stage variables to capture Cur_Loc, Pre_Loc, Cur_Role, Pre_Role 4. Derivation for each stagevariable would be something like: If KeyChange then If Not(IsN...
by ShaneMuir
Fri Apr 08, 2016 7:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compare Duplicate Records in a File
Replies: 5
Views: 4582

What have you tried so far?

HINT: Set stage variables and compare
by ShaneMuir
Thu Apr 07, 2016 6:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating records in ascending sequence
Replies: 10
Views: 9117

My requirement is to get a single column output(say Col2), with record values ranging between min(col1) and max(col1), and in a ascending order I do not want to use any sort stage/inline sort feature to sort the column . How would you ever hope to output values in ascending order on the output with...