Search found 204 matches

by thompsonp
Thu Mar 26, 2020 12:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SCD detect if match was found for derivation
Replies: 1
Views: 11207

SCD detect if match was found for derivation

I am using the SCD stage for a Type 2 slowly changing dimension. One of the audit columns in the dimension is version number. This should be set to 1 for the first occurence of a business key and then increment with each type 2 change. The column is a Decimal(9,0) and not nullable. I have not been a...
by thompsonp
Tue Apr 09, 2019 2:12 pm
Forum: General
Topic: ESX VMware backups
Replies: 1
Views: 2266

ESX VMware backups

Our company standard for VMs is for daily incremental snapshot backups and full weekly backups but we are seeing intermittent job failures when the backup runs. Jobs either abort or hang. The v11.5 Information Server documentation describes backing up an installation and states that no jobs should b...
by thompsonp
Mon Feb 25, 2019 4:47 am
Forum: General
Topic: Unable to start ORCHESTRATE network connection
Replies: 1
Views: 2764

Sorry for slow response - been away. The config file is (names changed): node "node1" { fastname "ServerName" pools "" resource disk "/test/datasetdata1/PNTest" {pools ""} resource disk "/test/datasetdata2/PNTest" {pools ""} resou...
by thompsonp
Fri Nov 30, 2018 2:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nullable Value transforms to 0 while writing to OracleDB
Replies: 2
Views: 2719

How are you checking the value in the Database?

What happens if you insert a null value into that table / column from outside DataStage?
by thompsonp
Thu Nov 15, 2018 7:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Websphere MQ Connector Failing
Replies: 3
Views: 4978

Resolved by adding the mqm/lib64 directory to LD_LIBRARY_PATH
Also set MQCHLLIB and MQCHLTAB in dsenv
by thompsonp
Fri Oct 19, 2018 4:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Websphere MQ Connector Failing
Replies: 3
Views: 4978

Did you resolve this?
I have the same error on a Linux v11.5 installation having moved from v8.1.
by thompsonp
Mon Sep 24, 2018 7:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSGetStageInfo giving inaccurate results
Replies: 5
Views: 4185

The issue went away for a while but has now resurfaced in a test environment.
It's back with IBM support with all kinds of tracing and debugging enabled.
by thompsonp
Fri Aug 17, 2018 7:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSGetStageInfo giving inaccurate results
Replies: 5
Views: 4185

With option DSJ.LINKROWCOUNT the count is returned as a single value. If I change that to DSJ.INSTROWCOUNT I get a comma separated list of counts for each partition. Does anyone know what these DataStage Basic functions are examining to get the results? Is it something I can check using some other m...
by thompsonp
Thu Aug 16, 2018 8:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSGetStageInfo giving inaccurate results
Replies: 5
Views: 4185

DSGetStageInfo giving inaccurate results

Jobs that work as expected on v8.1 have been migrated to v11.5 As part of an after job subroutine the link counts are examined using DSGetLinkInfo(JobHandle,ThisStage,ThisLink,DSJ.LINKROWCOUNT) Based on the naming convention of the links a simple check is performed which is essentially sum of inputs...
by thompsonp
Tue Jul 24, 2018 7:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SQL function in update statement using ODBC connector
Replies: 1
Views: 2729

SQL function in update statement using ODBC connector

I have a job whose target stage is an ODBC Connector. It will update one column on a table based on the key field. However the SQL needs to have a LOWER function applied within the WHERE clause: WHERE lower(entry_status)=ORCHESTRATE.entry_status Although this works the "lower" function cau...
by thompsonp
Wed May 16, 2018 9:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Dataset performance in RedHat Linux
Replies: 11
Views: 11806

John - do you have any further details or a case number from IBM that you could share?
by thompsonp
Wed May 16, 2018 8:50 am
Forum: General
Topic: ulimits and server restarts
Replies: 2
Views: 3151

ulimits and server restarts

We have a new v11.5 install and all the recommended kernel settings were supposedly made before the installation. The server was recently rebooted and we saw a message about increasing the open files limit changed from 10240 to 30000 and then after the reboot it became 1024 to 4096. What is the reco...
by thompsonp
Thu Jan 18, 2018 5:16 am
Forum: General
Topic: Separating Services and Repository tiers from Engine
Replies: 2
Views: 2944

Separating Services and Repository tiers from Engine

If we start with a basic installation topology where the Services, Repository and Engine tiers are all on the same server, how easy is it to separate the Engine tier from the other two at a later date? They would all be on a single VM to start with and if there are performance or capacity issues (e....
by thompsonp
Wed Jan 17, 2018 9:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fork-join with condition
Replies: 1
Views: 2740

What are you hoping to see in col1 on the output?

If it's just the col1 value from the row that had the last non zero value in col2 then it's straightforward.

Filter out all the rows where col2 is zero, then take the last row (tail).
by thompsonp
Thu Jan 04, 2018 3:37 am
Forum: General
Topic: Intel Kernel design flaw / bug
Replies: 6
Views: 4189

Intel Kernel design flaw / bug

Any idea what impact the patches to Linux and Windows to address the Intel cpu flaw will likely have on typical DataStage workloads?

I've been reading that workloads with lots of network and i/o may be worst hit with up to a 30% performance drop.