Search found 41 matches

by ASU_ETL_DEV
Wed Apr 18, 2018 3:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Encrypted connection to SQL Server
Replies: 5
Views: 8573

I am reopening this post because the solution I had provided ended up being incorrect. Below is what actually worked for me. The DataDirect SQL Server driver I am using (branded_odbc/lib/VMsqls00.so) does not support truststores in jks format, which is what the <keytool> command creates. Instead it ...
by ASU_ETL_DEV
Tue Jan 23, 2018 11:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Encrypted connection to SQL Server
Replies: 5
Views: 8573

Thanks JRodriguez. Yes, that was one of the posts I found too. Let's call that post#1. The other one I found is this (post#2): https://www.ibm.com/support/knowledgecenter/en/SSZJPZ_11.3.0/com.ibm.swg.im.iis.conn.filecon.usage.doc/topics/filecon_t_enable_ssl_connect.html IBM approved the instructions...
by ASU_ETL_DEV
Mon Jan 08, 2018 10:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Encrypted connection to SQL Server
Replies: 5
Views: 8573

Thanks qt_ky,
We opened a case with IBM Support. They pointed us to the odbc manuals in /branded_odbc but the driver security options' configuration is just one part of the story.
We are waiting for them to explain how to handle the certificates on the Linux server.
Marco
by ASU_ETL_DEV
Fri Jan 05, 2018 3:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Encrypted connection to SQL Server
Replies: 5
Views: 8573

Encrypted connection to SQL Server

Hello, We need to code a set of parallel jobs that connect to a SQL Server source database that has encryption turned on. They gave us CA-signed certificates to install on the DataStage server and client. We have never configured an encrypted SQL Server connection so we need a bit of step-by-step he...
by ASU_ETL_DEV
Sun Jul 05, 2015 8:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ExecSH to remove dataset in After-Job subroutine
Replies: 7
Views: 6392

Just to test, I created a variable, ORCHADMIN_PATH, added it to the command and it worked:

#$ORCHADMIN_PATH#/orchadmin rm #$TEMP_FILES_DIR#/dset_BB_USERS_aft.ds

I'll add it to the PATH in dsenv.

Thanks for your help.
by ASU_ETL_DEV
Sun Jul 05, 2015 5:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ExecSH to remove dataset in After-Job subroutine
Replies: 7
Views: 6392

Thank you! So could I add $APT_ORCHHOME/bin to the PATH variable in dsenv and keep the ExecSH command as is (without the $ signs)?
by ASU_ETL_DEV
Sun Jul 05, 2015 2:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ExecSH to remove dataset in After-Job subroutine
Replies: 7
Views: 6392

ExecSH to remove dataset in After-Job subroutine

Hello, I am trying to delete three work datasets after the job is done. I placed this command statement in the After-Job subroutine of the parallel job: $orchadmin rm #$TEMP_FILES_DIR#dset_BB_USERS_aft.ds; $orchadmin rm #$TEMP_FILES_DIR#dset_BB_USERS_bef.ds; $orchadmin rm #$TEMP_FILES_DIR#dset_BB_US...
by ASU_ETL_DEV
Thu Jun 25, 2015 8:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture and unique constraints
Replies: 11
Views: 10007

Ray, I was not implying that the stage used the Oracle indexes or any other index. But the stage sorts the before/after data according to key columns that in my case reflect the Oracle tables' primary key columns. During the change discovery the stage assigns the insert change code to records that l...
by ASU_ETL_DEV
Wed Jun 24, 2015 4:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture and unique constraints
Replies: 11
Views: 10007

If I completely reload the target with the same set of jobs I do not get this unique constraint error on the insert so I am wondering why this happens on an incremental load. Note that I am just staging the source data to the target table and the source table has the same primary index and secondary...
by ASU_ETL_DEV
Wed Jun 24, 2015 9:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture and unique constraints
Replies: 11
Views: 10007

In the property page of the Change Capture stage, in the Change Keys section, I specified the primary key columns. In the options section, as Change Mode, I selected "Explicit keys, all values". In the Input tab I specified Hash partitioning with sort on the primary key columns for both Be...
by ASU_ETL_DEV
Tue Jun 23, 2015 5:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture and unique constraints
Replies: 11
Views: 10007

The run on one node did not fix it. Same story. I changed the secondary index to non-unique and did not flag its column as key in any of the jobs and the whole thing started working without further problem. I am wondering whether the Change Capture stage does not support multiple unique indexes and ...
by ASU_ETL_DEV
Wed Jun 17, 2015 11:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture and unique constraints
Replies: 11
Views: 10007

Thank you for answering. I verified and the unique constraint error is actually happening on the primary key index (they have very similar names), not the secondary unique one. It is a two-column primary key that is correctly defined in the table and throughout the jobs. I am running the job on one ...
by ASU_ETL_DEV
Tue Jun 16, 2015 1:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture and unique constraints
Replies: 11
Views: 10007

Change Capture and unique constraints

Hello, In order to discover the latest source table's inserts, updates and deletes (two-column primary key and additional unique index built on another column) I coded a change capture job flow composed of the steps outined below. Job 5) aborts with over 50 warnings of unique constraint messages on ...
by ASU_ETL_DEV
Sun Mar 16, 2014 9:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup stage outputs duplicate rows
Replies: 3
Views: 4737

Hi Ray,
There were duplicates in the lookup table. I changed the SELECT to DISTINCT and also changed the lookup type to normal instead of sparse and now it is working correctly.
Thanks.
Marco
by ASU_ETL_DEV
Sun Mar 16, 2014 6:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup stage outputs duplicate rows
Replies: 3
Views: 4737

Lookup stage outputs duplicate rows

Hello, I am transitioning from the server to the parallel world so bear with me... I have two oracle tables: one is used as stream and the other as reference. I need to find out which rows from the stream are NOT in the reference and output them to a target file. I am using the Oracle connector for ...