Search found 182 matches

by satheesh_color
Mon Jun 11, 2018 7:21 am
Forum: IBM QualityStage
Topic: US Address Standardization
Replies: 4
Views: 13336

Hi All, After the standardize process, i got the below output LiterL=~(Seperation for records) Addr_Line1,Addr_Line2,City,state,Country,Zip 1 BOSTON PLACE,41ST FLOOR ~ ~ BOSTON ~ MA ~ USA ~ 02108 From the above example, while i try to get the required records i failed as Addr_Line2 is NULL, so 41ST ...
by satheesh_color
Mon Jun 11, 2018 2:36 am
Forum: IBM QualityStage
Topic: US Address Standardization
Replies: 4
Views: 13336

US Address Standardization

Hi All, I am new to Quality stage. I have a rquirement to validate US adresses(NA) for the below values. Addr_Line1 Addr_Line2 City State Country Zip/PostalCode For that i am creating new ruleset(AdrValidate) with the below values From PAT File: \PRAGMA_START SEPLIST " ~" STRIPLIST " ...
by satheesh_color
Thu Jun 07, 2018 12:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generate static values to junk dimension without having src
Replies: 2
Views: 2861

Generate static values to junk dimension without having src

Hi All, The requirement is to generate static values to load the data into Junk dimesion and it is a one time data load. Static Junk dimension table with all possible combinations for A(0/1/2) and B(0/1/2) Status Indicators (3*3=9 Records) ColumnA ColumnB 0 0 0 1 0 2 1 0 1 1 1 2 2 0 2 1 2 2 I would ...
by satheesh_color
Mon May 28, 2018 5:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: unableto import schema definitionOrchestrate Schema Importer
Replies: 0
Views: 1840

unableto import schema definitionOrchestrate Schema Importer

Hi All, I triedto import oracle schema table definition using Orchestrate Schema Importer Error:Unsupported SQL type OBJECT TYPE for column PRIORITIES. APT_ParseError: Could not find type: generic For this table A, couple of columns has been defined as below PRIORITIES SYS.XMLTYPE Other than this ta...
by satheesh_color
Tue May 15, 2018 12:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reusable Job Design
Replies: 5
Views: 3190

Thanks Craig.


Regards,
S.R
by satheesh_color
Sun May 13, 2018 11:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reusable Job Design
Replies: 5
Views: 3190

Reusable Job Design

Hi All, We have a situation in which we need to load data from sql server to Oracle staging area. It is a one to one data load(Metadata will differs for each table).But, i have so many tables(15) needs to be migrated using datastage. It is an initial load. Once that has been done, we will need to de...
by satheesh_color
Sat Feb 18, 2017 12:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC Connector Performance Tuning
Replies: 9
Views: 7934

Hi Paul,

Count mismatch is i could see the huge difference in extracting as well as Dataset rows.

Eg: My source table has the count of 1000, when i try to run with 4 nodes with partition read enabled...the extraction count exceeds more than 5000 rows.


Regards,
Satheesh.R
by satheesh_color
Thu Feb 16, 2017 7:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC Connector Performance Tuning
Replies: 9
Views: 7934

Hi, We were using simple extraction jobs from JDBC to a Dataset(Using Hash Partitioning) then it will be used in another jobs for join/lookup. Still i could see the count mismatch(huge difference) when i try to run the job with Partitioned read=YES. Appreciate for your help!!! Regards, Satheesh.R
by satheesh_color
Thu Feb 16, 2017 5:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC Connector Performance Tuning
Replies: 9
Views: 7934

Hi paul, Can we use partition read for non-partitioned tables.When I try to read data on partitioned read, the count shows a huge variation and it fetches much faster 25k rows/sec. But..i am really worried about the huge count mismatch. Kindly let me know your thoughts on the same. Regards, Satheesh.R
by satheesh_color
Wed Feb 15, 2017 6:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deadlock detected while updating table
Replies: 9
Views: 4599

Hi All, In JDBC connector we are using RecordCount as 100 and Session/BatchSize as 100. The default value is 2000. Eventhough we have reduced it, it causes deadlock. Note: We are trying to update 6 million records and Foreign keys(1,2,3) having index. We are updating the table based on primary key. ...
by satheesh_color
Tue Feb 14, 2017 11:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deadlock detected while updating table
Replies: 9
Views: 4599

Hi All,

As we are using JDBC Connector stage to connect the target Db using Oracle thin client with Read committed as an isolation level and Hashed partition..still the issue occurs when we try to update the table with 4 nodes.


Kindly let me know your thoughts on the same.


Regards,
Satheesh.R
by satheesh_color
Mon Feb 13, 2017 10:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deadlock detected while updating table
Replies: 9
Views: 4599

Hi Ray,

we are using Hash partition

Regards,
Satheesh.R
by satheesh_color
Mon Feb 13, 2017 6:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deadlock detected while updating table
Replies: 9
Views: 4599

Deadlock detected while updating table

Hi All, While doing an update of a table which cotains million of rows, we face deadlock issue. Even though we dont have duplicate value based on the key column we come across this issue. Fatal Error: The connector failed to execute the statement: UPDATE FACT SET AMOUNT1 = ?, AMOUNT2 = ?, AMOUNT3 = ...
by satheesh_color
Wed Jan 18, 2017 3:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JDBC Connector Performance Tuning
Replies: 9
Views: 7934

JDBC Connector Performance Tuning

Hi All, We are using JDBC Connector to connect to the remote Database using oracle thin client using Type 4 connection. When we try to extract the data from the Database....the fetch or rows/sec is very low(800-1000 rows/sec). Properties: FetchSize:2000 HeapSize:256 Kindly let me know your thoughts ...