DSXchange

Hi All, Two of the PX jobs running in parallel from my sequencer in Datastage 11.5, are failing with error "ds_ipcgetnext() - timeout waiting for mutex" (They both are using Basic Transofrmer in parallel). After the first failure, if I resubmit the sequencer again, they are failing with er...

Thank you Ray.

Any idea why it is creating two sessions only with AUTOGENERATED sql option. If I use user defined sql, we are seeing only one session on DB side.

Hi All, I am trying to delete records from a mainframe DB2 table based on a key. I am using sequential execution on DB2 stage so I should see only one session on Db side from ETL. But somehow, Datastage creating two sessions with same Autogenerated DELETE statement and causing the deadlock on DB2 en...

Here are the answers. 1. Yes. By default READ method is sequential unless your table is partitioned and you are enforcing stage to read in parallel from partitions. Write always in parallel bydefault. 2. Bydefault stage will try to read in sequential while extraction and in parallel while loading. I...

If you clear the partition then Datastage tries to repartition the data on link before next stage but as you are having "SAME" partition on that link, datastage should through the warning. By the way, why can't you have a copy stage on reject link before sequential file and clear the parti...

Hi Craig and qt_ky, Thanks for your replies. We tried with proper partitioning but not useful. We are getting the same issue with hash and modulus partitioning too. And also we collected the data from peek by partition wise and verified it. Datastage writing the data properly in partitions but someh...

Looks like an issue with ODBC Connector stage...!

Running fine in sequential mode so we are OK for now.

Please post me if any one having any better ideas to resolve this issue....

Hi All, We are trying to update a table in SQLServer2008 using ODBC Connector/Enterprise stages using 4 node config file. Job is aborting with message "Deadlock". Table is having a Clustered Unique index on key combination that I am using in Update statement in Job. My Database is not part...

Thank you Ray for the Information. I verified the ODBC API's code. It looks like we are calling Java classes on backend from connector stages. So If I have 4 node configuration file, then each session will create a separate java class instance and that java instance process the data row by row it re...

Thanks Ray for Information.

I searched IBM.DeveloperWorks to find the APIs, but I couldn't find any.

Can you route me to the page from where can I download APIs?

And also may I know where can I find ODBC API information...Thanks.

You are correct.

DB2 connector stages verifies the table and its structure even before it tries to run before SQL.

Get the table created by DBA before the first run. Add the DROP table statement before create statement then from second run you will be good.

Hi All, Can any one help me how DB2 or Oracle Connector stages work on Backend? Manual is saying it is using APIs but not mentioned what APIs it is really calling for DB2? I see on DB side, it is triggering some packages/procedures when I run the job but any one having the list of all procedures it ...

Thank you mobashshar.

That given link is useful to eliminate engine inserted sorts and partitions.

I want to know why datastage ignoring "Case Insensitive" option on Internal partitioning?

Hi All, I have a job to join data from two different streams. On first stream I am reading data from file , doing sort in ETL, removing duplicates then passing it to join stage. Sorting data on Key-1, partition on Key-1 with Case Insensitive option. On join right link, reading data from DB and sorti...

Thank you Pavi. I appreciate your effort.

That might be problem in my DS environment. I didn't see any other way other than re-partitioning the data in job-2 for now.

Thank you all for your response.