Querying bulk load status(Salesforce Connector) in Datastage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
nikita.bandekar
Participant
Posts: 6
Joined: Mon May 06, 2019 6:42 am

Querying bulk load status(Salesforce Connector) in Datastage

Post by nikita.bandekar »

I have a question regarding Querying bulk load status (Salesforce Connector) in IBM Infosphere Datatstage. The query job is returning me duplicate records of my Salesoforce job. Basically returning records x4 times as there are total 4 batches in my job. I have 13 records (4 batches) processed in my job in salesforce, but the query job is returning me 52 records (13*4).

I have used example3 query job from the BulkLoadStatusCheckingExample.dsx project file.

Is there any settings that i need to change in my sandbox or in Datastage?

I would expect 13 records in total, instead I am getting 52 records.
nikita bandekar
nikita.bandekar
Participant
Posts: 6
Joined: Mon May 06, 2019 6:42 am

Post by nikita.bandekar »

I checked with a different Job id. Again the records are x4 times.
I noticed in SalesForce that there multiple logins when i executed the job.
I believe its logging in multiple times, getting the job id and returning me the records.
nikita bandekar
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Partitioning, I would assume... you are running the job on four nodes, yes?
-craig

"You can never have too many knives" -- Logan Nine Fingers
nikita.bandekar
Participant
Posts: 6
Joined: Mon May 06, 2019 6:42 am

Post by nikita.bandekar »

Hey Craig,

Yes you were right!! It was running on 4 nodes. Changed it to 1 and its working fine now.
Thank you so much :D
nikita bandekar
Post Reply