Search found 150 matches

by dsuser_cai
Thu Aug 06, 2009 12:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

Hi , Im tryig to analyze why this problem exist, and only today i as able to get the Director logs, and that says: Read caching disabled, file size exceeds cache size i searched the forum for some replies. i read in a post that says, if i increase the "Read Cache Size" (mine was 128 MB). a...
by dsuser_cai
Wed Aug 05, 2009 10:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

But thanks Craig for your idea.
by dsuser_cai
Wed Aug 05, 2009 9:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

Hi chulett, That was a good idea. I tried to verify the issue, but i really couldnt understand why the key is not generated properly. but i found a way around to get this working. These are the steps i followed: 1) Increase the rows per transaction to a higher number (initially it was 0) 2) when the...
by dsuser_cai
Fri Jul 31, 2009 3:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

as you said i cleared the log, now i ahve ahardcoded all the parameters. im going to start the job again.
by dsuser_cai
Fri Jul 31, 2009 2:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

last_key is the previous value.(i mean the previous surrogate key that was generated)
by dsuser_cai
Fri Jul 31, 2009 2:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

a small update: this is the stage variable that i use:

If not(isnull(KEY_COLUMN)) then LAST_KEY+1 else 0

this works fine for all jobs that we have.
by dsuser_cai
Fri Jul 31, 2009 2:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

i used the following to find my job number: LIST DS_JOBS JOBNO WITH NAME = CustLdCup2OdsCustRef and this gave me the number as 2235. so my command to clear the log should be like: CLEAR.FILE RT_LOG2235, please correct me if im wrong. or can i create a copy of this job and try loading it in the mean ...
by dsuser_cai
Fri Jul 31, 2009 2:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

data type is Double (15-length)
by dsuser_cai
Fri Jul 31, 2009 2:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key - wrong generation
Replies: 23
Views: 6199

Surrogate Key - wrong generation

Hi I have a Server job that extracts data from a sequential file and loads it into oracle table using oracle bulk loader. the total number of records is 3.8 million in the text file. And when i load the data we generate a surrogate key in the transformer (we use a stage variable - keep adding 1 to t...
by dsuser_cai
Wed Jul 29, 2009 1:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing string values into SQL query via parameter
Replies: 14
Views: 14247

try using a back slash (\) before the single quote. for example i use it like this:
\'OD\' to specify 'OD'. i hoe this works for you.
by dsuser_cai
Wed Jul 29, 2009 10:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read value from text file using Execute Command
Replies: 4
Views: 7232

I checked cat /etl/PDAODS_Dev/temp/text.txt and this is working now, but i have one more issue, now. This text file has 2 fields, data type is double. The data in the text file looks like this: 20030125, 20080725 Ans im using a execute command stage to read these values and pass it as parameter to t...
by dsuser_cai
Tue Jul 28, 2009 4:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Row count not matching between DS and toad
Replies: 3
Views: 1490

Row count not matching between DS and toad

Hi I have a server job that reads data from Oracle DB. when I run the job the job gives me 15994 records (i mean the job extracts only 15994 records), but when i runt he same query in toad it gives me 16018 recods. i checked the job in director, it dosent have any warning in it. i do not see any pro...
by dsuser_cai
Tue Jul 28, 2009 4:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read value from text file using Execute Command
Replies: 4
Views: 7232

Read value from text file using Execute Command

Hi I have a issue when im reading from a text file. This is a job sequence. Job1 (J1) creates a text file with one row. (out put of j1 will be 1234 just a number). then i use a execute command stage to read this value from the file. The command is cat and in the parameter i have given /<path_name>/<...
by dsuser_cai
Wed Jul 22, 2009 1:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: partition symbols
Replies: 5
Views: 3612

I think you will not see the Partition symbol in this case. I tried the following. case1) RowGenStage---->Transformer----->ODBCStage in this case the partition for the transformer is "same" and the partition for ODBC is also set to same. I didnt see any partition flag (Link Mark) in the li...