Search found 22 matches

by dinakaran_s
Tue Apr 17, 2012 11:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Creating number of Files
Replies: 13
Views: 15565

Hi,

Good thing about using parallel job is Performance!! even with sequential mode.

I have tested a job with the above routinue and it really gives good performance.

Source : Oracle
Volume : 150,000 records
Time Taken : 2 min
by dinakaran_s
Tue Apr 17, 2012 8:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Creating number of Files
Replies: 13
Views: 15565

Steps: 1. Use the above code and create a file "Filename.c" 2. Compile the above file using value available in APT_COMPILEROPT and APT_COMPILER something like this below, g++ -c -O -fPIC -Wno-deprecated -m64 -mtune=generic -mcmodel=small 3. Now u can see a new file with "filename.o&qu...
by dinakaran_s
Mon Apr 16, 2012 12:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Creating number of Files
Replies: 13
Views: 15565

Routine for creating dynamic files

Hi, I have created a C++ routinue for creating dynamic flat files, Insert each record into the file. logic: Chk for the file name; If exists then append the row Else create new file. This routine works only ehn the transformer is set to sequential process. attachString -- > set of delimited column v...
by dinakaran_s
Thu Mar 15, 2012 8:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Batch process using Oracle connector
Replies: 2
Views: 1579

Batch process using Oracle connector

Hi, Currently we are trying to fetch 10 million records from oracle (it may grow) and to creating a flat file. In between, and need to get the description from the master using lookup. The jobs is running fine without any problem. But the problem is, the scratch disk is getting full (20 gb) for just...
by dinakaran_s
Tue Oct 18, 2011 8:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: header and trailer validation
Replies: 10
Views: 5560

Seq File --> Xfm1 --> Sort1 stg --> xfm2 --> output Xfm1 --> using stage variable count all the records and pass it to new column ( Count1) Sort1 stg --> Sort all the records based on Count1 column in decending order xfm2 --> put constraint to pass only first and last record ( constraint ==> INROWNU...
by dinakaran_s
Tue May 17, 2011 9:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Parsing & validation against the schema .XSD
Replies: 4
Views: 6024

Can you please tell me how to implement with XML pack 2. Is it through expression to be hard coded using transformer stage or the XML stage supports this property.
by dinakaran_s
Tue May 17, 2011 2:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Parsing & validation against the schema .XSD
Replies: 4
Views: 6024

XML Parsing & validation against the schema .XSD

Hi All, My requriment is to validate the XML based on the XSD schema. Is it possible to impelement in our datastage job. Sample XSD schema below; The reference element "Activity" is a user defined element "ActivityDataType" and it has list of restricted values as highlighed below...
by dinakaran_s
Tue Oct 06, 2009 3:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: All Oracle versions compatible with Data stage 7.1
Replies: 2
Views: 2490

Re: All Oracle versions compatible with Data stage 7.1

Hello, We will have to migrate from DB2 to Oracle.The current data stage version is 7.1.Could you please let me know which version(s) of oracle is compatible with DS 7.1?are 10g and 11g compatible with DS 7.1? Thanks in advance Datstage 7.1 can support any version of oracle, if the plugin for that ...
by dinakaran_s
Tue May 12, 2009 7:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: concatenating the target file with the system date
Replies: 4
Views: 2811

Hi,

Use the Sequencer jobs to run the job and now you can use the below function to define as paramter for the job.

Ereplace(Oconv(@DATE,"D-YMD[4,2,2]"),'-','')

This function will return the system date without '-' (e.x. YYYYMMDD).

Let me know i foyu need anything more.
by dinakaran_s
Fri May 01, 2009 8:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Add minutes to a date/timestamp
Replies: 3
Views: 2879

Hi, Create 2 stage variable for contactinating date and time rather than writing routine. In this below rule the time can have more than 2 digit as Hour (ex: 150:00:60). Lets us assume the input variable as below vDate = Date format vTime = time format **svDays stage variable calculates the no of da...
by dinakaran_s
Thu Apr 30, 2009 7:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Scheduling In Server Edition
Replies: 7
Views: 3590

Hi,

First make sure that the windows scheduler on the datastage server is enabled. If not request you Admin to enable the windows scheduler and then try through datastage.
by dinakaran_s
Mon Apr 06, 2009 8:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicated entries although using RemoveDuplicates stage
Replies: 10
Views: 5413

Sort the row before removing duplicates

Hi,

When ever you use "Remove Duplicate" stage, the incoming data should be sorted. As per your design, i don't think your imcoming are not properly sorted. Please try to sort the row before the "Remove Duplicate" stage.
by dinakaran_s
Tue Mar 31, 2009 7:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Help to identify the datastage process in the Task Manager
Replies: 4
Views: 2594

Sorry Man

Hi Ray,

I am really sorry. I really didn't mean to say that.
by dinakaran_s
Thu Mar 26, 2009 8:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Performance
Replies: 9
Views: 5144

Increase the array size in OCI Oracle stage

Hi,

Try to increase array size in hte OCI stage to 10,000. This will help to increase the performance.