Search found 21 matches

by andru
Wed Mar 16, 2005 5:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Removing Duplicate records from a flat file
Replies: 5
Views: 2446

Use "Update else insert new rows" option to insert new rows and update exiting rows.
If you want to delete the records which are already present in the table, then while updating mark a flag to those records. In the after job SQL you can delete those records with that flag.
by andru
Tue Mar 15, 2005 1:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ODBC Stage on Sybase
Replies: 6
Views: 2648

We solved this problem by just upgrading our sybase driver. Thanks.
by andru
Wed Feb 23, 2005 5:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ODBC Stage on Sybase
Replies: 6
Views: 2648

ODBC Stage on Sybase

We have difficulty in accessing sybase server using ODBC stage, whereas We were able to connect thru SYBASE stage.

DSN in working fine from datastore administrator. But when conenct through the DS for importing table definitions, it just hangs. Any idea on what is the problem?

Thanks.
by andru
Wed Feb 09, 2005 11:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: inputs required on the design...
Replies: 8
Views: 3710

The design will work fine w.r.t performance provided the tabels referenced in both the streams are different. You can try using a IPC stage between the ODBC and seq. stage. I have heard using IPC explicitly is mroe powerful than implicitly defining it in the project properties. Also if the o/p seq.f...
by andru
Tue Feb 01, 2005 1:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage TX Vs DataStage Server Edition
Replies: 0
Views: 785

Datastage TX Vs DataStage Server Edition

Can someone let me know if datastage TX is a data integration tool or just an application intergration tool. Heard from one of my colleague that TX jobs used for DI purpose are performing very pathetically when compared to DS server jobs. Just curious to know if there is some restriction in using th...
by andru
Tue Feb 01, 2005 12:15 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Insert/Update IMS DB
Replies: 4
Views: 3791

If we have Enterprise MVS edition on Unix, can we not execute the cobol program from the External Target Stage? Update on IMS is required for a feedback mechanism in ODS system. Should I have a batch file to trigger a DS job to dump the data into a file and then trigger a cobol program to update a I...
by andru
Mon Jan 31, 2005 7:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Insert/Update IMS DB
Replies: 4
Views: 3791

Insert/Update IMS DB

Hi,

I'm aware that we can access data from IMS database using IMS stage in MVS edition. Is there a way to insert/update data into IMS database from DS? This is a urgent requirement. any help is highly appreciated. Can the same be done on a DS390 on unix platform?

Thanks.
by andru
Thu Jan 27, 2005 3:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Validating records using Key Expression in transformer
Replies: 4
Views: 2499

Also make sure you do not have any numeric lookups on hash files. Convert all numeric fields to char fields before you do a lookup. For some reason, numeric lookups do not return proper value in hash file lookup.
by andru
Mon Jan 24, 2005 4:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Issue with sort and group by
Replies: 4
Views: 2165

If your input can be sorted in the desc order of the year, then you can do the same thing which the routine does in the transformer stage itself. declare three stage variables as below Derivation Stage Variable rowproccomparewithpreviousvalue(key) keychg if keychg then 1 else count+1 count (initial ...
by andru
Mon Jan 24, 2005 1:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error in Aggregator Stage
Replies: 4
Views: 2362

I agree with Rasi on avoiding aggregator stage for huge data. As sugessted you can dump the data into a temp table and do a group by query on the table to find the min value. Another alternative is that u can dump the data into a hash file with a transofmer in between. Let the key for your target ha...
by andru
Fri Jan 07, 2005 3:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issue
Replies: 5
Views: 2692

We work on a 16 CPU box with IPC on. We had a job with more than 20 stages which was performing very poorly. We split the job into 4 with intermediate files. The performance has improved considerable. So with my experience, I feel splitting the job into chunks should improve ur performance.
by andru
Mon Dec 27, 2004 12:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Partitoned Table in server jobs
Replies: 4
Views: 2158

Partitoned Table in server jobs

Hi, From the search I did on this forum on partition table, I understand that PX jobs can talk to partitioned table concurrently. But what will be the case with the server job. I guess server jobs cannot talk to different partiotions concurrently from a server job. If so, what is the use of having a...
by andru
Fri Dec 17, 2004 2:42 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Regression Testing
Replies: 2
Views: 2555

Regression Testing

Hi,

Is there any regression testing tool available for data stage. If not. what will be the approach for doing regression testing in data stage?

Thanks.
by andru
Thu Oct 28, 2004 12:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multiple hash files in a single stage
Replies: 3
Views: 1792

Siva, I feel wht u have told will be a case when you access the same hash file using multiple links from the same stage. But when you try to access multiple different hash files using the same stage, it will try to load the data of all the hash files in the same memory. Also the connection made will...
by andru
Thu Oct 28, 2004 12:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multiple hash files in a single stage
Replies: 3
Views: 1792

Multiple hash files in a single stage

Hi,

How will this work? Trying to access multiple hash files from the same stage using different links. Preload to memory is enabled.

My doubt is
1. Will the performance degrade?
2. Since the same memory will be used by all the four hash files, will there be any data leakage?

Thanks.
Uma