And you could use File Schema Files and RCP to make a generic job and correct parameters to have 1 generic job to support this.
I just finished doing this for 15 files in, and using SQL in a file handled a generic delta load for updates and deletes.
Search found 136 matches
- Sun Aug 04, 2013 6:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: delete and load in odbc
- Replies: 2
- Views: 2281
- Sun Aug 04, 2013 6:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to read Mainframe tapes from IIS
- Replies: 5
- Views: 4001
Couldn't you use an FTP stage to bring the data from the mainframe tape and read it in? No landing and blocking is handled on the mainframe side automatically. It's been a while since I've used Mainframe FTP, but I remember there are some additional commands to handle it from Unix, but it can even h...
- Sat Jun 15, 2013 5:28 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: trimming spaces of varchar fields
- Replies: 4
- Views: 3081
- Fri Jun 14, 2013 2:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: trimming spaces of varchar fields
- Replies: 4
- Views: 3081
- Thu Jun 13, 2013 11:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: trimming spaces of varchar fields
- Replies: 4
- Views: 3081
trimming spaces of varchar fields
G'day, I'm having an issue where varchar fields with direct mapping are trimming leading, trailing and internal double spaces ... sometimes. I write sometimes because it doesn't always happen. Here's some of the suss data: CONTACT1_NAME|contact_name KAY -VICTORIA PAM -KAVANR|KAY -VICTORIA PAM -KAVAN...
- Thu Apr 04, 2013 9:36 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dropping decimal/fractional seconds
- Replies: 2
- Views: 2572
- Thu Apr 04, 2013 4:26 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dropping decimal/fractional seconds
- Replies: 2
- Views: 2572
Dropping decimal/fractional seconds
G'day, We are having a data issue reading timestamp 3 records from a sql server database on a unix platform. First time we noticed it was trying to add decimal seconds to an existing timestamp so Heisenberg remains happy, but the output always truncated the fractional seconds. At first i thought it ...
- Thu Jan 24, 2013 3:42 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How can I design this job with this logic?
- Replies: 6
- Views: 3624
G'day Bhana, I'm inherently lazy so I'd read each record and create a primary and secondary priority for them. If Status = 'A' the PRIORITY_1 = 1 else 0 IF POSITION = 'S' then PRIORITY_2 = 1 else 1 then sort on record_id, priority_1 desc, date desc, priotiy_2 desc. RD on record_id, keeping first 1. ...
- Wed Jan 23, 2013 6:10 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: slower ODBC Enterprise stage
- Replies: 11
- Views: 9852
G'day Zaino, Comparing two jobs that read different tables with different criteria will only lead to frustration. The two tables are different sizes, possible different predicates and you are transferring different amounts of data. So comparing the speed of your problem job to another isn't a fair c...
- Wed Dec 12, 2012 4:25 pm
- Forum: Site/Forum
- Topic: Slide-Ins
- Replies: 11
- Views: 11418
- Wed Dec 12, 2012 4:21 pm
- Forum: Site/Forum
- Topic: Slide-Ins
- Replies: 11
- Views: 11418
- Wed Nov 14, 2012 3:30 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sort and Filter gives different results run to run
- Replies: 5
- Views: 3716
- Tue Nov 13, 2012 10:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sort and Filter gives different results run to run
- Replies: 5
- Views: 3716
G'day PPP, First thing that comes to mind is a partitioning error. 1) Are you partitioning going into the sort (or carrying it Same from a previous partitioning) 2) Is the partitioning against the first part(s) of the sort These are the 2 most common reasons for this error I have seen 3) Is it null ...
- Thu Aug 16, 2012 7:27 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Set row "create_date" and "last_update_date&q
- Replies: 5
- Views: 3559
I agree with Craig. Split and insert or update separately. This is especially true if the number of updates is small. Upsert and update operations are incredibly time consuming in most databases, Inserts are normally very quicl. Insert/Update (or update/insert) tend to take a lot of time. Be careful...
- Mon Aug 06, 2012 12:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Records in sequential order...
- Replies: 11
- Views: 6007