Search found 3045 matches

by vmcburney
Thu May 31, 2007 5:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performing Lookups on Large tables
Replies: 4
Views: 1080

You could use a database input stage and a lookup stage to join the table to itself - but you would be reading the 10 crores of data in twice. The user-defined SQL in a database input stage lets you join the table on the database engine and bring the data to your ETL server just once. It performs a ...
by vmcburney
Thu May 31, 2007 1:00 am
Forum: General
Topic: Quality Stage Server & EE run
Replies: 2
Views: 1192

I think you should wait for QualityStage 8 before you redesign any of your jobs for parallel processing. QualityStage 8 and run your QualityStage 7 jobs as legacy jobs or you can keep QualityStage 7 server running. QualityStage 7 parallel jobs may need some rework to run under version 8 .
by vmcburney
Wed May 30, 2007 8:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: using SIEBEL PACK
Replies: 8
Views: 1612

This looks like a transformer error and not a Siebel PACK error. If you create a job with the Siebel PACK writing the data directly to a Sequential file stage do you still get an error? It looks like you have derivation code in your Transformer that is aborting your job.
by vmcburney
Tue May 22, 2007 9:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Online Documentation
Replies: 6
Views: 1309

DataStage has the generate report function, MetaStage has publish to browser, the new Metadata Server has a browser based reporting tool. You can see more options in the FAQ or my post Navigating your project through the documentation Bermuda Triangle.
by vmcburney
Tue May 22, 2007 8:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: 2 datastage servers
Replies: 5
Views: 1358

They can co-exist on the same server. You can use the client switcher on your desktop. The tricky part is segregating files and jobs. There can be some confusing if both projects are trying to read or write the same datasets. There will also be a database repository and WebSphere Application Server ...
by vmcburney
Wed May 16, 2007 11:57 pm
Forum: General
Topic: Moving from DS Server to EE
Replies: 4
Views: 1484

Your existing DataStage and QualityStage jobs will run without any modifications on both a DataStage EE 7.x and 8.x implementation. On 7.x the full server environment runs alongside the parallel environment. So you only need to convert server jobs to parallel jobs if you want them to take advantage ...
by vmcburney
Tue May 15, 2007 9:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how read cobol file and flaten the column
Replies: 2
Views: 804

You need to look at the help file and the PDF for the complex flat file stage. The trick is defining the file - you need to impart a Cobol copybook definition of the file. You may need to make some minor adjustments to the file for DataStage to recognise it as some copybooks do not conform strictly ...
by vmcburney
Mon May 14, 2007 7:47 pm
Forum: General
Topic: datastage versions 7.5(EE)/7.1/6.0/5.2
Replies: 4
Views: 2045

It is a bit of a chore going back through all those previous versions. There are a few release notes to get through including the point releases and you can't really compare DataStage 5.2 to EE since they are radically different products. If you are preparing for a job interview the correct answer i...
by vmcburney
Sun May 13, 2007 7:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Are Server jobs will run on PX?
Replies: 6
Views: 1100

You just need to make sure whoever installs it enters both the server and enterprise authorization codes. I've seen installs where they only enter the Enterprise code and this will prevent server jobs from being installed.
by vmcburney
Thu May 10, 2007 9:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Adavantages of using db2 query or data stage??????
Replies: 8
Views: 3692

I dislike any transformations in the SQL select statement as they are mostly invisible to metadata reporting and can be hard to document and maintain. I would argue both the 50 case statement and 50 IF statement are both flawed. You should be looking at creating some type of business rule mapping ta...
by vmcburney
Thu May 10, 2007 9:06 pm
Forum: Data Integration
Topic: DataStage versus SQL Server Information Services
Replies: 11
Views: 19414

10 Million records a month. You could use DataStage if you wanted to process this in under an hour but SSIS should be able to churn through this in a month. You should find that SSIS can load it and SQL Server can store it but the challenge is how much of that data you need to make available to user...
by vmcburney
Tue May 08, 2007 9:05 pm
Forum: Site/Forum
Topic: 20,000 just around the corner?
Replies: 6
Views: 3361

I haven't thrown in the towel, if you retire and I keep posting at my current rate for another 40 years I can overtake you.
by vmcburney
Tue May 08, 2007 6:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Not showing up link count
Replies: 6
Views: 1749

Or that it didn't reject all the rows due to metadata mismatch. You got a reject link on that sequential file stage?
by vmcburney
Tue May 08, 2007 12:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Current Row and Previous Row
Replies: 6
Views: 4277

Since this is a parallel job make sure you have sorted and partitioned by your Name field so that matching rows are adjacent to each other and on the same node in the Transformer.
by vmcburney
Tue May 08, 2007 12:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Difference between version 7.5 & 8.0
Replies: 3
Views: 1269

The DataStage Designer is not that different. QualityStage is fully integration so it has a complete GUI overhaul. Have a look at www.squidoo.com/datastage8 for links to DataStage 8 information or search this forum for DataStage 8 threads.