DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
nsm



Group memberships:
Premium Members

Joined: 09 Feb 2004
Posts: 139

Points: 1347

Post Posted: Mon Jul 02, 2007 11:44 am Reply with quote    Back to top    

DataStage® Release: 7x
Job Type: Parallel
OS: Unix
Additional info: I wanted to know when should I go for Build-op
Hi All,

I rcently started working on PX and wanted to learn when should I go for creating Build-ops..Where can I find the help on Build-ops.

Tried finding in the helh pdf docs but no luck.

Thanks
nsm.
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 51947
Location: Las Vegas
Points: 282047

Post Posted: Mon Jul 02, 2007 3:30 pm Reply with quote    Back to top    

It's a bit hard to write a help manual for a stage in which you write the code ! What have you gleaned from the Parallel Job Advanced Developer's Guide ? Try asking for specific advice - ...

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Sydney and Melbourne
Rate this response:  
Not yet rated
bcarlson



Group memberships:
Premium Members

Joined: 01 Oct 2004
Posts: 772
Location: Minnesota
Points: 7799

Post Posted: Mon Jul 02, 2007 3:32 pm Reply with quote    Back to top    

Here's my 2 cents - and I apologize now for being long winded. I have my opinions, but I'll try to be fair to both sides...

I, personally, prefer buildops. But then again, I come from a background in C/C++ - not a big fan of Basic languages. Besides, my shop made the transition into DataStage PX from Torrent, not from DataStage server. Torrent is the predecessor to PX and only had buildops, no Transformer stage. We had 100's of jobs that used buildops, so we kept using them when we switched to PX and continue to use them exclusively today. And initially, buildops performed significantly better than the Transformer. That is no longer the case - transformers should perform just as well as a buildop. Lately, we have chosen to stick with buildops for the sake of consistency.

Another thing to keep in mind is that transformers are compiled by DataStage into buildops. So anything a transformer can do, a buildop can do. However, there are things a buildop can do that a transformer cannot do - simply because the buildop has the wealth of C/C++ programming at its fingertips. The next logical question should be - how often do you create a buildop that does things a transformer can't do ? Good question - not sure if we have really run into that here.

One of the downsides to using buildops is that the metadata of the transformations themselves are hidden from DataStage. If you use MetaStage for your metadata, you may not like that. We do not use MetaStage, so this has not been an issue for us. Our transformation documentation is completely independent of DataStage.

Another downside is that the vast majority of DataStage developers seem to be coming from the DataStage server arena and may not have had any exposure to buildops. However, anyone that has been introduced to C/C++ at any time (even just the ability to read it) should have no problem learning how to do it. For that matter, we have COBOL programmers that picked it up almost instantly.

From what I hear in interviews and read in postings, the most common approach seems to be to use Transformer for everything except the most complex transformatons - then use the buildop. If you are coming from a server background, this will probably be the easiest approach, since you already have familiarity with the transformer stage. Also think about your metadata and whether you use DataStage to gather your metadata info - easy to track with a transformer, not so easy with a buildop.

So, there is 2 cents. Hope this helps! Anyone else, feel free to pipe in here!

Brad.
Rate this response:  
Not yet rated
vmcburney

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup

Joined: 23 Jan 2003
Posts: 3523
Location: Australia, Melbourne
Points: 27300

Post Posted: Mon Jul 02, 2007 8:34 pm Reply with quote    Back to top    

Not coming from a C++ background I try to do things in the Transformer first or via the use of lookups for more dynamic business rules. I can see the value of buildops for modular and reusable comple ...

_________________
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn: Vincent McBurney LinkedIn
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours