Search found 3835 matches

by eostic
Fri Jun 25, 2010 6:33 am
Forum:
Topic: Data Lineage
Replies: 9
Views: 3925

Think of DataStage Jobs and Extension Mappings as equals.....(if you are in 8.1.1 or above).... they both connect resources. If you are on 8.1 prior to 8.1.1, then yes, only DataStage Jobs can paint lineage. Lineage is for Shared Tables and Files (and their columns), and Report assets, and for a few...
by eostic
Fri Jun 25, 2010 6:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Practices: Jobs as SOA
Replies: 4
Views: 1832

Hi Doug....tell us a bit more about the patterns you are looking at.....your title is Jobs as SOA (which often is a request/response pattern that rarely has a persistent store), but your initial question is regarding DataSets.... all good questions and thoughts --- just want to get an idea of what y...
by eostic
Fri Jun 25, 2010 6:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: regarding connection with webservice
Replies: 2
Views: 1052

Search thru the doc and in the forum for entries on Web Services Pack. It is designed to invoke simple web services from within DataStage. If these are services that provide a limited number of rows at the source, and the same at the target, you can use Web Services Pack for that, usually the WS Cli...
by eostic
Thu Jun 24, 2010 2:12 pm
Forum:
Topic: Data Lineage
Replies: 9
Views: 3925

Start here.... since we were discussing it, I decided to put an entry into my blog.... http://dsrealtime.wordpress.com/2010/06/24/data-lineage-vs-business-lineage/ You'll need to at least be on 8.1.1, which came out in June of 2009. This release allows you to create what we call Extension Mappings.....
by eostic
Thu Jun 24, 2010 12:11 pm
Forum:
Topic: Create your own Shared Tables and Shared Files....
Replies: 9
Views: 5297

a) We assume that you have 8.1.2 of BG and Metadata Workbench installed. b) We assume you have working "data" lineage that goes from, perhaps, a Shared Table as a source...thru a DataStage Job...and into another Shared Table as a target. [if not, let's start another thread on that topic......
by eostic
Thu Jun 24, 2010 10:46 am
Forum:
Topic: Create your own Shared Tables and Shared Files....
Replies: 9
Views: 5297

In 8.1.2 there is a feature called Business Lineage.... it is primarily designed for Business Glossary, but is visible also in Workbench if you also have the BG user role. It's a "higher" level view of lineage...one that includes only the data resources (sources, targetst, reports) in the ...
by eostic
Thu Jun 24, 2010 5:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can we convert MQ Stage to MQ Connector?
Replies: 5
Views: 2011

Nothing in particular.....the MQ Connector can do a lot more things, but most of them have specific purposes......If your job is "working", there should be no reason to change it. Here are some of the more significant reasons someone might move to the connector: It can do both MQ client an...
by eostic
Wed Jun 23, 2010 7:24 pm
Forum:
Topic: Create your own Shared Tables and Shared Files....
Replies: 9
Views: 5297

They become critical for data lineage when you want to connect DataStage Jobs to "other" software, other artifacts and other information....such as profiling details uncovered by Information Analyzer and Discovery, Cognos reports and Packages, or models imported from a variety of design to...
by eostic
Wed Jun 23, 2010 5:38 pm
Forum:
Topic: Create your own Shared Tables and Shared Files....
Replies: 9
Views: 5297

I'm talking here about "Shared Tables"...these are the formal tables that we see inside of xmeta --- the ones created today by using the little wizard inside of DataStage ("Create Shared Table from Table Definition") or via Import/Export Manager, or when you import via a Connecto...
by eostic
Wed Jun 23, 2010 5:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML error:Caught unknown exception from runLocally()
Replies: 23
Views: 13166

Exacly...it's a leftover from/during the metadata import process....and since <non> "happens" to look like xml, it makes sense that it had a problem. The current xml pack "overloads" the description as a place to carry xpath. Unfortunately it wasn't caught in 7.x. Ernie
by eostic
Wed Jun 23, 2010 11:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem in reading special characters ,while reading from MQ
Replies: 1
Views: 1349

It should be just "bytes". What problems are you having? I wouldn't try to view the data anywhere within ds, but if you write it to a sequential file, and open that with an editor that can see hex, I would expect the data to still exist as it was in the original queue..... how you "vi...
by eostic
Wed Jun 23, 2010 10:34 am
Forum: General
Topic: How to pass data to MQConnector
Replies: 5
Views: 1430

Ok...some things to try....

What happens if you just go from a Transformer into MQ? (skip your java stage).
Are you using MQ Connector or MQ Plugin?
What happens when you try the other?
Are you using MQClient or MQ Server mode?

Ernie
by eostic
Wed Jun 23, 2010 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Lineage in Job
Replies: 6
Views: 1862

I didn't find it at fix central, but maybe I missed it..... maybe it has to be requested specifically....anyway, I've been told that it's number if JR33537, if that helps. Let support qualify the requirement for you --- it's possible that the fix does other things also, or maybe it's rolled up somew...
by eostic
Wed Jun 23, 2010 6:06 am
Forum:
Topic: Create your own Shared Tables and Shared Files....
Replies: 9
Views: 5297

Create your own Shared Tables and Shared Files....

Hi all... Our engineering team has built a utility that allows the creation of Shared Tables and Shared Files directly from the command line via a .csv structure. Ultimately it will be posted in a DeveloperWorks article, and I will make it available at my blog. Will this be useful? Wanted to get an ...
by eostic
Wed Jun 23, 2010 5:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML error:Caught unknown exception from runLocally()
Replies: 23
Views: 13166

Do you want that column on your XML? If so, it needs xpath on the input link. If not, I would delete it from the link.

Why did it work before? Chalk it up to "code tightening." I am surprised it didn't get an error.

Good debugging work!

Ernie