Search found 763 matches

by bcarlson
Thu Mar 10, 2011 10:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to identify jobs or projects that have changed
Replies: 4
Views: 3790

How to identify jobs or projects that have changed

We have weekly backups of our DataStage enviroments - XMETA database, WAS, etc. But this requires downtime. We would like to do daily online backups to guard against loss of work, espeically in development. One option we are considering is simply identifying projects or jobs that have changed and us...
by bcarlson
Tue Mar 08, 2011 12:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: AIX vs Win environment?
Replies: 4
Views: 2475

We have AIX at our shop (large IBM servers). Works great, but very expensive. I have been hearing rumors that our corporate infrastructure teams are being encouraged to migrate from AIX to Linux.

Brad.
by bcarlson
Mon Mar 07, 2011 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conn options for db2part operator
Replies: 5
Views: 3702

By the way, we did run into one issue/bug. The client (local) DB2 instance was a different version than the server (remote) instance, and so we had to explicitly set the DB2INSTANCE environment variable to point to the remote instance. We brought this up as an issue with IBM because other DB2 stages...
by bcarlson
Mon Mar 07, 2011 4:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conn options for db2part operator
Replies: 5
Views: 3702

When we talked to IBM, they said it was a known issue and sent us a custom 'db2part' operator with the necessary options. If you talk to IBM, the PMR we used is 34835,370,000.

Brad.
by bcarlson
Mon Mar 07, 2011 10:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata load balancing and DS
Replies: 3
Views: 4451

We process several terabytes a day (reading, writing, etc.), with tight timelines and so have used the previously stated "one-size-fits-all approach", knowing that it is overkill in some instances. The sheer volume of the conversion forced us this direction, but now we are needing to rethi...
by bcarlson
Fri Mar 04, 2011 2:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata load balancing and DS
Replies: 3
Views: 4451

Teradata load balancing and DS

We just finished a conversion from DS7.5 to Ds8.1, and DB2 to Teradata. We are now running Ds8.1 against TD13. There are approx 6K jobs and about 45% of them touch Teradata. To simplify the conversion effort, we have been using a one-size-fits-all approach and using 16 sessions per TD stage/connecto...
by bcarlson
Tue Jan 04, 2011 5:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problems using DB2Z stage to talk to Mainframe DB2
Replies: 2
Views: 1962

Our Infrastructure group is looking into this. One of the qeustions that came up is whether DB2 Connect can be setup on a client instance or if it can only be used on a server instance. Our own UDB is on a remote server, so our ETL server has a local client instance and the database is cataloged on ...
by bcarlson
Tue Jan 04, 2011 4:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: which purpose for scratch disk
Replies: 2
Views: 2268

By the way, we have 2 sets of scratch disk defined on our system. The first is 100GB of RAM disk (i.e. it is memory mapped to a filesystem, so really fast). The 2nd is a regular 500GB filesystem. If the first fills up, jobs automatically start using the 2nd. We saw upwards of a 50-60% effciency incr...
by bcarlson
Tue Jan 04, 2011 4:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: which purpose for scratch disk
Replies: 2
Views: 2268

Well, I think you have kind of answered your own question. It is temporary storage space for stages like sort, aggreator, etc. The scratch space is partitioned just like your datasets, so each node has space for work. Databases do teh same thing with temp space. I think the engine uses this space to...
by bcarlson
Tue Jan 04, 2011 4:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: issue with file read
Replies: 1
Views: 2017

When you import your data, do you need the field to maintain formatting (i.e. keep the carriage retruns) or ignore them?

Brad.
by bcarlson
Tue Jan 04, 2011 4:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problems using DB2Z stage to talk to Mainframe DB2
Replies: 2
Views: 1962

Problems using DB2Z stage to talk to Mainframe DB2

Has anyone used the DB2z stage before to talking to a mainframe-based DB2 database? We are running from Unix using DataStage 8.1 talking to DB2 OS/390 9.1.5 on the mainframe I am getting the following error message in DataStage: main_program: Qualified table name : DT3G.COMM_METHOD_TB. Resource bund...
by bcarlson
Thu Nov 04, 2010 5:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Conn options for db2part operator
Replies: 5
Views: 3702

Has anyone used a DB2 partitioner before against a remote database? It does not have options (in the GUI) to se username and password, so how do you set it up? We did discover that the OSH has those parameters, but for some reason they were left out of the stage in the GUI. Makes no sense...

Brad.
by bcarlson
Thu Nov 04, 2010 5:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How would you "over-partition" your data?
Replies: 7
Views: 3191

May have been a bad example, but that is the gist of over-partitioning, right?
by bcarlson
Wed Nov 03, 2010 3:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet rejecting null records
Replies: 7
Views: 7406

Not to get distracted, but when you say orchadmin is not installed right or not working, are you getting library errors? Something like this: exec(): 0509-036 Cannot load program orchadmin because of the following errors: 0509-150 Dependent module /opt/CA/UnicenterAutoSysJM/autosys/lib/libicui18n.a ...
by bcarlson
Wed Nov 03, 2010 3:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet rejecting null records
Replies: 7
Views: 7406

* What database are you coming from? * How is the data being read from the database? (SQL, table read, etc.) * How is the field defined in the database? * Have you confirmed that the data is stored in teh dataset as nullable? (Note: I like to look at the dataset on the server itself and check its sc...