DSXchange

DS306 is the Ascential course designed by Mike Favero, Art Walker, Dale Nichols, and myself. It takes you thru a generic example of building a data warehouse ETL application. As part of that course, you learn and practice the concept of using hash files as a work area or sandbox to help manipulate t...

I don't know of any facility in DataStage to achieve flattening a hierarchy. This tends to be a relational operation. The best you'll achieve in DataStage using a single GUI job is: 1. Build a job with a fixed number of passes at the source data, with each pass handling a finding the parent of a chi...

It has nothing to do with DataStage's efficiency. Every database has an optimal loading solution for data warehouse environments: the bulk loader. Teradata is specifically a data warehouse database. It is less a relational database and more a specific creature of the data warehouse world. Redbrick a...

Have you ruled out using the bulkloading utilities available with Teradata (Multiload, etc)?

Databases are sources and targets. As reference objects they don't do well for a host of reasons. I'm not talking about joins, I'm talking about references, a totally different concept. As sources and targets, obviously, they are fine. But, when you have to manipulate, massage, or enrich data then t...

Check the Array Size field in the ODBC stage. Apparently, someone tried increasing this value to get a performance boost and didn't do the math to keep it in range.

You can search the forum for what phantom is. There's 3 different explanations: it's a directory, it's a background process, it's a stub program for running background processes. As for your troubles with compilation, the first check it a physical lock. If you don't see the job locked via the lock t...

You're right, there's no error codes specifically for dsjob. I might suggest a peak at

http://www.dsxchange.com/viewtopic.php?t=85578

to get an idea of how I handled wrapping dsjob.

Didn't mean for you to have dead air all day. I tried some options, but couldn't figure out a way to purely output the specific result from the command. Everything involved ksh commands to strip off the excess characters. The only other option would be a DS BASIC program that specifically does what ...

There are restrictions on things like numeric precision and such. Can you please state your issue?

Your comparison is Oracle references versus a .ds Merge or Lookup operation. In the words of Tom Kyte, you're comparing apples to toaster ovens. The whole problem with database reference lookup calls is the saturation issue on the database server side combined with repititive query combined with net...

What I mean is that the .ds file is just a pointer to the underlying data files in the DataFiles directory. Do I have to FTP all the underlying files as well. Thanks. Raj A .ds file is a specific work file structure that PX uses. It has no ability to be used by anything other than PX, so why would ...

Have you checked your Online Documentation? Under the Server job developer book, there is a whole chapter on the command line interface under the DataStage Development Kit. All error codes are explained.

1. Yes

2. Yes

The implementation of a type 2 has data modeling components as well as ETL components. You must know how your data modeling for your type 2 is done so that you can write the appropriate ETL logic. The table typically contains a surrogate key, a natural key construct column, a starting effective date...