DSXchange

A Cluster is a group of Datastage servers where The admin/designer designs the APT file to use the compute node resources available. A Grid uses software to auto-gen the APT file to use a subset of resources based on compute node use. If you have a group of 25 compute nodes, the designer would write...

Increase your /tmp workspace or have Datastage use a different disk for it's soft workspace. When you sort data, all the data must be present in order to determine the order of the data. This may require more memory than the system actually has. Datastage uses a scratch workspace on the HDD to proce...

You can execute a Before/After routine. You may also use the "External" stage on your Datastage desktop to execute a routine.

Finally, you can create a wrapper BuildOP for execution of an external routine.

Cheers,

Ray D

You need to ask a question with more details.

The Switch Stage is a Datastage ETL stage used much like an SQL Where clause. SQL is a database language used to manipulate data.

Setup your Seq stage to read the 3 files using a wildcard. Create a new column as part of the take-on that is the name of the source file (use a parameter maybe?) Use a hash partition method on the source file key you created above and the data will be grouped in the same way as the take-on. Cheers,...

Better yet, perform a VALIDATE on the job. There is a tab when you try to run the job for validation.

This will ensure that all resources are available to the job. It will also create any missing Hash tables if you have checked the box in your hashed file stage to create the table.

Regards,

Ray D

Hi All, Why not create custom SQL within the Oracle stage? This way you won't pull 17Million rows of data across the net. Datastage can initiate the SQL thru a Datastage job. I'm at a site right now where we are trying to do something similar, but with 2.3 BILLION rows of data on a multi-node grid. ...

Always use the Teradata MLoad stage. Bulk loading will be much faster.

Ray D

This was a special patch done for the client. I don't know how this is going to be distributed.

Ray D

Well I am trying. Ohhhh.... the OTHER Ray :)

Well, since Ray W is slightly older than me I guess he get's to use the name without extensions :)

Define the columns as you would a COBOL flat file. Use CHAR(10) which represents the full length of the string (ie INPUTVAR[20, 10 ] Make sure you define the sequential input by it's full block length. This will be processed sequentially, but the decode of the flat file will be done in parallel if y...

Thanks Arnd, you took the words from my typing fingers :). I searched the system for dataset and magic but I did not discover your posting. That would have saved the group my rantings. FYI, I'm doing some Datastage admin work for a large datastage site using offshore contractors. Sometimes the jobs ...

I'm looking to update a unix (linux) MAGIC file so I can scan a directory and identifiy both Dataset headers as well as Dataset parts for cleaning/purging older datasets on the system using the file command to identify the object. I've identified that all Dataset headers start with "Torrent Orc...

Do you have the Oracle CLI installed on the Datastage server? You need this if you are accessing oracle by the Oracle plugin.

Otherwise setup your ODBC to access the oracle environment and try importing the metadata by ODBC.

Regards,

Ray D

Your post is for a unix platform. Sendmail also runs on windows