DSXchange

Huh? If it's not ASCII, what is it? EBCDIC? Binary? Octal? What stage is getting the data?

Google remsh, rlogin, rsh

All let you run commands on remote servers. DS jobs CANNOT start a graphical program, but can run straight DOS, perl, java, ksh, sh, and programs with stdin/stdout.

Sure the session limit is unlimited, but your 100's of sqplus sessions, what are they doing? Are they all simultaneously streaming data? I've seen your exact problem when there were too many clients attached, maybe your DBA can twiddle some settings to mitigate. My first guess is the client software...

Create two jobs: OCI-->XFM-->SEQ and SEQ-->XFM-->OCI. You'll see how fast the data spools, and how fast the data inserts. As for the PL/SQL argument, she's lost it already. It would be faster to use straight DML, because of parallel query processing capability. "INSERT INTO target.table (...) SELECT...

Look at the dsjob command line program. It can be called successively with different options. Write a .ksh and you're all set. Valid primary command options are: -run -stop -lprojects -ljobs -linvocations -lstages -llinks -projectinfo -jobinfo -stageinfo -linkinfo -lparams -paraminfo -log -logsum -l...

Row processed information is accessed using the APIs documented in your DS BASIC manual. Why are you trying to run DS Engine SQL statements against internal undocumented structures? The APIs cleanup the data and make it easily available, you're going to spend 100X the amount of time doing it the unk...

Your problem is malformed data. For each column definition, go to the metadata and set the action to be replace and give the appropriate replacement value. I guess 032 doesn't work for a "space", so just put a space there or check the help to see if it has another way. The Merge stage is kind of tou...

If the table yesterday was partitioned one way, and today is another, obviously the data had to be ported from the old copy of the table because the partitioning key has changed. That being said, the new method for partitioning may have shifted the data around differently. Comparing yesterdays loads...

You're exhausting some resource, DataStage is not your problem. Your Oracle client on the Unix server could be running out of memory. Consider running fewer simultaneous processes and see if your problem goes away. Chances are you're going to have to keep trying various combinations until you figure...

You can pull design metadata from the designs using MetaStage, but if you're not familiar with the tool, its conceptual usage, the job dependencies, physical staging structures, transformation stages, etc, you won't understand the design metadata. It's not a SQL generator, so you can't just read SQL...

Here's some logic you can paste into a DS Batch job and see how things work. Ultimately, get it working how you need and then move it into a DS Routine. Use it in a Sequencer job to get the file name and then start your transformation job giving the file name parameter value. This logic should get a...

In your job control (Batch, Sequencer, or custom job control) you can use a Unix "ls" command to get a file listing, capture the screen output and parse it for the name. You could also use "find" to search in case you don't know which directory the file will be in. I guess you could also write a she...

You can executed OS commands, scripts, and programs by using the DSExecute API from a routine. Just execute sqlplus and pass it the script name. Stick to sqlplus via sqlnet and avoid ODBC because licensing is not supported for usage outside a transformation job.

Okay, but a "Clear table" is a "DELETE FROM TABLE" statement in the DB2/UDB world.

Use any method you know to look at a directory and fetch the file name. Feed the file name as a job parameter and use in the sequential stage as well as a derivation for your particular column. You need to read your Teradata manuals to learn more about the bulk loader for Teradata (multiload) and wh...