DSXchange

There is nowhere in DataStage to change the metric. It only reports rows/sec. I really wish it didn't. Calculate the MB, and divide by the elapsed time.

Does D_HF_T84_ETLTRANSCO_ACCT (the file dictionary) exist?

Change your metric. Use MB/minute, as noted earlier. With 2MB per row (given that just your Long VarChar is 2MB) your 100 rows/sec equates to 1200MB/minute (over 1GB/minute), which is not too bad a transfer rate.

Or manage your expectations better.

Or introduce partition parallelism.

You use two stage variables to remember the value from the previous row and to detect when it has changed. Search the forum for detailed explanation of the technique.

Have your employer pay for you to attend DataStage Essentials class (code DX434 for version 7.5, code DX444 for version . These are really fundamental concepts; if you don't understand them then you will not be able successfully to design efficient parallel jobs. DSXchange does not purport to be a s...

Welcome aboard.

The only certain way is to inspect the score.

Monitor view in Director can also reveal this information.

It may be different for different stages.

When's the interview?

In total 31.

I think this must be an interview question somewhere - it's been asked (and answered in detail) with slightly different numbers about a week ago.

The best function is Index(). Its task is to search for (the nth occurrence of) a substring within a string.

Premium membership costs less than 30c (about INR12) per day, and will allow you to read the entire posts made by the five premium posters. This is one of the ways that the hosting and bandwidth costs of DSXchange are funded. No-one posting is paid to do so. The revenue from premium membership is t...

Environment variables are part of the (execution) environment - you can use them in operating system shells even on systems that don't have DataStage installed. Job parameters are exactly what the name suggests; placeholders whose values are supplied when (before) a job run request is issued. It is ...

A Search on that exact term turned up 17 hits (including this thread). Surely one of those has an answer for you?

How? It doesn't have a conditional expression.

Welcome aboard.

I, for one, would find it impossible to record on this forum all I have learned about the product over the past 12 years.

Try opening the Server Job Developer's Guide at random. See whether there's anything there that you didn't know before.

Convert blank source to null using an If..Then..Else expression. Test whether it's blank - if so, generate null. If not, leave it alone. Might be valuable to Trim() the source before testing. Target is irrelevant, provided that the columns to receive the nulls are nullable.

You specified monthly 2004 through 2007. That's 48 columns. Not sure how you're proposing to calculate week but, at worst, that's 212 columns. Just create them.