DSXchange

Will the sparce lookup auto commit records:?: That's entirely a matter of how you design, and (I believe) what Arnd meant by "no buffering of output". YOU control the number of rows per transaction - for auto-commit set it to 1. and also using a sparce lookups will decrease the performance of the j...

Yes they are, according to DataStage's rules.

Yes it did.

Since you haven't purchased premium membership you are unable to read the entire reply.

You will need to provide five columns from DataStage, and your INSERT statement has six columns mentioned in the columns list.

Yes. But not directly because - being in Japan - Excel is set up to expect Shift-JIS. But you can specify different map if you open a worksheet then use the Import Data\Import External Data menu option (under Data menu, from memory). I think the field is called "File Origin" or something similar.

So we're back to "when and why did the job abort?"

That was not a part of your original specification!

Why not write a little routine to pre-process the file, to remove all the totally blank lines? This can be executed, for example, as a before-job subroutine, and the job reads its result (a different, but associated, file name).

You can not use it in the Transformer stage itself. You could use it through an Oracle stage of some kind servicing the reference input, and in the Oracle stage select a single row (from anywhere - DUAL will do) invoking the NEXTVAL property of the sequence. This will be abysmally slow. More usual i...

So you plan to put the Excel (.xls) file on a Unix machine? Good luck!! Or is it a text dump (.csv or .txt file) that you plan to put on the Unix machine? In either case you can work out which is the latest by checking the date/time accessed/modified, which the ls option suggested by ArndW uses to s...

Use job parameters, and references to them in the SQL - for example #zMonth# and #zYear# - instead of the "@"-style references.

Welcome aboard, and thank you for the useful advice.

I explained how the conversion is effected in my previous post on this thread. The "?" character is interpreted as a delimiter character, then the rules that I outlined are applied. Premium membership costs less than 30c per day and allows you, among other things, to read the entirety of posts by th...

The site where I am currently working uses UTF-8 almost exclusively, using Oracle databases. There are a couple of exceptions where external providers send text files encoded using Shift-JIS. DataStage copes perfectly well with both. The only mapping error I've encountered is a Japanese hyphen chara...

Different error handling in dsjob and in the GUI client, probably. It's just how it is.

Best practice is to check the job status prior to submitting a run request.

Because you probably missed some vital step in the New phase. It is really difficult to reconstruct the exact history of steps you took.