DSXchange

That's fine and where one typically leverages UserStatus. I for one use a Stage Variable for this and set it so that it only gets called on the first row through the job - no need to set UserStatus a million times if you are processing a million records.

Viewing data from the target side is a little bit of a different animal as there's no "select" query in the stage for it to use. What is your "update action"?

Dang, you need to slow down on the replies. Ok, but here's the problem ... I need a filename to send to a stored procedure. If I cannot output the filename from the folder stage to a sequential file, how am I going to use that filename to send as an input parameter to a stored procedure ? Of course ...

Typically I would concatenate all of the files together than process the concatenated result, but you need the individual filenames, yes? Then you may need to consider a looping Sequence job, one that gets a list of files with the UserVariables Activity stage and then the Start/End Loop stages to ru...

Right, as noted the Folder stage was designed for processing XML files but (technically) can be used with other file types. You can only create one or two columns, with two columns: * Column 1 contains the filename of the current file being processed. * Column 2 contains the complete contents of the...

Ok... the Folder stage isn't really about 'transferring' files anyway.

As noted, search the forums for the phrase "vertical pivot". The how to implement part has been posted many times out there.

Well, if you've tested that you can still get UserStatus information from an aborted job and it works, then it works. Test all of the other scenarios on your own so you know if each works (or doesn't work) in your environment. Curious what "in the starting of the Job itself" means - as a Before Job ...

It will be set when Job1 completes normally. What will 'overwrite' (basically unset it) would be if the job aborts, is reset or is recompiled. And as far as I know, multiple jobs can access another job's user status information without issue. I've never had any issues doing so in any case, it's not ...

Do you have a derivation in that transformer using "GE" for "greater than or equal to"? If so, replace it with ">=" and see if it will compile.

No, Still the Hashed File gets updated, after using the sequential file also. You seem to be missing the point here, that or your description of the job design doesn't match what you are actually building. What exactly are you saying here? Of course the hashed file gets updated, but only if the job...

Hmmm... maybe it was the fact that he had a Server job that could produce the file but no PX job could read it. [shrug]

Technically, there is no "full outer join" option in the Merge stage. From what I understand, the closest you can come is the Complete Set and it is more of a "union all" than a join of any kind.

I believe it works in Server but not in PX for some reason. Search for topics on the subject by Phil Hibbs and his problems with a rusty 6" nail.

If you've got some way to check, check and then pass in the found filename as a job parameter. But if your check is an FTP script, then you might as well do the 'get' while you are out there checking.