DSXchange

Sure, as long as the amount of data being feed into any fifo never exceeds a certain amount without the reader of the output draining it at or near the same rate. Think of it this way: You have a job OCI --> XFM --> fifo --> OCI. If the source OCI stage is spooling at 10000 rows/s, and the target OC...

The link collector uses a fifo buffer, such as a pipe, to hold incoming rows and feed to output side. Or, simple write the data to a file and then read back from the file. The difference is the fifo can feed the output at the same time it's receiving input, the passive stage must receive all input r...

Absolutely. Use job instances with a constraint that divides the rows evenly among the instances. Each job is responsible for a portion of the data. You can run 4 copies of the job, each inserting 1/4 of the rows. This is quite easy and elegant and we were doing this long before PX. I've got a docum...

I've got a DS Batch job that compiles other jobs. You could run this job to go recompile jobs. You can adapt it however you want. Get it from my website. You run it from the command line, have it go find "Running" jobs (or just do all jobs) and recompile them. Since it's a job, you can start it usin...

True Craig, but if rollback space does not allow commit at the end you'll have to commit as you go. Will that still work if you do periodic commits on separate links? I think you'll get into some issues there. I believe with double, triple, or more links you could get into a situation where you're r...

Hmmm, loading parents simultaneously with children. I'd think a best practice would be to do parents first, then do children. You'll benefit from dedicated mass loading of a single table instead of straddling two tables. But if what you're doing is more "real-time" microbatch using Server rather tha...

Resetting a job is the same as running. If the status is "Running", you CANNOT "run" it again in RESET mode. See my previous post, I don't like repeating myself.

Use DS manager to either export it from another project and import it or
go to DS Manager and under Routines folder create a new function from the File-->New Server Routine menu. Name it DateIconv and paste in the supplied logic.

Is every single job restartable from wherever it was in the middle of processing? You're sure you won't have to deal with corrupted files and such? How about data already loaded and committed? What about cleaning up temporary files and such? A hard crash usually needs a little cleanup. If the server...

Derivation for d is: If NOT(ISNULL(A)) Then A Else If NOT(ISNULL(B)) Then B Else If NOT(ISNULL(C)) Then C Else "Unknown"

I recognize your function. Here, use this logic, as I'm guessing your site has a set of my routines. Before DS 5.0, the ICONV function didn't recognize certain formats of dates. This function explicitly looked at certain date formats, including those with time elements which fouled up ICONV. DateIco...

I re-read your original post. Remove all columns from the output link, just leave one column. Then try debugging why the database believes that a value is being passed to DML that doesn't match the datatype.

For the error message, can't tell you why. But for your query, use LIKE not =

To use stage variables, you must first sort the data by the grouping keys. Then, setup a stage variable to hold the group key values. On each change in the group key value, output the row. Then, the first row will always be output, and the subsequent rows with repeating key values will not.

sendmk wrote:yes all the rows all entirely similar

Saying "similar" is not specific, I asked you to clarify. Don't just say a "duplicate" row. Do the keys repeat with different attribute data, or do the keys repeat with identical attribute data? A solution for both has been given.