DSXchange

You can only concatenate together string fields.

Search. Post the error.

Deadlocks are not a 'performance issue'. And I'd wager if you took the error you're getting here and searched for it, you'd get the answer you're looking for. Failing that, post the error.

Which specific records are being dropped?

Keep in mind it was just a thought... me, I'd stick with reading the file as a single string and do the parsing inside the job.

So are we. What "the path" are you hard-coding / parameterizing?

Missing 'the picture below'. But if we're talking a relational database like Oracle, I'm assuming standard OCI connectivity would be fine. Or ODBC if you like. Apologies if everyone else knows what "RDM" actually stands for but I don't and using more acronyms to define an acronym didn't re...

If there are no grouping columns you will at some point need to perform a count sequentially (otherwise you'll get one answer for each partition). Good point. That's true... unless (as you noted) there are other columns not mentioned that will allow say a hash partition so that does not become an i...

You could try defining the first 500 as individual fields and then just leave the last 300 (or whatever) as an optional post-read parse. Or just read it as a single string and parse it later using the Column Export stage (unless, of course, it's the Column Import stage that goes 'one to many' - I ne...

Hard to say but the first thing that comes to mind is read it was a single 800 byte string then check the actual length or each record. From there you can go down either a 500 or 800 byte path to parse it appropriately. Clarify something for grins - is the 500 layout a subset of the 800 or are they ...

Why do you think that? Are there other requirements for grouping that you haven't shared?

First off, let's get you into your own post rather than one that's four years old. Secondly, you'll need to provide a wee bit of details before anyone can provide any cogent help or anything that the thread I split you out from doesn't already cover. So... tells us about your job design(s) - how/whe...

Sorry... RDM?

What exactly is "the schema reconciliation issue"? If you are getting error messages, please post them.

That's how it handles decimal values written to a file. If you want some other behaviour, define the output field as a string and use DecimalToString() to get it formatted however you need it.