DSXchange

Download ETLstats for free from Kim Duke's web site and avoid re-inventing the wheel.

Only experience.

Are you using File Pattern or Multiple Readers Per Node properties? If so these will block First Line is Column Headings. If you read specific files, however, the First Link is Column Headings property is definitely available.

No, date format, for example 000001101101001000101010100010110101

The Match stages prefer Data Sets as their inputs. You should not provide them data from ".txt" format files. If you only need a sample to look at, interpose a Peek stage in the link between the Match Frequency stage and the Data Set, and direct the second output of the Peek stage to a Seq...

The If..Then..Else construct determines which of the two formats is used in the current row. It is sufficient to test the first four characters being numeric (which indicates YYYY-MM-DD format in your case). If Num(InLink.TheString[1,4]) Then StringToDate(InLink.TheString,"%yyyy-%mm-%dd") ...

You can use a BASIC Transformer stage in a parallel job.

Before/after job subroutines are server routines anyway, so you don't need to do anything about those.

You're going to need some If..Then..Else logic to differentiate the formats, and apply the appropriate conversion in each case.

The data type is integer but you have spaces. Spaces is not a valid integer.

Create an identical sequence with the run mode of every job activity set to "Validate".

If you want a more self-documenting variant, you can use %(m,v)

I'm sure I've seen it, but it may have been in an IOD presentation or a "what's new" paper rather than the manuals. The manuals are organised somewhat differently in 8.7 - there are four manuals dealing solely with metadata, for example.

Are you specifying port number 9080 with the domain?

You seem to be using a sledgehammer to crack a nut here. I'm guessing you are setting up WHERE clauses for something downstream, maybe a Filter stage. Why not use type <> "A" as the first expression itself?

Locking in the Oracle database?