DSXchange

I seem to recall that there's a Hive connector downloadable from developerWorks. Maybe that supports sparse lookup also. (I'm not currently in a position to be able to check.)

Review your xpath expressions.

The Big Data File Stage generates MapReduce script within Hadoop and executes that when called upon to do so.

Groan.

So what's your actual question? You've imposed some limitations on how the product works, so you have to work out how to code around them. But it's not clear exactly what you want to do. I'd guess that the answer lies in Parameter Set values files, but don't really have enough information to make th...

Don't be inconsistent in your use of string and ustring.

My bad. Editing original response.

in a BASIC Transformer stage.

(Edited from "MX0C" which is hexadecimal.)

Use a generic expression in the Transformer stage. For example: where jpLength is the desired length provided as a job parameter.

It's always been present, though the mechanism has changed. Every field has a "drop on import" property.

Can you log in with Administrator client (which uses a different mechanism)?

Follow precisely the instructions in the Planning, Installation and Configuration Guide.

With parallel jobs not all "Fatal" errors are fatal (cause abort). You can get red icons in the log but the job status is "Finished (see log)". I don't agree with that, but it does sometimes occur.

Yes but it would be very unwise in my opinion.

There is a purpose to "modify, test and deploy". In a word, it's known as "governance".

You can. No constraints, although it's slightly more efficient when a fixed-length format is available. The issue is that, with delimited files, the reader has to approximate the cutoff locations for each Nth of the file, and then scan for the next line terminator. With fixed width this is a simple ...