cdp wrote:In the Big Data File stage documentation there is no such mention and I understand that the Big Data File Stage CAN access non BigInsights HDFS:
To use the Big Data File stage, you must ensure that the stage can access the HDFS libhdfs.so shared library, its associated JAR libraries, and configuration files. If you are using the Big Data File stage to access an InfoSphere BigInsights HDFS by way of the REST connection method or from an AIX operating system, the InfoSphere BigInsights libhdfs.so library is not required.
If your understanding is based on the If you highlighted, I assume you also need to bold the "by way of the REST connection method or from an AIX operating system" statement as that is what it applies to. Not just the "if BigInsights" bit. And that just to say you don't need to ensure access to the shared library. At least that's how I'm reading it.
Or does your understanding come from elsewhere?
-craig
"You can never have too many knives" -- Logan Nine Fingers
The Big Data File stage is available in DataStage Designer 11.3 on our system, and we do not have InfoSphere BigInsights installed. Its properties look the same as a regular Sequential File stage.
Choose a job you love, and you will never have to work a day in your life. - Confucius