DSXchange

Posted: **Tue Mar 14, 2017 5:58 pm**

cdp wrote:In the Big Data File stage documentation there is no such mention and I understand that the Big Data File Stage CAN access non BigInsights HDFS:

To use the Big Data File stage, you must ensure that the stage can access the HDFS libhdfs.so shared library, its associated JAR libraries, and configuration files.
If you are using the Big Data File stage to access an InfoSphere BigInsights HDFS by way of the REST connection method or from an AIX operating system, the InfoSphere BigInsights libhdfs.so library is not required.

If your understanding is based on the If you highlighted, I assume you also need to bold the "by way of the REST connection method or from an AIX operating system" statement as that is what it applies to. Not just the "if BigInsights" bit. And that just to say you don't need to ensure access to the shared library. At least that's how I'm reading it.

Or does your understanding come from elsewhere?

Posted: **Wed Mar 15, 2017 11:51 am**

The Big Data File stage is available in DataStage Designer 11.3 on our system, and we do not have InfoSphere BigInsights installed. Its properties look the same as a regular Sequential File stage.

Posted: **Wed Mar 15, 2017 12:27 pm**

Available or available and usable?

Posted: **Wed Mar 15, 2017 2:16 pm**

chulett wrote:And that just to say you don't need to ensure access to the shared library. At least that's how I'm reading it.?

Yes, you're right.
But anyway, the mystery remains for now:

To access a Hadoop Distributed File System (HDFS) with the Big Data File stage , you must make the libhdfs.so [...]

I understand 'a' as in 'any'

Posted: **Wed Mar 15, 2017 2:58 pm**

Question for support, then. Or an English major. Or both!

DSXchange

File Connector, Big Data Stages - BigInsights compatibility

Re: File Connector, Big Data Stages - BigInsights compatibil

Re: File Connector, Big Data Stages - BigInsights compatibil