Connection to HDFS through BDFS Stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pillip
Premium Member
Premium Member
Posts: 50
Joined: Thu Dec 10, 2009 10:43 am

Connection to HDFS through BDFS Stage

Post by pillip »

hi,

We are getting the following error while connecting to HDFS through Big Data File Stage

Unable to connect to host hdfs server though port 9000.

Can anyone who worked on bdfs stage let us know what is causing this error.

The biginsights server is pinging fine from DS Engine server.



Thanks.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Can you check that the Hadoop server is listening (successfully) on port number 9000? This is the next step on from a ping test, which only shows network connectivity. Use netstat and, perhaps, telnet commands to test the port.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
pillip
Premium Member
Premium Member
Posts: 50
Joined: Thu Dec 10, 2009 10:43 am

Post by pillip »

The Hadoop server is listening fine. Below is the exact error which we are facing :

Unable to connect to hdfs host on port 9000: Socket operation on non-socket.
pillip
Premium Member
Premium Member
Posts: 50
Joined: Thu Dec 10, 2009 10:43 am

Post by pillip »

We have used netstat and telnet commands to test the port. The Biginsights (hdfs) machine is listening fine too. Below is the exact error we are getting.

Unable to connect to hdfs host on port 9000: Socket operation on non-socket.


Thank you.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Contact Support.
Choose a job you love, and you will never have to work a day in your life. - Confucius
asaf_arbely
Premium Member
Premium Member
Posts: 87
Joined: Sat Jul 14, 2007 2:24 pm

Post by asaf_arbely »

Did you find a solution for this connection issue?

We are are getting the same error on a new DS 9.1.2 installation while old DS 8.7 connecting to the same HDFS can connects fine.
Post Reply