can Datastage be a Service Consumer

Puli · Post by **Puli** » Tue Jul 07, 2009 11:45 pm

hi Experts,

As of i know Datastage can act as Service Providers where we develop jobs and deploy them.

I want to know how to implement Datastage as a Service consumer to get the information from other service providers like Jakarta-Tomcat.

My exact requirement is, In middle of Design of DS job as service provider using WISDL-input/WISD-output stages, i want to implement this service_consumer_Concept part to get some information from External service provider and process them process them along with my job.

WISD_INPUT---->Transformer--->NAME&ADDR_STANDARDISATION---------->Get_Information_from_External_ServiceProvider---->LoadDB--->WISD_OUTPUT

Thanks

lstsaur · Post by **lstsaur** » Wed Jul 08, 2009 1:04 am

It's better to create a seperate job for your "service_consumer_Concept part" because you are inside your company's firewall.

Puli · Post by **Puli** » Wed Jul 08, 2009 4:55 am

To proceed developing in a standalone desing...do i need to use Webservice_Transformer stage?

i tried with Webservice_Transformer stage in a seperate job for accesing the external service. its compiling with no issues. while running throws fatal error andaborted.can you please help me on this?

the Error as follows:

Web_Services_Transformer_10,0: Error: TJClient::initialize: unable to create Java Virtual Machine; classpath = /opt/IBM/InformationServer/Server/DSEngine/java/lib/wsclient.jar
/opt/IBM/InformationServer/Server/DSEngine/java/lib/axis.jar
/opt/IBM/InformationServer/Server/DSEngine/java/lib/commons-discovery.jar
/opt/IBM/InformationServer/Server/DSEngine/java/lib/commons-logging.jar
/opt/IBM/InformationServer/Server/DSEngine/java/lib/jaxrpc.jar
/opt/IBM/InformationServer/Server/DSEngine/java/lib/saaj.jar
/opt/IBM/InformationServer/Server/DSEngine/java/lib/wsdl4j.jar
ASCL-DSJNI-00011`:`JNIWrapper: load library failed: directory /opt/IBM/InformationServer/Server/DSEngine/java/jre/bin/classic, name jvm
/opt/IBM/InformationServer/Server/DSEngine/java/jre/bin/classic/libjvm.so: cannot open shared object file: No such file or directory

Fatal:Web_Services_Transformer_10,0: Error occurred in call to ORPHCallActivePluginInitialize().

Followed to this i added some parameters:

DATASTAGE_JRE=$ASBNode/apps
DATASTAGE_JVM=jre/bin/j9vm

still with same issue...

Please help for solving this issue...

thanks in advance....

eostic · Post by **eostic** » Wed Jul 08, 2009 5:42 am

The "unable" to find jvm is 99% the env var issue as you noted, although the values of these are slightly different for every platform. Search around..there are a lot of entries in here on this topic, for both the WSTransformer as well as JavaPack.

Assuming you get past that in your test job, make sure the web service you initially test with is very simple --- single row in and single row out, and no security, and with a simple SOAP envelope....a basic request/response row with a couple of columns. Make sure you know it works from the same env where DS is, using an alternative tool to test it.

Once you have it tested and working and know it's behavior, it can be used in a WISD job..but it's very hard to debug it there. Get it working first as recommended earlier in its own job.

Ernie

Puli · Post by **Puli** » Tue Jul 14, 2009 2:33 am

Thanks for your comments
This time we fixed the javaruntime in our DS environment and its not throwing the previously mentioned error.

after its fixed i got another hurdle like failed invocating,

APT_CombinedOperatorController,0: Fatal Error: Fatal: 0026`:`com.ascentialsoftware.wsclient.ServiceInvocationException: Service invocation exception: <ns1:Fault xmlns:ns1="http://schemas.xmlsoap.org/soap/envelope/">
<faultcode>soapenv:Server.userException</faultcode>
<faultstring>java.net.ConnectException: Connection refused</faultstring>
<detail>
<ns1:stackTrace xmlns:ns1="http://xml.apache.org/axis/">java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:336)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:201)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:188)
at java.net.Socket.connect(Socket.java:478)
at java.net.Socket.connect(Socket.java:428)
at java.net.Socket.<init>(Socket.java:335)
at java.net.Socket.<init>(Socket.java:150)
at org.apache.axis.components.net.DefaultSocketFactory.create(DefaultSocketFactory.java:129)
at org.apache.axis.transport.http.HTTPSender.getSocket(HTTPSender.java:157)
at org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:114)
at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrategy.java:71)
at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:150)
at org.apache.axis.SimpleChain.invoke(SimpleChain.java:120)
at org.apache.axis.client.AxisClient.invoke(AxisClient.java:180)
at org.apache.axis.client.Call.invokeEngine(Call.java:2564)
at org.apache.axis.client.Call.invoke(Call.java:2553)
at org.apache.axis.client.Call.invoke(Call.java:1753)
at com.ascentialsoftware.wsclient.OperationCall.invoke(OperationCall.java:266)
at com.ascentialsoftware.wsclient.WebService.callServiceInternal(WebService.java:1685)
at com.ascentialsoftware.wsclient.WebService.callService(WebService.java:1591)
at com.ascentialsoftware.wsclient.WebService.callService(WebService.java:1544)
at com.ascentialsoftware.wspack.Transformer.process(Transformer.java:104)
at com.ascentialsoftware.jds.StageFactory.runStage(StageFactory.java:544)
at com.ascentialsoftware.jds.StageFactory.runTransformer(StageFactory.java:361)
</ns1:stackTrace>
</detail>
</ns1:Fault>
at com.ascentialsoftware.wsclient.OperationCall.handleRemoteException(OperationCall.java:369)
at com.ascentialsoftware.wsclient.OperationCall.invoke(OperationCall.java:274)
at com.ascentialsoftware.wsclient.WebService.callServiceInternal(WebService.java:1685)
at com.ascentialsoftware.wsclient.WebService.callService(WebService.java:1591)
at com.ascentialsoftware.wsclient.WebService.callService(WebService.java:1544)
at com.ascentialsoftware.wspack.Transformer.process(Transformer.java:104)
at com.ascentialsoftware.jds.StageFactory.runStage(StageFactory.java:544)
at com.ascentialsoftware.jds.StageFactory.runTransformer(StageFactory.java:361)

what might be the issue & how can i resolve this?

your suggestions are always welcome!!!

Thanks!!!