Search found 174 matches

by hsahay
Thu Jul 23, 2020 3:20 pm
Forum: General
Topic: Loading data from Oracle to Snowflake
Replies: 0
Views: 11456

Loading data from Oracle to Snowflake

I am able to load data from oracle to snowflake using the "Snowflake internal location" option in the snowflake connector but not when using the External location(S3) option. job design is simple oracle stage >>>>>transformer>>>>>snowflake connector stage When using the internal location o...
by hsahay
Tue Dec 19, 2017 1:42 pm
Forum: General
Topic: Sequential file CR/LF working differently in AIX vs LINUX
Replies: 6
Views: 5079

Thanks for your responses guys but this is a strange problem To answer your question Chulett, Every file will either have a CRLF or just LF. But we can't predict which file will have which line delimiter. The issue is that when we had these jobs running in AIX environment, the sequential file stage,...
by hsahay
Mon Dec 18, 2017 11:43 am
Forum: General
Topic: Sequential file CR/LF working differently in AIX vs LINUX
Replies: 6
Views: 5079

Sequential file CR/LF working differently in AIX vs LINUX

Hi We just migrated our datastage installation from AIX to LINUX and we have run into an issue with the sequential file stage. The sequential file stage is used to read a file and store the fields in an oracle table. The sequential file is reading files that may have CRLF or just LF as record delimi...
by hsahay
Tue Oct 18, 2016 12:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Cloudera Cluster Connection
Replies: 1
Views: 2565

Cloudera Cluster Connection

Hello,

Has anyone connected to cloudera hadoop cluster (connection type impala) using datastage? If yes, How?

I've tried ODBC, but it doesn't seem to be working? Any suggestion would be welcomed.
by hsahay
Tue Oct 18, 2016 9:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC connection error
Replies: 0
Views: 2501

ODBC connection error

Hello, I'm trying to connect to cloudera hadoop cluster's table using a parallel job and ODBC stage. I'm getting below error: ODBC_Connector_6: ODBC function "SQLConnect" reported: SQLSTATE = 08S01: Native Error Code = 0: Msg = [IBM(DataDirect OEM)][ODBC Impala Wire Protocol driver]Socket ...
by hsahay
Fri Jun 03, 2016 8:44 am
Forum: General
Topic: failed to open project after running successfully in a loop
Replies: 2
Views: 3302

failed to open project after running successfully in a loop

Hi We just recently upgraded to 11.3 on AIX. This is a clean fresh installation. We have one particular job which consist of a script that loads multiple input files in a loop until all are loaded. In each loop iteration this script does the following - 1. Calls an oracle stored proc. 2. Sends a res...
by hsahay
Thu Mar 10, 2016 10:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: mathematical functions for larger data types ????
Replies: 8
Views: 4803

Chulett - Hi ! Can you please elaborate on that with examples ? Are you saying that there are string functions in server jobs that can be used for mathematical operations of the kind i mentioned in my original post ?
by hsahay
Thu Mar 10, 2016 9:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: mathematical functions for larger data types ????
Replies: 8
Views: 4803

Thanks QT_KY. That is precisely what has been happening with us. Overflow and data corruption all over the place. Which is what prompted me to ask this question.

Does anyone know of any options if one needs to use these functions on larger datatypes ?
by hsahay
Wed Mar 09, 2016 5:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: mathematical functions for larger data types ????
Replies: 8
Views: 4803

mathematical functions for larger data types ????

Hi Functions like MAX, MIN, CEIL, FLOOR etc work on INT32 datatype. What if my variables are larger than int32 ? For example, the signature for MAX is number1 (int32),number2(int32) returns int32 What if the values i need to compare are int64 ? or even Double. Are there no functions for larger data ...
by hsahay
Wed Jan 27, 2016 1:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: issue with implicit casting during field comparison
Replies: 1
Views: 1986

issue with implicit casting during field comparison

I have two DataStage installations, one on AIX and one on LINUX, displaying the below described behavior. DataStage version - 11.3 .2 AIX version - 7100-03-03-1415 Linux version - 2.6.32-504.30.3.el6.x86_64 Problem description - ------------------------ I have two variables var1 integer var2 double ...
by hsahay
Tue Nov 24, 2015 7:30 pm
Forum: General
Topic: double datatype weirdness
Replies: 7
Views: 4572

qt_ky - thank you ...i think that explains it.

I will mark this thread as resolved.
by hsahay
Mon Nov 23, 2015 5:19 pm
Forum: General
Topic: double datatype weirdness
Replies: 7
Views: 4572

Yes sir !

I noticed it too.

But what does that signify. Why is it happening only on AIX ?
Why is LINUX putting out 111 ?

What can we try to fix this behavior ? Is there anything bigger than double that we can use ?

Is double restricted to signed 32 bit in datastage ?
by hsahay
Mon Nov 23, 2015 4:50 pm
Forum: General
Topic: double datatype weirdness
Replies: 7
Views: 4572

double datatype weirdness

Something weird is happening and i can't tell why. I send in two values in a comma separated sequential file - 9999999999, 111 (that is ten 9s) All columns and the stage variable in the job are defined as double 20,5. In the transformer i set a stage variable V = max(val1, val2) Then i output the st...
by hsahay
Mon Aug 03, 2015 8:42 am
Forum: General
Topic: unable to open project - non standard port
Replies: 5
Views: 4528

Ray I use dsjob -Server command where server - qxdstage5:9445 Do I need to use a different command line when using a server with a port ? Currently I am getting the below error where despite the 9445 port i specify in my dsjob command it still goes looking for 9443 for some reason. ERROR: Failed to ...
by hsahay
Fri Jul 31, 2015 5:35 pm
Forum: General
Topic: unable to open project - non standard port
Replies: 5
Views: 4528

Thanks Ray ....now what do i have to do for the dsjob -server command to consider the port I am specifying in the environment variable DS_SERVER=qxdstage5:9445 ?

Why does it look for 9443 ?