Search found 23 matches

by nyk1989
Mon Aug 21, 2017 6:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Storing TimeStamp with MicroSeconds in a Varchar field
Replies: 2
Views: 2721

Storing TimeStamp with MicroSeconds in a Varchar field

Hi guys, I am getting XML message for my source data which has a TIME attribute with value like "2017-08-18T16:00:54.368+01:00" I have extracted this value from the XML and stored in a field in transformer with datatype as varchar and the value after peeking into it was "2017-08-1816:...
by nyk1989
Wed Aug 02, 2017 1:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML data getting truncated while loading into CLOB column
Replies: 4
Views: 3740

I tried loading the CLOB column with array size as 1 and I see that the entire xml is getting loaded into the field.

This works properly if I use an Oracle Connector to load the data whereas if I use DTS stage - the job aborts.

Error I get is - player terminated unexpectedly.
by nyk1989
Fri Jul 28, 2017 4:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML data getting truncated while loading into CLOB column
Replies: 4
Views: 3740

I checked the data in Toad and found that the xml data is truncated. So, it's not loading completely into database but it doesn't throw any size error or anything else. In my ETL the APT_DEFAULT_TRANSPORT_BLOCK_SIZE is set to 9999999. Still this issue happens.
by nyk1989
Wed Jul 19, 2017 6:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML data getting truncated while loading into CLOB column
Replies: 4
Views: 3740

XML data getting truncated while loading into CLOB column

Hello, I have a job design like below - MQ Connector -> Transformer -> DTS Here in DS, I have given the column datatype as LongVarchar with no length provided. I am reading a XML file coming from MQ and loading into a Oracle table with column datatype as CLOB. The job completes successfully and I se...
by nyk1989
Wed Jan 11, 2017 9:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How the Write Mode 'UPDATE' works
Replies: 2
Views: 2241

How the Write Mode 'UPDATE' works

Hi guys, can someone tell me how exactly the write mode 'UPDATE' works in Oracle connector? Lets say i have a table with several columns and 2 columns (account_id and as_of_dt) are the PKs. Now if some new records come in which are not there in the table, will it insert them or drop? And if the data...
by nyk1989
Tue Jan 10, 2017 8:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding the occurence of a substring in a string
Replies: 7
Views: 6665

I/p - ID KEY VALUE 12 CBD XXX 12 GTI YYY 22 CBD 123 22 SC_ID 456 22 FUND 789 o/p - ID CBD GTI SC_ID FUND 12 XXX YYY null null 22 123 null 456 789 so, this is how my i/p and o/p should be. Current Design - I/P -> xfrmer -> Rem Dup -> xfrmer -> seq file in the first xfm, i am concatenating the KEY and...
by nyk1989
Tue Jan 10, 2017 4:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding the occurence of a substring in a string
Replies: 7
Views: 6665

Finding the occurence of a substring in a string

hey guys, need your urgent help!!! i have an input column with data like - ABC,DEF,GHI (3 values concatenated with comma delimiter) In the output, I want the position of each values like - for ABC - o/p should be 1 for DEF - o/p should be 2 Any idea how can we do this in DS? I tried Index function b...
by nyk1989
Wed Jan 04, 2017 3:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading xml data into a CLOB column in Oracle DB
Replies: 2
Views: 2258

Hi Andy,
Thanks for the reply!!

1) i have the CLOB column listed last in the DS as well as in the table definition.
2) array size is 1 only.
3) and the file size is 8KB whereas i am specifying till 1MB. But if I go above 1MB then it fails or if I don't specify anything then it fails.

Thanks!!
by nyk1989
Tue Jan 03, 2017 8:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading xml data into a CLOB column in Oracle DB
Replies: 2
Views: 2258

Loading xml data into a CLOB column in Oracle DB

Hey guys, I am trying to load a XML msg into a CLOB column. Job Design - MQ -> XML -> DTS I have provided the datatype as LongVarchar in DS for the column. But didn't specify any length. If so, it throws error that - Error in writeBlock - could not write 40 writeAllData() write failed. This is proba...
by nyk1989
Fri Feb 05, 2016 5:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ DTS Issue
Replies: 0
Views: 1843

MQ DTS Issue

Hi Guys, I have created a job which looks like MQ -> XML -> Transformer -> DTS (Oracle). I am passing a XML file as the source from MQ and it correctly passes through as a single row and gets parsed and the data gets loaded into an Oracle Table. The above is happening correctly when i am running the...
by nyk1989
Tue Jan 05, 2016 9:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ Stage Message Length Issue
Replies: 3
Views: 3182

Sounds like a question for the person/program who loaded the queue. Use DataStage to load your queue with test information, and ensure that you are loading ONE row (varchar with a long length). . ... Possible job design - External source stage -> mq stage If I do this to load the queue, its throwin...
by nyk1989
Tue Jan 05, 2016 6:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ Stage Message Length Issue
Replies: 3
Views: 3182

MQ Stage Message Length Issue

Hi Guys, I am trying to read a 250KB file using MQ stage. The file has all the data in a single row. The MAXMSGL is defined as 4MB and hence I am expecting that this entire file should get accomodated in a single message. But after loading the file into MQ, i see that there are 3 messages created fo...
by nyk1989
Mon Jan 04, 2016 6:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading XML file using MQ Stage
Replies: 1
Views: 2353

Reading XML file using MQ Stage

I am trying to read a XML file using MQ Stage. All the data in my XML file is in 1 line with no CR LF entries but when I load it into MQ stage, instead of displaying the file as a single message, its displaying it as several messages and because of which my job is getting aborted. Design - Mq -> XML...
by nyk1989
Thu Dec 24, 2015 8:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HPivot option in XML Stage
Replies: 0
Views: 3486

HPivot option in XML Stage

Hi, Does the HPivot option in XML stage work in the same way as the pivot stage in DS? Because I tried the same with an example data and I am not getting similar output. Eg: ID Name M1 M2 M3 1 Nyk 4 5 6 2 Luv 7 8 9 Output: ID Name M 1 Nyk 4 1 Nyk 5 1 Nyk 6 2 Luv 7 2 Luv 8 2 Luv 9 This output I am no...
by nyk1989
Wed Dec 23, 2015 7:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using Sorting Transformation available in XML Stage
Replies: 2
Views: 3166

Thanks for the reply..I checked and indeed the column's type was String and hence the incorrect result.