Search found 145 matches

by jackson.eyton
Thu May 24, 2018 7:43 am
Forum: General
Topic: ETL Modeling suggestions
Replies: 11
Views: 6389

HAHAHA, ok I only laughed because I use n++ all the time, just not for mapping... yet... UCDI, you mentioned HTML maps of the model, is that something that your architect puts out via Data Architect?
by jackson.eyton
Wed May 23, 2018 8:15 am
Forum: General
Topic: ETL Modeling suggestions
Replies: 11
Views: 6389

Hmm I went through one of IBMs training/demo documents for FastTrack and tried to replicate one of our jobs that we already have. I could not get the lookup entered correctly as we use a joined source lookup, meaning our lookup query is a join of multiple classification tables and the join in FastTr...
by jackson.eyton
Wed May 23, 2018 7:40 am
Forum: General
Topic: Netezza SQL Extensions XML functions oddity
Replies: 7
Views: 5200

Ray - That certainly would work, unfortunately this is a block of code that we are needing cognos to run directly. We did get it to work using replace() in the select statement.
by jackson.eyton
Fri May 18, 2018 12:54 pm
Forum: General
Topic: ETL Modeling suggestions
Replies: 11
Views: 6389

Yea, we are doing in a combination of both methods. Our architect models a particular table from our old database into the new model. That table from the old world will populate several different fields in many different destination tables. So from his perspective in the sheet he adds a source, and ...
by jackson.eyton
Fri May 18, 2018 10:42 am
Forum: General
Topic: ETL Modeling suggestions
Replies: 11
Views: 6389

ETL Modeling suggestions

Hi, I just wanted to get some pointers or opinions on what you guys use for relaying ETL instructions from the data architect. Currently we have these setup in a spreadsheet and its not the easiest thing to navigate and/or understand. I'm investigating FastTrack but I'm not positive on it. Our model...
by jackson.eyton
Fri May 18, 2018 7:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Incompatible data type for properly set column
Replies: 2
Views: 2254

alright figured this out, seems odd that we've not run into this before as this is not a new thing for us but we had to cast every NULL field of non VarChar type to its intended type.
by jackson.eyton
Thu May 17, 2018 7:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Incompatible data type for properly set column
Replies: 2
Views: 2254

Incompatible data type for properly set column

Hi, I seem to be having an issue with a source query and its column definitions. Using the netezza connector, the columns defined were all done by hand, not imported from a table definition. I had assumed that certain data types that are NULL from the source, such as SELECT NULL as Column1 FROM TABL...
by jackson.eyton
Tue May 15, 2018 6:58 am
Forum: General
Topic: Netezza SQL Extensions XML functions oddity
Replies: 7
Views: 5200

My apologies, yes, all good!
by jackson.eyton
Wed May 09, 2018 7:15 am
Forum: General
Topic: Netezza SQL Extensions XML functions oddity
Replies: 7
Views: 5200

Ahh that makes sense, unfortunately we are not using it to deal with any real XML or even be interpreted later as XML, but instead as a method of group_concat that is technically supported by IBM. I was unable to get approval from management to install the UDF for group_concat out of fear it would e...
by jackson.eyton
Tue May 08, 2018 10:29 am
Forum: General
Topic: Netezza SQL Extensions XML functions oddity
Replies: 7
Views: 5200

Netezza SQL Extensions XML functions oddity

Hi everyone, When running the following query we are seeing that any instances of '&' in BRANCH_NAME are being represented as '&amp' in the output for NZ_CONCAT_STRING and anything that followed the '&' is omitted: select MARKET , count(*) as NUM_OF_ROWS , trim(trailing ', ' from replace...
by jackson.eyton
Fri May 04, 2018 8:20 am
Forum: General
Topic: Job schedules failing to run on schedule
Replies: 5
Views: 3446

ray.wurlod thats funny! Your job was able to complete a task before it started? As an update I received the follow update from IBM: Please try this suggestion out and see if the scheduled job runs. The setting in question is: Local Security Policy -> Security Options -> User Account Control: Run all...
by jackson.eyton
Wed May 02, 2018 4:11 pm
Forum: General
Topic: Job schedules failing to run on schedule
Replies: 5
Views: 3446

Job schedules failing to run on schedule

Hi, we have been scheduling jobs using the datastage director for some time now, it seems we had some issue over the weekend that caused one of the scheduled jobs PID to crash. This was a master controller sequence job that crashed, we recompiled it and everything it touches and confirmed it runs fi...
by jackson.eyton
Thu Apr 05, 2018 12:16 pm
Forum: General
Topic: Kafka logs on Service tier
Replies: 5
Views: 4965

Official word back from IBM was that log retention configuration for kafka-server.log files cannot be done via any log files. These need to be manually cleaned or scripted to maintain a limited retention. I created a scheduled task that runs the following command: cmd /c powershell -command "Ge...
by jackson.eyton
Mon Apr 02, 2018 4:14 pm
Forum: General
Topic: Kafka logs on Service tier
Replies: 5
Views: 4965

Official word thus far from IBM is to delete the log files. I did that back to January of this year for the kafka-server log files only. I am awaiting a response from them on proper configuration of server log file retention as it was indicated that those logs are not affected by the config file.
by jackson.eyton
Thu Mar 29, 2018 1:57 pm
Forum: General
Topic: Setting global variable from job?
Replies: 10
Views: 5018

All the points to you sir! I see it now in the second link I sent, apparently needed to read a little closer. That indeed did the trick. Thanks!