Search found 145 matches

by jackson.eyton
Thu Mar 29, 2018 1:32 pm
Forum: General
Topic: Setting global variable from job?
Replies: 10
Views: 5127

Ok, I just ran the following steps: 1. Created new Environment variable: APT_LASTDATEPROCESSED and set value to 2018-03-25 2. Added the environment variable the the parameters in a test job properties, this shows the default value of 2018-03-25 3. Compiled and ran the job with $APT_LASTDATEPROCESSED...
by jackson.eyton
Thu Mar 29, 2018 12:30 pm
Forum: General
Topic: Setting global variable from job?
Replies: 10
Views: 5127

Yea something is not right... using the datastage administrator I can see the correct value of the variable, yet when I go to run the job that uses said variable it shows the previous value. Doesn't matter if I close datastate and relaunch, recompile the job, etc. It doesnt matter if I place the env...
by jackson.eyton
Thu Mar 29, 2018 9:23 am
Forum: General
Topic: Kafka logs on Service tier
Replies: 5
Views: 5071

Thanks for the reply! I have been reading a bit about altering the log retention settings. I see you're calling the update-config script and passing in new retention attributes from there. Is this different than editing the server.properties file itself in $InstallPath\shared-open-source\kafka\conf ...
by jackson.eyton
Thu Mar 29, 2018 8:19 am
Forum: General
Topic: Kafka logs on Service tier
Replies: 5
Views: 5071

Kafka logs on Service tier

Hi everyone, I received a disk usage alert from my service tier server this morning. Upon further review of the disk I am seeing that the IBM\InformationServer\shared-open-source\kafka\logs directory is 12GB. It does not appear that any of the logs are bloated per se, just a steady accumulation of l...
by jackson.eyton
Wed Mar 28, 2018 3:51 pm
Forum: General
Topic: Setting global variable from job?
Replies: 10
Views: 5127

So this kind of works, it seems the value does not update until the project is reloaded. For scheduled jobs this may indeed work just fine. For curiosity sake does anyone know if its possible to update a parameter value for a parameter set via CLI in a given project?
by jackson.eyton
Wed Mar 28, 2018 2:08 pm
Forum: General
Topic: Setting global variable from job?
Replies: 10
Views: 5127

Thanks FranklinE, That is exactly what we were looking for! I will need to go through and add the Environment variable to every job, unless someone knows a way to make an env var available to all jobs without adding it to the jobs parameters? Not a huge deal to add one thing like this though. Our se...
by jackson.eyton
Wed Mar 28, 2018 10:24 am
Forum: General
Topic: Setting global variable from job?
Replies: 10
Views: 5127

Setting global variable from job?

Hi everyone, We have run into an issue where we need to pull in a value from a source, could be flat file or database table, doesn't matter to us. However I would like to have that value saved as a global variable that is accessible to any other job. Is something like this possible? Could execute so...
by jackson.eyton
Fri Mar 09, 2018 11:18 am
Forum: General
Topic: Make Parameters Read Only?
Replies: 6
Views: 2998

Thanks gentlemen, not sure why I did not think of that, I will need to edit every job that uses the parameter to use the environment variable but that is absolutely the correct route to go. Thanks!!!
by jackson.eyton
Wed Mar 07, 2018 11:46 am
Forum: General
Topic: Make Parameters Read Only?
Replies: 6
Views: 2998

The end goal is to try and avoid a simple mistake we sometimes make where we package up a series of jobs and we might leave the option enabled to bring in dependencies. Welp in the case of one of our parameter sets that includes the database name and some connection details. When we deploy the packa...
by jackson.eyton
Wed Mar 07, 2018 8:27 am
Forum: General
Topic: Make Parameters Read Only?
Replies: 6
Views: 2998

Make Parameters Read Only?

Does anyone know how I can make a parameter set read only? I attempted exporting said parameter to a dsx file and editing the Readonly field to = 1 and reimporting that but I can still edit the parameter set :-(
by jackson.eyton
Mon Mar 05, 2018 12:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversion issues
Replies: 24
Views: 13520

I will have to shelf this for a bit. I cannot seem to get the server job with Iconv to work with the data that I have. I'm not 100% sure why. I did make some progress, I see now using one static date string "yyyy-mm-dd" format I was able to get that to convert, at least according to the la...
by jackson.eyton
Fri Mar 02, 2018 3:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversion issues
Replies: 24
Views: 13520

I did see that yesterday, giving it another look now, one note for anyone else that reads this, the links on the page ray listed do not work for me as-is, though they merely need a www. prefix.
by jackson.eyton
Thu Mar 01, 2018 4:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversion issues
Replies: 24
Views: 13520

Thanks Chulett, the input data is coming in a numeric column containing non standardized dates. We're wanting to convert these to standardized dates, the biggest issue is the dates can be in any number of formats: mddyy mmddyy mddyyyy mmddyyyy yyyymmdd yyyyddd I have to account for any one of those ...
by jackson.eyton
Thu Mar 01, 2018 4:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversion issues
Replies: 24
Views: 13520

Ok, I have created a server job and attempted to do some date conversions with that. For now the job is failing due to too many warning messages. The warning messages are all similar to the following: DateConversionBASIC..XFM: At row 23617, link "OUT", while processing column "TLTMD2&...
by jackson.eyton
Wed Feb 28, 2018 9:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversion issues
Replies: 24
Views: 13520

Alright, premium membership just purchased, I'll do some research on Oconv/Iconv and doing this in a server job instead of a parallel. I should soon be able to read your whole post. Thanks Ray!