Search found 145 matches

by jackson.eyton
Tue Oct 12, 2021 10:43 am
Forum: General
Topic: Job Logs for most recent execution (XMETA SQL)
Replies: 2
Views: 10549

Job Logs for most recent execution (XMETA SQL)

I am working on writing a query to pull the most recent job logs from any given job in a specific project, where that jobs completed status is anything other than OK (no warnings etc). Figured I might as well post here in case someone has already done this, otherwise I will post the code here once c...
by jackson.eyton
Tue Oct 12, 2021 10:38 am
Forum: General
Topic: Hierarchy stage not working with flash gone now
Replies: 3
Views: 12589

Re: Hierarchy stage not working with flash gone now

We ran into the same issue, thankfully jobs already built with the stage continue to function. I did reach out to IBM at one point about this and they indicated that they intend to implement that stage into the web interface but no roadmap on when to expect that. We are currently planning to rebuild...
by jackson.eyton
Tue Jul 07, 2020 6:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dynamic Parameter
Replies: 1
Views: 11000

I don't believe this is possible directly within a parallel job. I do this using Sequence jobs and UserVariable Activity stages. From what I understand of your need, you'd want a parallel job that performs your database query and outputs the result to a file, then using a UserVariable Activity stage...
by jackson.eyton
Wed Jul 01, 2020 1:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Identify Trouble Column on Transform Error
Replies: 0
Views: 11377

Identify Trouble Column on Transform Error

Hi guys, I feel like I must be missing something here. I have some files that I am bringing in from a CSV, due to datastage's quirks we bring in all fields as VarChar initially then transform them in an TRANSFORM stage to what the intended data type should be. My biggest issue is when I have many fi...
by jackson.eyton
Thu Jul 18, 2019 10:15 am
Forum: Cognos (IBM BI)
Topic: Cognos 11.1.3 page load speed issue
Replies: 0
Views: 23533

Cognos 11.1.3 page load speed issue

Hi everyone, figured I would ask here in case someone has run into this. I do have an open ticket with IBM as well so if they find anything I will update this for everyone. Basically we have an issue with our Cognos after we upgraded to 11.1.3 from 11.0.9. This was an in-place over the top upgrade. ...
by jackson.eyton
Thu Jun 27, 2019 5:12 pm
Forum: General
Topic: Sequential(CSV) file structure validation?
Replies: 5
Views: 5873

Looks like CSV Lint might work. I was considering writing my own, may still do that but I will research some other tools that already exist first.

https://csvlint.io/
by jackson.eyton
Thu Jun 20, 2019 1:33 pm
Forum: General
Topic: Sequential(CSV) file structure validation?
Replies: 5
Views: 5873

Sequential(CSV) file structure validation?

Hi, I have a potential issue I am hoping to circumvent before it happens (matter of time). We have a few external sources that we have to bring in from sequential files. The issue is that a few of these have to be manually generated by that department. It is only a matter of time before someone inco...
by jackson.eyton
Tue Jun 18, 2019 11:23 am
Forum: General
Topic: Include = sign in Execute Command argument list?
Replies: 3
Views: 3959

:lol: As an update, looks like we got it, not sure why it wouldn't work via the Command Execute stage but worked fine in a native command prompt. The fix was to adjust the bat file itself as follows: Just wonder, can you try to modify your trigger.bat and see how it goes? Change "%JAVA_HOME%bin...
by jackson.eyton
Mon Jun 17, 2019 6:31 pm
Forum: General
Topic: Include = sign in Execute Command argument list?
Replies: 3
Views: 3959

Include = sign in Execute Command argument list?

Good afternoon everyone, I am having an issue using an Execute Command stage in a sequence job. Scenario is that I have a bat file I need to call and pass a series of arguments to it. The problem child is the password that I have to pass as it contains an = sign. I'm just doing this as plain text fo...
by jackson.eyton
Tue Apr 30, 2019 10:36 pm
Forum: General
Topic: DataStage Job Reports 403
Replies: 2
Views: 3040

DataStage Job Reports 403

Hi Everyone, I am in the process of documenting our nightly processing jobs into a wiki and I wanted to include links to the DataStage generated reports for the jobs. I create the reports and I can view them just fine, but when I embed them into my wiki, those URLs no longer work, citing an HTTP 403...
by jackson.eyton
Tue Jan 29, 2019 7:17 am
Forum: General
Topic: DataQuality Notifications for invalid data
Replies: 3
Views: 3749

Thanks Ray! I have been looking into this for some time now. Part of an issue I have is that it appears our IA setup might have some issues. I am working with IBM on that but in the meantime I was hoping you could point me in the right direction for some good use examples/training how to use the exc...
by jackson.eyton
Fri Jan 18, 2019 12:01 pm
Forum: General
Topic: DataQuality Notifications for invalid data
Replies: 3
Views: 3749

DataQuality Notifications for invalid data

Hi Everyone! I wasn't sure where to put this so into General it goes. We are looking to implement some awareness of some kind in regards to Data Quality. One example of our issues: we have several jobs that build unique business keys by concatenating several fields together. An issue can arise when ...
by jackson.eyton
Wed Nov 28, 2018 2:34 pm
Forum: General
Topic: Job Sequence: Downgrade warning message to info?
Replies: 8
Views: 6093

Ok, I did some more research and ended up just creating a sequence that calls the DSSendMessage routine straight up. I have a couple of UserVariables Activity stages that are used to build the message and recipients. This seems to work fine and won't return a complete job warning if the mail relay r...
by jackson.eyton
Wed Nov 21, 2018 6:24 am
Forum: General
Topic: Job Sequence: Downgrade warning message to info?
Replies: 8
Views: 6093

Which that may have been our issue all along for that. Many of our jobs are OK to continue if they finish with warning, and I believe the biggest thing was running through sequence logic with the jobs it calls set to validate only, as a test measure. If I recall correctly, which its possible that I ...
by jackson.eyton
Tue Nov 20, 2018 7:24 am
Forum: General
Topic: Job Sequence: Downgrade warning message to info?
Replies: 8
Views: 6093

No problem at all, I appreciate the discussion! Any particular reason to use DSJS over the actual job codes? I only ask as we switched most of our links to use the actual job status code instead of RUNOK or RUNWARN. We did this due to datastage not correctly triggering on a RUNOK at times. When we s...