Search found 136 matches

by boxtoby
Thu Jun 22, 2017 5:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generate sequence number using parallel job
Replies: 6
Views: 6710

Hi,

You weren't far out with your original idea.

Here's what I use: (@PARTITIONNUM+1)*10 : @OUTROWNUM

Use @OUTROWNUM rather than @INROWNUM to aviod problems with funnel stages etc.

Hope that helps!

Cheers,
Bob.
by boxtoby
Fri Mar 10, 2017 7:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Paralle routine to count num bytes
Replies: 11
Views: 5888

As it's a unix flat file would the unix command "wc" not suffice?
by boxtoby
Wed Mar 01, 2017 10:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: User inserted sort
Replies: 1
Views: 1726

User inserted sort

Hello, I have a job which is identical in development and production. In production it works because the partitioning behaves correctly on the two join stages in the job. In development the job doesn't behave correctly and produces slightly different results each time I run the job. I have actually ...
by boxtoby
Mon Dec 19, 2016 10:44 am
Forum: General
Topic: Server Routine
Replies: 18
Views: 8430

You ask "3) Any other feasible way...." If you mean is there any other way of retreiving job stats you could look at the database XMETA.DSODB which contains all this information. DSODB is quite easy to understand and here's some SQL you can try: (Hope it helps!) select fjr.runid, je.jobid,...
by boxtoby
Mon Nov 28, 2016 10:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Importing sequential file with double quotes in data
Replies: 2
Views: 2117

Hi Guicar, I have seen this sort of problem before, even to the extent that there were 4, 5 or even 6 double characters in the data! I solved the problem by using the sed command: sed s/'"";'/'";'/g input file1 > output file2 sed s/'""'/' '/g input file2 > output file3 This ...
by boxtoby
Tue Nov 22, 2016 6:39 am
Forum: IBM QualityStage
Topic: AVI Country Validation
Replies: 4
Views: 20114

Hi dj, I haven't used qsav for a while, but my recollections are that the results differ depending how you pass the data in to qsav. If you send in distinct street, city, state, zip country columns you get the best results assuming the columns contain the correct data, eg. you haven't got street and...
by boxtoby
Wed Oct 19, 2016 5:14 am
Forum: General
Topic: Dual monitor losing Designer panels
Replies: 2
Views: 2297

Dual monitor losing Designer panels

Hi Guys, I think this is actually a windows problem, but I'm wondering if anyone else has come across this problem and knows how to get out of it. I am using a laptop with a second monitor connected via the "extended desktop" option. Normally, all works well but occasionally due to the hot...
by boxtoby
Tue Jan 12, 2016 3:19 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: Run Column Analysis from the api
Replies: 2
Views: 5355

Hi Robert,

Perfect!

Many thanks.

Bob.
by boxtoby
Mon Jan 11, 2016 11:01 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: Run Column Analysis from the api
Replies: 2
Views: 5355

Run Column Analysis from the api

Hello, I am wondering if anyone has successfully used the IA API to run column analysis? I have used it successfully to run DQ rules and extract the results, but I am struggling to use it for running column analysis. Here is the xml structure the api uses and the part I am not sure of is the "C...
by boxtoby
Mon Nov 30, 2015 11:21 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: Exporting IA rules with version number
Replies: 2
Views: 5303

Hi Robert, I am exporting the Data Rule Definition and the Data Rule using the export and import option within IA on the Quality Console. I don't know of any other way, is there one? For this particular exercise the rules are being execured by DataStage jobs but that's by the way really. Kind regard...
by boxtoby
Mon Nov 30, 2015 6:59 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: Exporting IA rules with version number
Replies: 2
Views: 5303

Exporting IA rules with version number

Hi, I am having a couple of issues with data quality rules: Firstly ===== I have recently made some changes to a data quality rule: Definition: DRD_CUSTOMER_NAME Data Rule: DR_CUSTOMER_NAME When I publish the rule I get: Definition: DRD_CUSTOMER_NAME1 (new version) Data Rule: DR_CUSTOMER_NAME (no ch...
by boxtoby
Thu Oct 29, 2015 3:27 am
Forum: General
Topic: Retrieving user role information from xmeta
Replies: 2
Views: 3067

Retrieving user role information from xmeta

Hello, I am trying to retrieve user role information such as "DataStage and QualityStage User" from xmeta because the reports don't appear to provide that level of information. I can see some of the tables which are obviously part of the answer such as ASCLMODEL_USER, ASCLMODEL_USERCREDENT...
by boxtoby
Fri Sep 11, 2015 2:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Filter stage clarification
Replies: 3
Views: 3467

Might be for one of several reasons: Your expression DeptNo=10 might need to be DeptNo="10" if the column is a varchar There may be trailing/leading spaces in the column. Insert a transformer before the filter and trim() the column If the file came from a windows system the last character ...
by boxtoby
Fri Aug 28, 2015 2:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading SQL Server XML data type
Replies: 7
Views: 9442

I have a job which reads an xml column from an SQL Server table successfully on Red Hat Linux.

However, I had to add the following environment variables to the job:

$APT_DEFAULT_TRANSPORT_BLOCK_SIZE
$APT_PHYSICAL_DATASET_BLOCK_SIZE

and set them both to 3000000 (3,000,000)

Hope that helps.

Bob.
by boxtoby
Thu Aug 27, 2015 5:46 am
Forum: General
Topic: Restarting the sequence
Replies: 4
Views: 2973

Always restart the top level sequence only. It will work out which sequences and jobs need to be skipped or restarted.