Search found 3045 matches

by vmcburney
Tue Nov 29, 2005 4:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Portability between Unix OS
Replies: 7
Views: 2151

You will certainly need to recompile anything with a transformer in it. You will need to retest everything to take into account differences between the environments such as different node configurations, different database clients, different directories and the robustness of the hardware.
by vmcburney
Tue Nov 29, 2005 2:41 am
Forum: Site/Forum
Topic: Allow guest users?
Replies: 3
Views: 2531

If the site develops more content, let's say downloads, white papers, example code etc. then make the forum exposed and accessible to search engines and make other features available to free members and premium services to different levels of paid members. The forum threads cover just about every Da...
by vmcburney
Mon Nov 28, 2005 7:36 pm
Forum: Site/Forum
Topic: Allow guest users?
Replies: 3
Views: 2531

Allow guest users?

Should the forum be available to guest users? Allow people to view threads without having to login (or signup). This would give the site greater search engine saturation, currently the only pages from the site on the google search index are the non-login pages such as profiles, news pages and testim...
by vmcburney
Mon Nov 28, 2005 5:11 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem combining 2 inputs
Replies: 1
Views: 515

We retrieve the DB2 sequence numbers during the insert by using NEXT VAL as the insert value via user-defined SQL: INSERT INTO CUSTOMER CUSTOMER_ID, CUSTOMER_NAME, CUSTOMER_ODOR (NEXT VAL FOR #DB_SCH#.CUSTOMER_SEQ, ?, ?) This statement will retrieve the next sequence number from the CUSTOMER...
by vmcburney
Mon Nov 28, 2005 4:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DB2 UDB API Connection
Replies: 7
Views: 2287

Have you gone through the DB2 installation steps in the DataStage Installation guide? You need to make sure the correct settings have been applied to the dsenv file and the setup and grant scripts have been run.
by vmcburney
Sun Nov 27, 2005 5:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: filter records
Replies: 8
Views: 1517

Whenever you get a text file you should always go back to the source and ask if they have a data dictionary that defines the file. For example some files are extracted from a database, so you can use the table metadata for a more accurate file definition. Some are complex flat files produced by a ma...
by vmcburney
Sun Nov 27, 2005 4:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: 'fix_zero' for decimal values
Replies: 5
Views: 6301

fix_zero causes a decimal field containing all zeros to be treated as a valid zero. Omitting fix_zero causes the application to generate an error if it encounters a deimal containing all zeros. suppress_zero specifies that the returned ustring value will have no leading or trailing zeros. Examples....
by vmcburney
Sat Nov 26, 2005 12:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Checking Source Data
Replies: 2
Views: 813

Have a look at Kim Duke's ETL Stats, amongst other things it populates an ETL_ROW_HISTORY table where you can see the history of every row for every link in a job and report or audit it with SQL.
by vmcburney
Sat Nov 26, 2005 12:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to do change capture in server jobs?
Replies: 3
Views: 795

Also do a search for threads on the CRC32 function and look at the example uploaded to Ascential developernet. It can be a faster way to compare a lot of attributes when doing change detection.
by vmcburney
Thu Nov 24, 2005 8:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Summing up Financial Year to Date data 1 April to Mar 31
Replies: 9
Views: 3453

The complex SQL approach is not as robust or maintainable as having a lookup table such as a time dim. You have a duplication of code rather then code sharing, one spelling mistake by a novice programmer and the job will still work and produce results but all the aggregation will be wrong. Eg. typin...
by vmcburney
Thu Nov 24, 2005 5:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How can we handle unstructured data?
Replies: 7
Views: 3471

IBM see Information Integration accessing federated and unstructured data and the Ascential suite processing those parts of it that it can handle. Adding BLOB support to DataStage is part of this. There are some highly specialised tools out there for identifying text in pictures or converting legacy...
by vmcburney
Thu Nov 24, 2005 4:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to Join the multiple Database sources
Replies: 5
Views: 1318

The IILive2005 had a session on using the full IBM Information Integration suite (not just the Ascential products). With Information Integrator you can create a join across heterogeneous data sources and then process this data with DataStage. You can also use Information Integrator replication to tr...
by vmcburney
Thu Nov 24, 2005 4:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Validating all fields of a row & send errors to ErrFile/
Replies: 7
Views: 1862

And you can put a char(10) at the start of each test message to make it appear on a seperate row. You can output both an error header file and an error item file, the header has some columns that identify the job name and process information (process identification and date) and something that ident...
by vmcburney
Thu Nov 24, 2005 4:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate key stage's start value
Replies: 2
Views: 762

You can set the surrogate key start value to a job parameter and pass in the start value every time you run the job. The max value can be retrieved by the Sequence job by a shell execute script that runs SQL or isql or db2 commands.
by vmcburney
Wed Nov 23, 2005 11:55 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem related with job sequence
Replies: 6
Views: 1545

If you are using a recent enough version of DataStage have a look at the documentation on the Set Job Variables stage. This lets you create variables at the start of your sequence job and use them in all downstream stages. It supports using job parameters, routines and external scripts to set and ma...