Search found 15603 matches

by ArndW
Tue Oct 20, 2009 5:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: To skip a job for null dataset
Replies: 14
Views: 4491

Use a call to DSGetLinkInfo() to get the information on the number of rows processed down a link.
by ArndW
Tue Oct 20, 2009 5:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: what is the best practice to load 50Mil+ in HF
Replies: 12
Views: 3884

Once your file is full of data, get the number of groups, add 10%, find the next highest prime number and use that value as the MINIMUM.MODULUS for the dynamic hashed file. Also check the UNIX files DATA.30 and OVER.30 to see if they are over 2Gb. If they aren't then a 32bit hashed file is preferable.
by ArndW
Tue Oct 20, 2009 5:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to open project 'XYZ' - 81016. ( Job Migrated )
Replies: 13
Views: 6999

Have you tried a forced compile on the job? IS the "XYZ" a project name on the old machine?
by ArndW
Tue Oct 20, 2009 5:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: differece between disk pool and scrach disk in data stage
Replies: 2
Views: 855

The two concepts have nothing to do with each other. The Disk Pools allow one to group items, while the resource scratchdisk specifies which location(s) are to be used for temporary storage.
by ArndW
Tue Oct 20, 2009 5:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: To skip a job for null dataset
Replies: 14
Views: 4491

Call job1 from a sequence job, after that completes do an execute command stage of "orchadmin describe -f {YourDataSetFileDescriptor}", then parse the output for the last line starting with " records" and then take the numeric value after the ":" character. You can then...
by ArndW
Tue Oct 20, 2009 4:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XMEta migration
Replies: 3
Views: 2179

I think that the answer is that, as of version 8, it is simpler and quicker to effect a complete new installation rather than attempt so "fool" the software and just shifting things around manually.
by ArndW
Tue Oct 20, 2009 3:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Site with similar configurations
Replies: 3
Views: 1226

Machine A : 10 CPUs 32Gb Memory. Micropartitioning disabled. Machine B : 4 CPUs 24Gb Memory. Micropartitioning disabled. Machine C : 8 CPUs 10Gb Memory. Micropartitioning enabled. All 3 are AIX p-series DS servers with remote repositories and databases. All are used heavily for different DataStage c...
by ArndW
Tue Oct 20, 2009 3:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: what is the best practice to load 50Mil+ in HF
Replies: 12
Views: 3884

I think that the columns comprising the key should be as small as possible. What columns with what average total length are in your data portion of each record?
by ArndW
Tue Oct 20, 2009 3:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to get jobs names from Datastage project.
Replies: 6
Views: 20856

The DS_JOBS hashed file can be accessed from server jobs or from the TCL command line (which in turn can be called from execute command stage in a sequence job, for example). The SQL syntax would be "SELECT COUNT(*) FROM DS_JOBS WHERE JOBTYPEIND NE '';" Addendum - I read your post that you...
by ArndW
Tue Oct 20, 2009 3:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading from Excel
Replies: 5
Views: 1355

The contents of the .odbc.ini definition for the ODBC driver is dependant on which ODBC driver is installed, one needs to specify paths & names and therefore you need to have the ODBC drivers installed first and read the appropriate readme files for that package which will tell you which values ...
by ArndW
Tue Oct 20, 2009 1:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: what is the best practice to load 50Mil+ in HF
Replies: 12
Views: 3884

The good news is that there is a lot of room for improvement here. First off, can you remove the 5th column from the key completely? The shorter and simpler the key is, the better the hashing algorithm will work. If the 5th column cannot be removed from the key, put it to position 1 and specify SEQ....
by ArndW
Tue Oct 20, 2009 1:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading from Excel
Replies: 5
Views: 1355

The issue here is that you need to run an ODBC driver to connect from UNIX to Excel data sources; this is not part of DataStage and the aforementioned java app would seem to be a free driver. Once that driver is installed and functional you can then go about configuring the ODBC connection in DataSt...
by ArndW
Tue Oct 20, 2009 1:21 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: How to perform Bulk delete oe optimize delete operation
Replies: 4
Views: 1970

Then it would makes sense to talk with your DBAs about enabling partitioning in order to make maintenance, such as this delete, a simple matter.
by ArndW
Tue Oct 20, 2009 1:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Timeout error
Replies: 2
Views: 1021

In addition to what Ray requested, it would be good to know the exact Timeout error message and in which stage this happens.
by ArndW
Tue Oct 20, 2009 1:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Site with similar configurations
Replies: 3
Views: 1226

AIX, being and IBM OS just as DataStage is an IBM product, is one of the more common implementations. For example my current site has 6 LPARs with DataStage V8 ranging from 2-CPU to 16CPU. Many others here on DSXchange will also have AIX installations. It is difficult to simply compare CPU and Memor...