Search found 15603 matches

by ArndW
Mon Jul 13, 2009 5:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: configuration file
Replies: 6
Views: 1561

Where did you see physmem and virtmem?
by ArndW
Mon Jul 13, 2009 5:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Metadata Mismatch
Replies: 6
Views: 1894

I'm not sure if the ODBC interface supports BigInt as a datatype. Are values in the BigInt range (i.e. greater than what an Int can handle, for example 2147483649 ) correctly loaded?
by ArndW
Mon Jul 13, 2009 5:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: handling cobol data files in comp-1 and comp-3 format
Replies: 1
Views: 893

Yes, look into the CFF (Complex Flat File) stage.
by ArndW
Mon Jul 13, 2009 3:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: System.OutOfMemoryException: Exception of type 'System.OutOf
Replies: 7
Views: 1818

And what happens when you turn off buffering?
by ArndW
Mon Jul 13, 2009 3:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: IXF file transfer and load
Replies: 5
Views: 3393

The FTP stage is not suited for such compressed files. I've "cheated" in the past and defined a record length of 1 and passed compressed binary data through FTP that way, but it is neither efficient nor recommended and it is preferable to do an external FTP call.
by ArndW
Mon Jul 13, 2009 2:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: System.OutOfMemoryException: Exception of type 'System.OutOf
Replies: 7
Views: 1818

Try turning off buffering on the hashed file. What operations do you perform in the transform stage (anything tricky or complex)?
by ArndW
Mon Jul 13, 2009 2:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: need clarification on installation
Replies: 5
Views: 1302

You specify the name of the database during installation. You can check your installation log file (and response file, if you created one) to see what you did.
by ArndW
Sun Jul 12, 2009 2:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: C++ routine error
Replies: 16
Views: 4437

Do you get better output when you turn off operator combination? (APT_DISABLE_COMBINATION set to "true").
by ArndW
Sat Jul 11, 2009 5:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: System.OutOfMemoryException: Exception of type 'System.OutOf
Replies: 7
Views: 1818

Unless you supply some more information and error messages, my guess is that the system is out of memory. Is that possible?
by ArndW
Sat Jul 11, 2009 12:57 am
Forum: General
Topic: Microfocus Index Files Format 8
Replies: 3
Views: 1159

As far as I know these particular formats for MF Cobol files are not supported. Perhaps one of the IBM insiders here might know if it is on the list for future enhancements.
by ArndW
Sat Jul 11, 2009 12:53 am
Forum: General
Topic: Deriving job Info in a transformer
Replies: 2
Views: 1231

The first parameter to all of these routines is the JobHandle, which is the "file unit" to which the job name has been opened using DSAttachJob(). In this case you would also want to add a call to DSDetachJob() so that you don't have too many file units open.
by ArndW
Fri Jul 10, 2009 1:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multivalued fields in Server Hashed File
Replies: 4
Views: 1440

Kim - you got it the first time around. Dictionary type entries: Col 1 - "D"ata or "I"-Type Col 2 - Position (for D) or Formula (for I) Col 3 - Conversion. i.e. MD2, for Masked Decimal 2 places comma separated Col 4 - Display column header Col 5 - Display format Col 6 - "S&q...
by ArndW
Fri Jul 10, 2009 7:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CPU Utilization 100%
Replies: 14
Views: 7448

Normally the ODBC connector, as a passive stage, doesn't consume CPU. Is there a transform stage before that? If one process uses 20-30% CPU then you should be able to run 4 concurrent processes, if you attempt to run more your performance will go down. Either increase CPU and/or memory (does your s...
by ArndW
Fri Jul 10, 2009 7:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reseting and Running a Job from Routine
Replies: 3
Views: 2378

This is a tricky issue, which I think leads back to how the JobHandle is returned on resetting the job. I would recommend adding a line JobHandle=DSPrepareJob(JobHandle) as Craig suggested to replace your if-then-else construct. Note that DSPrepareJob() returns a different JobHandle when it resets t...
by ArndW
Fri Jul 10, 2009 6:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CPU Utilization 100%
Replies: 14
Views: 7448

Dump your score and see how many processes your job runs. Look at the monitor to see %age CPU per stage. Try running 1 process on 1 node and see what your CPU utilization comes out to.