Search found 19 matches

by smeliot
Mon Jul 19, 2010 10:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heavy I/O - need help with job design
Replies: 7
Views: 5852

thank you - I knew the problem was resource constraints, just didn't know why. So, is nproc a Unix setting or a DS setting?
by smeliot
Mon Jul 19, 2010 6:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heavy I/O - need help with job design
Replies: 7
Views: 5852

It took forever to get them to let me run this <sigh>. Anyway, the jobs within the sequence that failed are some of the ones that read a dataset, and then write to 16 complex flat file stages. There are sorts on the links going into the CFFs. all jobs are running sequentially job that reads complex ...
by smeliot
Tue Jul 13, 2010 7:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heavy I/O - need help with job design
Replies: 7
Views: 5852

Thanks, but the issue here is not speed (although that may become an issue later), but with not aborting due to Resource Constraints. The master sequence does call the sub-sequences sequentially, and each sub-sequence calls its five jobs sequentially as well. I will definitely ask about local vs. SA...
by smeliot
Tue Jul 13, 2010 6:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Heavy I/O - need help with job design
Replies: 7
Views: 5852

Heavy I/O - need help with job design

We have a master sequence that calls a number of sequences, all of which have five jobs. The first job creates a dataset, then the next four jobs read the dataset, and create 16 files (complex flat files) each. The last four jobs of each sub-sequence are identical, except that the constraints are ha...
by smeliot
Tue Jul 13, 2010 6:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Records Dropping because of 0 values
Replies: 5
Views: 2459

What is the If statement that you used? Are you using one of the NullTo... functions?
by smeliot
Mon May 03, 2010 1:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading issue for a cobol file.
Replies: 13
Views: 7535

Since the error message is pointing to the field that has the number of occurrences - do you think that it has more than 100 occurrences in this record of the data? Can you look at the data at its source?
by smeliot
Thu Mar 18, 2010 12:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generate multiple records from 1 record in the input based o
Replies: 1
Views: 2033

Re: Generate multiple records from 1 record in the input bas

Since it looks like you're using Transformation eXtender (not Datastage), you'll need to create a group in your output that corresponds to your group in your input. (the input group being within the record, your output group being a "virtual" group of records). Also - make sure that your i...
by smeliot
Mon Aug 17, 2009 1:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Command Line Documentation -which manual?
Replies: 3
Views: 1734

Thank you very much, Craig - I feel so much better - my eyesight may be bad, but I wasn't missing it! (only the reference to it ... )

-Susan
by smeliot
Mon Aug 17, 2009 12:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Command Line Documentation -which manual?
Replies: 3
Views: 1734

Command Line Documentation -which manual?

I've been searching and searching, and cannot find which manual has the command line documentation (dsjob, etc).

Can someone point me to the right one?

thanks!
by smeliot
Wed Jun 10, 2009 8:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rejects from Dynamic RDBMS Stage
Replies: 1
Views: 1075

I'm having the same problems. The RDBMS stage is rejecting my rows (and rightly so - there's a constraint error), but my reject link doesn't get anything.

Have you found a solution yet ?
by smeliot
Wed Oct 22, 2008 10:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Column Import with Schema File - how to get it to work ?
Replies: 1
Views: 1759

Column Import with Schema File - how to get it to work ?

I have searched here, and found 1 thread that talks about someone using a Schema File to define their output metadata, and it not working, and then in the very last message they posted "it's working now". <sigh> If anyone has experience using Schema Files with Column Import, I'd love to he...
by smeliot
Thu Jun 12, 2008 7:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: moving data to Mainframe via MQ - not all data getting there
Replies: 8
Views: 2647

The "Maximum Message Length" is a Queue setup parameter - perhaps that is set too small in your queue? ... Finally figured it out. I had to lie to DS and tell it that the file that I created in one job with CFF (with 127 fields, about 1/3 of them defined as COMP-3) was actually a Sequenti...
by smeliot
Wed Jun 11, 2008 1:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: moving data to Mainframe via MQ - not all data getting there
Replies: 8
Views: 2647

Yes, you will need to concatenate the fields to one; you can use a transform stage or a column export stage to effect this. ... Okay - I've concatenated a couple of different ways - and was able to send to the Queue. However, only 72 of the 775 bytes of the now one field was received (again, all 4 ...
by smeliot
Wed Jun 11, 2008 9:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: moving data to Mainframe via MQ - not all data getting there
Replies: 8
Views: 2647

Sorry, my mistake. Don't you just have one data output column called "Payload", which comprises all the column data, to which you write? The template for this is in Table Definitions -> Real Tim ... Well, unfortunately, I can't see your whole message. I'll make a guess - and look for the ...
by smeliot
Wed Jun 11, 2008 8:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: moving data to Mainframe via MQ - not all data getting there
Replies: 8
Views: 2647

ArndW wrote:Have you tried using the MQ Connector stage? We are using MQ from mainframe with very long and variable message sizes with no issues. ...
That's what we're using - CFF Stage to MQ Connector Stage. We are not receiving messages, we're sending.

Thanks.