Search found 32 matches

by djbarham
Wed Sep 07, 2011 12:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Flat File stage - variable record lengths
Replies: 5
Views: 2536

CFF does not readily support a single record type having varying numbers of columns, outside of the support of the "OCCURS DEPENDING ON" COBOL FD clause. Hmmm ... I wouldn't call it a varying number of columns so much as optional columns. ;) If it hits the end of record before the end of ...
by djbarham
Tue Sep 06, 2011 8:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Flat File stage - variable record lengths
Replies: 5
Views: 2536

Re: Complex Flat File stage - variable record lengths

Pending a resolution of this with the CFF stage, I think build another job to preprocess the file by padding out records to their respective maximum lengths.
by djbarham
Tue Sep 06, 2011 7:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC connection to Access 2007
Replies: 3
Views: 1560

Re: ODBC connection to Access 2007

Hello, I am trying to update a table in an Access 2007 database on a pc. I have created a system DSN without a password but cannot get it to connect. Is this Access file and ODBC DSN on the same server as DataStage? Can you use something like Excel or Microsoft Query to first prove that the ODBC So...
by djbarham
Tue Sep 06, 2011 7:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Select All records at once?
Replies: 2
Views: 1482

Re: How to Select All records at once?

I am reading 600 million records from the database and I don't want it to read 2000 records at a time because that would be too many hits against the database. I think you misunderstand what ths assay size is doing. It is NOT generating 300,000 separate queries against the database where each retri...
by djbarham
Tue Sep 06, 2011 7:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Flat File stage - variable record lengths
Replies: 5
Views: 2536

Complex Flat File stage - variable record lengths

I'm having a problem variable record lengths on the CFF stage. I think my problem is the same as this thread, but I don't think respondants there really understood the problem: http://www.dsxchange.com/viewtopic.php?p=391304 I have several different record types and I have the meta data defined for ...
by djbarham
Thu Sep 01, 2011 12:42 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ORA-12842: Cursor invalidated during parallel execution
Replies: 3
Views: 13404

I have repeatedly run into this error and for me it is not because of a null in a column that I am grouping on. It is a null in a column that is the subject of an aggregate function, such as MAX. Normally, aggregate functions like MAX ignore nulls. However, when you use KEEP FIRST, it is different. ...
by djbarham
Sun Aug 14, 2011 8:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: range lookup
Replies: 7
Views: 7632

Confused as to how that actually fixed the problem as there was no need to return multiple anything in the example given, just one. :? Thanks guys, this thread helped me too. Craig, I agree with your confusion. I have the same situation where I have 2 columns with an equality match on the lookup, t...
by djbarham
Tue Aug 02, 2011 4:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture stage vs Difference stage driving me nuts
Replies: 3
Views: 2979

OK, I had a quick look at the SCD stage. I'm not sure I'm seeing how it applies. Maybe I didn't describe my requirements very well ... actually, I didn't really describe my requirements at all. So, here is the functionality I require. I have from an external source an image of how my record should l...
by djbarham
Tue Aug 02, 2011 4:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture stage vs Difference stage driving me nuts
Replies: 3
Views: 2979

OK, I'll admit that this had not occurred to me. The table is not a dimension, it is not tracking changes over time, nor is the structure in any way a star schema, but sure, if you think the SCD stage might still be useful for this, I'll have a look. Still interested in feedback on the Difference st...
by djbarham
Tue Aug 02, 2011 1:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture stage vs Difference stage driving me nuts
Replies: 3
Views: 2979

Change Capture stage vs Difference stage driving me nuts

I'm trying to compare a set of potential updates with existing data on a table. The updates have a natural key which is also on the table but is not the primary key (it has a surrogate key). the catch is that I also want to bring the primary (surrogate) key through for changed records so I can use i...
by djbarham
Thu Jul 28, 2011 12:06 am
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Manually Configuring Web Service Pack
Replies: 10
Views: 13152

OK, all working. Just had to sort out correct namespace references in the header. To summarise the whole issue from start to end: * DataStage did not recognise anything in the WSDL when loaded directly from the URL. Once I saved it as a file, then read the file with DataStage, it found the necessary...
by djbarham
Tue Jul 26, 2011 11:00 pm
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Manually Configuring Web Service Pack
Replies: 10
Views: 13152

Aaaarrrgggghhh!!! Don't you hate it when the answer is in the manual. I had to read the section on adding headers 3 or 4 times before the penny finally dropped as to what it was saying. Instead of putting a value in for a field as you do with the body of the enevlope, it requires you to enter the ac...
by djbarham
Tue Jul 26, 2011 7:07 pm
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Manually Configuring Web Service Pack
Replies: 10
Views: 13152

As suggested above, the proxy may indeed be the issue. Assuming you can prove that, you may need to write your own handler to deal with it, if the other server expects the client to get the response ... Gah ... so it seems that I have to pay to see your response. That aside, we have done some furth...
by djbarham
Tue Jul 19, 2011 12:35 am
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Manually Configuring Web Service Pack
Replies: 10
Views: 13152

Re: Manually Configuring Web Service Pack

Well, it turns out things aren't working so well after all. While I was getting a response, it was an empty response and independent tests have confirmed that this is what happens when authentication fails. The soap envelope from our independent tests looks like this. <soap:Envelope xmlns:xsi="...
by djbarham
Sun Jul 10, 2011 6:01 pm
Forum: General
Topic: Configuring an ODBC connection on Solaris
Replies: 0
Views: 965

Re: Configuring an ODBC connection on Solaris

Doh ... maybe I'm the problem.

Maybe I just can't run this in test mode from Designer.

I built a job to call the routine and it seems to work.