Search found 119 matches

by palmeal
Tue Apr 26, 2005 3:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: MSSQL Performance Problem
Replies: 5
Views: 1486

Thanks Ray, I had joked to a colleague that this is what I'd have to end up doing. Anyway, I've got the ftp working (FTP Plug0In stage) to transfer files to the MSSQL Server box but wonder if I can remotely call the bcp on that server. I have previously used "Call DSExecute("UNIX", Co...
by palmeal
Mon Apr 25, 2005 6:31 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: MSSql Server and Stored Procedures
Replies: 5
Views: 3283

Delving a little deeper into this has thrown up a problem which I don't think I can get around: the grant of exec must be given to public in order for DataStage to pick up these stored procedures. I have tried granting access to individual users but DataStage fails to pick up these procedures. In a ...
by palmeal
Mon Apr 25, 2005 5:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: MSSql Server and Stored Procedures
Replies: 5
Views: 3283

I can now see all of the stored procedures when I do import. I had to add on grant permissions to my MSSQL user despite the fact that my user is already dbo. So despite the fact that I can exec these procedures whilst logged onto an MSSQL server when I try and retrieve the definitions through DataSt...
by palmeal
Mon Apr 25, 2005 4:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: MSSql Server and Stored Procedures
Replies: 5
Views: 3283

When I try to import the stored procedures the only ones that are listed are ones named dt_**** which are all for version control. These are installed at run time. No other user created procedure names are returned. I tried creating a stored proc named dt_delme but this is not picked up in DataStage...
by palmeal
Mon Apr 25, 2005 4:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: MSSQL Performance Problem
Replies: 5
Views: 1486

Thanks Ray, I guess I could break out to UNIX and use the bcp utility.
I'm trying to do everything within DataStage without breaking out to UNIX but I guess in this case I may have no option. Having said that I'd be surprised if Microsofts bcp will sit and run on UNIX.
by palmeal
Mon Apr 25, 2005 3:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: MSSQL Performance Problem
Replies: 5
Views: 1486

MSSQL Performance Problem

I am trying to write a simple server job to take comma separated files and load them into a table in MSSQL Server. Unlike ORACLE/SYBASE which have load/BCP stages there doesn't appear to be anything that I can use for MSSQL Server except the ODBC stage. By using this method it took 5 1/2 minutes to ...
by palmeal
Mon Apr 25, 2005 1:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issues with DS7.x
Replies: 15
Views: 7711

Raid 5 is not the best storage set up for writing - Raid 0 + 1 would be the best set up. Are your files spread around the disks or are the controllers trying to access the same disks at the same time. Again Raid 0 + 1 will randomise this and reduce disk contention.
by palmeal
Mon Apr 25, 2005 1:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: MSSql Server and Stored Procedures
Replies: 5
Views: 3283

MSSql Server and Stored Procedures

I think I know the answer to this one already but I can always hope. The project that I am working on takes data from approx 10 Sybase servers and dumps the data onto an MSSQL Server. When all of the data are loaded I have to carry out a series of transforms/sums/aggregates etc that would easily be ...
by palmeal
Fri Apr 22, 2005 1:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to count the number of records in a seq file
Replies: 8
Views: 3347

Would using openseq and then a loop not be slow for really large and numerous files ? Would it be better to break out to unix and wc -1 on the file and then awk to pull out the column 1 ($1) number. It's probably best practice to keep control within datastage but wonder what the thoughts are on this...
by palmeal
Fri Apr 22, 2005 1:07 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Notification Activity
Replies: 9
Views: 3516

Go to the Parameters for your Job Sequence and add a variable like SMTPSERVER/EMAILADD then on the Email Notification Properties click on the dots for the chosen property and your parameters (amongst other things) will be displayed. This is the case for version 7.5.1 - I can't speak for previous ver...
by palmeal
Tue Apr 19, 2005 8:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Start Loop --> Nested Condition --> End Loop Limitatio
Replies: 4
Views: 3209

Thanks for that - added the Sequencer Stage and it works a treat.
by palmeal
Tue Apr 19, 2005 8:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Start Loop --> Nested Condition --> End Loop Limitatio
Replies: 4
Views: 3209

Thanks for the quick reply but I don't understand what you mean by
Use a 'sequence' stage with 'any' option
by palmeal
Tue Apr 19, 2005 7:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Start Loop --> Nested Condition --> End Loop Limitatio
Replies: 4
Views: 3209

Start Loop --> Nested Condition --> End Loop Limitatio

I have a start loop that has a comma separated list of data passed into it. Within this start loops are various job activities before an end loop completes the loop. I want to add in a Nested Condition Activity after one of the stages within the loop. I have added this in and have two output streams...
by palmeal
Tue Apr 19, 2005 7:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSGetLinkInfo Problem/Confusion
Replies: 6
Views: 5024

Couldn't get this to work unfortunately - despite being able to return the job name, short/long description, stageName and LinkName the rowcount returned was always 0. Have given up just now and just gone for a 'wc -l' and an awk statement.
by palmeal
Fri Apr 15, 2005 9:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSGetLinkInfo Problem/Confusion
Replies: 6
Views: 5024

Thanks again Arnd - I'll give this a try and see how I get on - won't be able to feedback until Tuesday though.