Search found 53125 matches

by ray.wurlod
Wed Jul 30, 2003 4:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: stage variable
Replies: 6
Views: 1153

Try changing the key value that you are using. For example, in job "A" use KeyMgtGetNextKey("A") and in job B use KeyMgtGetNextKey("B"). Note that the sequences in SDK.SEQUENCES are never reset (unless you do so manually or in separate code). Could it be that you'd already processed 1000 rows using ...
by ray.wurlod
Tue Jul 29, 2003 11:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Incremental aggregetion
Replies: 6
Views: 1314

Beware, however, that lookups over a network are abominably slow and should be avoided. Vincent's model is good if the Oracle instance is on the same box as the DataStage server, but slow if not.
by ray.wurlod
Tue Jul 29, 2003 6:42 pm
Forum: Data Quality Best Practices
Topic: New to Datastage (stored procedure question)
Replies: 1
Views: 1852

This question really belongs on the ETL thread, as it's not a data quality issue. You posted this question there a couple of days ago, and got a good answer there. Why did you post here? The simple answer - assuming you're constructing a server job - is that you import the stored procedure definitio...
by ray.wurlod
Tue Jul 29, 2003 6:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Incremental aggregetion
Replies: 6
Views: 1314

IF your DataStage is running on a Windows platform then you can create functions and deliver them via an ActiveX control. Import these into DataStage (in Manager, Import External Function Definitions) then they're ready to use. Note, however, that performance is not all that good. What's wrong with ...
by ray.wurlod
Tue Jul 29, 2003 6:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can't figure out error
Replies: 2
Views: 1134

The message is telling you that you're generating SQL in a UV stage but that the UniVerse server is having problems opening a UV table called "SnapshotDate". Check that you have the spelling and casing of this name correct. For example, is it actually "SnapShotDate"? You might also check the operati...
by ray.wurlod
Tue Jul 29, 2003 6:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: No jobs listed under Operator permissions
Replies: 4
Views: 1031

Use the DataStage security mechanism from your Administrator client. You can make one UNIX group developers (all access) and another group operators (run only, limited access to log files). There is a check box for giving operators full access to the log files. Use Version Control to mark jobs read-...
by ray.wurlod
Tue Jul 29, 2003 6:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job control - Abort code
Replies: 6
Views: 1086

I never use DSLogFatal, or Abort, or the DS.ERRFATAL key with DSAttachJob() in DataStage jobs or in routines called from them. This way I always retain control. I can detect what happed from log entries (for example using DSGetNewestLogId function) or from the controlled job's status (for example us...
by ray.wurlod
Tue Jul 29, 2003 5:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: To pass job status to routine
Replies: 5
Views: 856

If you check execution status of a job from that job's after-job subroutine, the answer will always be "running".

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
by ray.wurlod
Tue Jul 29, 2003 5:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Warnings--->No Limits
Replies: 3
Views: 1035

Beyond that, if you feel like modifying the code generated by compiling your job sequence, there is a function called DSSetJobLimit that you can use prior to executing the job (but after it is attached). You can find this function in on-line help from your Designer. Ray Wurlod Education and Consulti...
by ray.wurlod
Tue Jul 29, 2003 5:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sybase 12.4 and Datastage 5.2
Replies: 2
Views: 1102

Check that there's an entry in the uvodbc.config file for the data source. This entry must have DBMSTYPE = ODBC. Check that you've properly configured the data source in ODBC.INI and that that file is visible as .ODBC.INI. Test (using the utilities provided with the driver) that the driver manager i...
by ray.wurlod
Tue Jul 29, 2003 5:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: defunct and ghost jobs
Replies: 3
Views: 1446

The difficulty is knowing exactly which processes to kill. The job runs as one process, and active stages (such as Transformer stages) run as child processes. Any use of DSExecute, ExecSH, ExecTCL and so on may also start child processes. You can, of course, determine the job's pid in an after-job s...
by ray.wurlod
Tue Jul 29, 2003 5:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: lookup only once from hashfile
Replies: 6
Views: 1205

Another solution is to maintain a list of keys that you have seen, and search this list. For a sufficiently small list (up to, say, a few thousand), a dynamic array in a variable declared to be in COMMON would suffice. For larger lists, a more efficient search strategy would be needed, such as a bin...
by ray.wurlod
Tue Jul 29, 2003 5:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to Delete a set of Records from the Hash File
Replies: 5
Views: 740

Be aware that records in hashed files are not date-stamped. Therefore, unless one of the fields within each data record contains a date-stamp of some kind, there is no mechanism for identifying the records that you might want to delete. For example, the DataStage job logs are hashed files but, in th...
by ray.wurlod
Tue Jul 29, 2003 5:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: stage variable
Replies: 6
Views: 1153

That is really odd. If you examine the code of KeyMgtGetNextValue routine, you will not find any 1000 offset. The two different argument values will result in two different records existing in a hashed file called SDK.SEQUENCES. Could it be that "someone" has modified KeyMgtGetNextValue on your site...
by ray.wurlod
Mon Jul 28, 2003 10:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Director Job Log
Replies: 5
Views: 1670

You can archive the job logs to text file before compiling. Techniques for doing this have been published - check the archives here, search all forums (so that you pick up the Oliver list). Essentially the algorithm is: (1) determine name of log file (RT_LOGnn, where nn is job number) (2) open log f...