Search found 53125 matches
- Mon Aug 29, 2005 5:34 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Automated Data Type Validation
- Replies: 1
- Views: 788
In server edition the Sequential File stage acknowledges that there are no data types in text files, only text. Any data types recorded are purely advisory. You must enforce the validation on a per-column basis as part of your job design. In enterprise edition (parallel jobs) the Sequential File sta...
- Mon Aug 29, 2005 5:31 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: deleting rows from table using odbc
- Replies: 2
- Views: 1022
Read the flat file using a Sequential File stage. In a Transformer stage pass along only the timestamp column, and mark it as Key. In the OBDC stage use user-defined SQL to construct a DELETE statement referring to this key in the WHERE clause. DELETE FROM tablename WHERE timestampcol = ? "Key" in t...
- Mon Aug 29, 2005 5:28 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Using table as a hash file due to range conditions
- Replies: 11
- Views: 3384
The name of the SQL table is the VOC (vocabulary) name of the hashed file. If you created the hashed file in an account, this is the same as the name of the hashed file. If you created the hashed file in a directory you need to create the VOC entry (search the forum for SETFILE command) then the nam...
- Mon Aug 29, 2005 5:25 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: add_to_heap() - Unable to allocate memory
- Replies: 13
- Views: 2767
That message is basically warning you that DataStage cannot find enough free memory to cache the hashed file, so that you are aware that it will therefore be read from disk (presumably more slowly than from memory). Solution is either to increase the cache size or to reduce the volume of data in the...
- Mon Aug 29, 2005 5:20 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Error calling DSWaitForJob(), code=-99
- Replies: 3
- Views: 7053
Code -99 is "other" errors; those for which there is no specific diagnostic handler within DataStage code. If you are getting T30 table full errors you have reached the maximum number of hashed files that can be open at any one time. (Remember that all the DataStage Repository tables are hashed file...
- Mon Aug 29, 2005 5:16 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Status code = -10 DSJE_JOBLOCKED
- Replies: 7
- Views: 8595
- Mon Aug 29, 2005 5:15 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Count warnings and stop job
- Replies: 13
- Views: 2833
- Mon Aug 29, 2005 5:14 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ODBC Database error extracting
- Replies: 2
- Views: 882
- Mon Aug 29, 2005 4:54 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Adding APT_DUMP_SCORE in shell script
- Replies: 2
- Views: 1125
- Mon Aug 29, 2005 2:12 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sort Stage Problem
- Replies: 5
- Views: 951
I tried to do the same thing with seq file. After all rows entered to Sort stage ( all 100000) the Job was ended immidiatly . It seems tahat Sort actually transfer rows but dont show it and rows count stay 0 from Aggregator With order by I get 2500 rows per sec . I want more because I have very lar...
- Mon Aug 29, 2005 2:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Surrogate key generation problem
- Replies: 3
- Views: 1285
Probably the easiest-to-understand way is to pre-store the maximum value in an earlier job (perhaps into a DataSet). Then pick up this value is a Lookup stage that precedes the Transformer stage, delivering the same value for every row processed. However, if you're going to work in the parallel envi...
- Mon Aug 29, 2005 1:19 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Sort Stage Problem
- Replies: 5
- Views: 951
Pre-sorting data prior to Aggregator is common practice, and helps the Aggregator stage to use memory efficiently (provided it's the grouping columns that are sorted). Are you claiming that no rows are output from the Sort stage? If so, please create a job that consists of your job up to the Sort st...
- Mon Aug 29, 2005 1:14 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: linear/cyclic depend error on vertical pivot
- Replies: 5
- Views: 1923
- Mon Aug 29, 2005 1:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Can UtilityabortToLog be used in PX?
- Replies: 4
- Views: 1550
- Mon Aug 29, 2005 12:49 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Need idea on Hash Partitioning In Server Jobs
- Replies: 5
- Views: 1434