Search found 175 matches
- Tue Apr 01, 2003 9:58 am
- Forum: General
- Topic: Why ETL is hard
- Replies: 13
- Views: 10374
Why ETL is hard
According to TDWI white paper 'Evaluating ETL and Data Integration Platforms' by Wayne Eckerson and Colin White: "According to most practicioners, ETL design and development work consumes 60 to 80 % of an entire BI project. With such an inordinate amount of resources tied up in ETL work, it beh...
- Tue Apr 01, 2003 9:46 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: AxcelPack vs PE
- Replies: 6
- Views: 5414
AxcelPack vs PE
What advantages does AxcelPack bring in a multi-processor enviroment, and how does Parallel Extender go above and beyond those advantages?
Also, will AxcelPack continue to be available or is PE its replacement?
Also, will AxcelPack continue to be available or is PE its replacement?
- Mon Mar 31, 2003 6:41 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Synchronization error ; CurWave ; LastWave
- Replies: 2
- Views: 2091
Synchronization error ; CurWave ; LastWave
Upon writing to a sequential file I get the following error:
MTXDsourceWkly..T1: Synchronization error Resource = MTXDsourceWkly..CSeqFileStage6.MTXD_USR, CurWave = 1, LastWave = 1, Expected 0
Any idea as to the meaning of 'synchronization error' and the values for CurWave & LastWave?
Thanks
MTXDsourceWkly..T1: Synchronization error Resource = MTXDsourceWkly..CSeqFileStage6.MTXD_USR, CurWave = 1, LastWave = 1, Expected 0
Any idea as to the meaning of 'synchronization error' and the values for CurWave & LastWave?
Thanks
- Mon Mar 31, 2003 3:24 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: High Quantity of Jobs In One Project
- Replies: 9
- Views: 5235
project cleanup
Is the project cleanup / rebuilding indexes safe? For some reason I've always been afraid of running it in fear of causing more trouble than help.
- Mon Mar 24, 2003 3:48 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: High Quantity of Jobs In One Project
- Replies: 9
- Views: 5235
Director refresh
I'm currently using DS 5.1 and have similar problems. I had it anytime with a large number of jobs in a project. I don't think the Server's OS and configuration has any effect, I believe it is purely client machine, so more CPU or RAM on your client might help, but I still think as a developer you a...
- Tue Mar 11, 2003 11:46 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hats off to Ray Wurlod
- Replies: 16
- Views: 4517
- Tue Mar 11, 2003 11:43 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: aggregator stage & nulls
- Replies: 4
- Views: 2181
aggregator stage & nulls
I'm using the average function on a column in an aggregator stage, and the input data contains nulls. In a true mathematical sense the returned average should be null, but the tool does what is more logical & useful and still computes an average. But the question is does it ignore nulls or does ...
- Tue Feb 18, 2003 3:18 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Shared Containers
- Replies: 6
- Views: 3424
- Tue Feb 18, 2003 3:04 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Access Documentation Tool question
- Replies: 6
- Views: 1477
- Tue Feb 18, 2003 11:44 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Access Documentation Tool question
- Replies: 6
- Views: 1477
Access Documentation Tool question
Is it just me or is Access built for such a simple mind that anyone used to a real database is throughly confused on how to do anything? I'd like to start with a clean mdb to run the auto-doc from Manager. I don't see anywhere through DataStage's interface to delete all from this database. It appear...
- Fri Jan 24, 2003 2:36 pm
- Forum:
- Topic: importing vs saving metadata
- Replies: 8
- Views: 6193
graphical flow
Also, are there any graphical process flows between DataStage and MetaStage that have been created to demonstrate the interaction between these two products? If so, could you post an url to them or get them included as downloads here.
Thanks
Thanks
- Fri Jan 24, 2003 1:37 pm
- Forum:
- Topic: importing vs saving metadata
- Replies: 8
- Views: 6193
Datastage metadata links
thanks for the reply. It sounds like the cyclical approach to maintaining metadata you mention starts out smoothly but then user interaction is needed to manually reload the definitions in the jobs because no automated process exists in DS or MS to do this. That would be very useful to have. Also, I...
- Thu Jan 23, 2003 5:35 pm
- Forum:
- Topic: importing vs saving metadata
- Replies: 8
- Views: 6193
importing vs saving metadata
If I'm remembering correctly, importing metadata from DS Manager often destroys the links to where the definition is used within jobs that can be used for usage analysis withing Manager. Doesn't this method also have an adverse effect on MetaStage? I think importing hashed file definitions and overw...
- Thu Jan 23, 2003 4:58 pm
- Forum: Data Quality Best Practices
- Topic: What is your company doing about data quality?
- Replies: 9
- Views: 9247
Re: What is your company doing about data quality?
I'm not surprised at all that the survey yeilded a small number of businesses with formal data quality programs. And I think the most common scenario is cleasing after the fact or cleasing only in one island and not fixing the root causes. If an ODS has dirty data and it sources a data mart, I feel ...
- Mon Dec 30, 2002 1:31 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: dscmdexport error
- Replies: 1
- Views: 1226
dscmdexport error
when trying to use dscmdexport.exe I get the following error: "dscmdexport aborted: Failed to load resource dll" I have no issues using the Manager export on the same client machine. There are so many DS dlls, does anyone know about this error or which of the dlls is the resource library? ...