Search found 4992 matches

by kcbland
Tue Jul 11, 2006 6:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: OCI and Decimal type
Replies: 16
Views: 2634

I begged for too long for a meta-data stage that would enforce the metadata and perform extra validations and such from a meta-library. The silence was deafening. Imagine the ability to "scrub" your data, perform all trims, roundings, scalings, range/domain/pattern checks, etc.
by kcbland
Tue Jul 11, 2006 6:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Calling Custom routine using environment variables
Replies: 3
Views: 832

This is going to be executed for every single row going thru the Transformer. It would be better to use it in the initialize step of a stage variable so it's done only once. For the derivation of the stage variable, just use the stage variable.
by kcbland
Mon Jul 10, 2006 7:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: OCI and Decimal type
Replies: 16
Views: 2634

It's worked this way since Server 5.0 came out. Somewhere around then Ascential (then under Informix banner) engineering decided that metadata does matter. The Sequential file stage will enforce the scale, whereas the Hashed stage doesn't care. This became frightening because soooo many jobs used ju...
by kcbland
Mon Jul 10, 2006 10:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage Repository Interface
Replies: 11
Views: 2771

If the DS server is already upgraded to 7.5, then you must use the 7.5 client to open the jobs. If they upgraded the server in place with existing projects with jobs, then the jobs "are" upgraded. Whether they will work is a different story. If the DS server is version 6.0 and you need to copy them ...
by kcbland
Mon Jul 10, 2006 9:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: unit of mesure conversion
Replies: 3
Views: 790

Welcome aboard. Next time, please post your question in the appropriate forum. We don't know if you're asking about RTI, PX, Server, etc. Either write a function with a series of CASE statements, or have a conversion table constructed and load into a reference source that you can use in a transforme...
by kcbland
Mon Jul 10, 2006 9:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: The semaphore timeout period has expired
Replies: 6
Views: 4142

In the meantime, put the copy command into a bat script. Have the script keep copying the file until the byte count on the farside matches the byte count on the DS Server. That way, no matter the error, it will sit there and make sure the file gets over. Something like this pseudo code: remove remot...
by kcbland
Mon Jul 10, 2006 9:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ORACLE BLOB Datatype
Replies: 7
Views: 1527

Oracle's VARCHAR2(4000) is the maximum, so you're limiting yourself to the first 4000 characters selecting and inserting. It's BLOB, so that means you're corrupting your data, since BLOB means BINARY LARGE OBJECT, the first 4000 characters of binary data is useless.

Proceed at your own risk.
by kcbland
Mon Jul 10, 2006 9:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ORACLE BLOB Datatype
Replies: 7
Views: 1527

I do believe you can't move BLOBS using the Oracle OCI and regular DML. But I could be wrong.
by kcbland
Mon Jul 10, 2006 8:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: SQL query on Universe Stage
Replies: 5
Views: 1362

Okay, just looked over at that thread. I originally ignored it because "removing duplicates" is just about the most hated topic for me. Hashed files are great for 1:1 reference purposes. While there is fantastic functionality inherent in DS BASIC for working with them, using DataStage and UV/SQL is ...
by kcbland
Mon Jul 10, 2006 8:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: SQL query on Universe Stage
Replies: 5
Views: 1362

If you're using the UV/ODBC stage as a source stage, use the primary inputs section. Filenames are case sensitive, so makesure that's okay. Keep in mind this is not going to be fast, hashed files are not setup with secondary indexes to optimize relational type joins. If your volumes allow, consider ...
by kcbland
Mon Jul 10, 2006 7:58 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: The semaphore timeout period has expired
Replies: 6
Views: 4142

Your Routine seems to be saying: Error Code from the copy command is 1, and the Screen Output was "The semaphore timeout period has expired. " This is the operating system, not DataStage. You shouldn't write a job to do a file copy, the OS should do it way better and faster. Your issue is related to...
by kcbland
Mon Jul 10, 2006 7:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: What's the fastest way of doing an "exists in" or
Replies: 1
Views: 572

Best and fastest are subjective. I can't believe your archiving solution isn't tied to the delete solution. If that's true, you're talking about full scan the live table and compare with the archive table, and where matched you'll delete from the archive table. The fastest solution if these two tabl...
by kcbland
Sun Jul 09, 2006 7:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Supress extra Carriage returns
Replies: 21
Views: 4172

If anyone cares, the original problem was MULTIPLE CR/LF at the END of the string, so you need to remove as many as you can from the end, preserving the rest of the formatting. My original answer still looks to be the only one that solves that issue.
by kcbland
Sat Jul 08, 2006 1:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DS_AUDIT retention, schema, and content
Replies: 9
Views: 1779

I like to analogize Multi-Value by saying you store arrays instead of values. Being an aerospace engineer by education, we did a lot of matrix math, so I was quite comfortable with the idea of thinking in 3-D matrix form for numbers, now it's just dates and quantities and dollars. Actually, I did ch...
by kcbland
Sat Jul 08, 2006 7:28 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DS_AUDIT retention, schema, and content
Replies: 9
Views: 1779

Multi-value fields (attributes) are simply strings, so they can be quite large. The entire row (record) can be quite large, megabytes if you want. The problem with large numbers of multivalues in an attribute is just retrieval time, but don't think that's a big deal in this case. Keep in mind in the...