Search found 15603 matches

by ArndW
Fri Sep 21, 2007 6:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error - ds_ipcflush() - Error in mutex_unlock() - Not owner
Replies: 1
Views: 779

Hello and welcome to DSXchange! This is a problem that has been encountered and discussed in this forum numerous times in the past. This is the reason why it is recommended to always use the Search facility prior to posting a question. I used the keywords "mutex_unlock() - Not owner" and received 14...
by ArndW
Fri Sep 21, 2007 6:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to convert Float to Varchar
Replies: 2
Views: 1815

The Float to String conversion can also be done implicitly, anytime your source is float and your target is string in a stage the engine will perform an implicit conversion for you. It is better to perform explicit conversions so that you know when and how numbers are being converted, but it isn't r...
by ArndW
Thu Sep 20, 2007 9:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: sequential File
Replies: 22
Views: 3256

or use an absolute path to your tr command in your job to see if that works.
by ArndW
Thu Sep 20, 2007 9:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: BLANKS stored in VARCHAR fileds of a dataset
Replies: 8
Views: 1663

Just as an info, I did a test run with with 5% of the data into a dataset and it was 17.661Gb large, the same data going to unbounded VarChar columns was only 6.109Gb on disk (120 columns, 80 Varchar with 1-50 lengths). The saving in disk space were great but runtime was even better on this I/O boun...
by ArndW
Thu Sep 20, 2007 7:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: installation error
Replies: 8
Views: 1601

Thread Closed ---- see this duplicate thread
by ArndW
Thu Sep 20, 2007 7:10 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: MetaData import problem
Replies: 2
Views: 1963

Did you specify a fully qualified name in your DB2 import?
by ArndW
Thu Sep 20, 2007 7:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Substituting Hash File Design with Lookup File Set
Replies: 1
Views: 644

Question 1 - Sorry, the lookup filesets won't allow extensions. You can use normal datasets and append to them, though. Performance will be similar unless the datasets are huge. Question 2 - PX won't allow anything like that. You can split the job into 2, but the data would need to be written to dis...
by ArndW
Thu Sep 20, 2007 6:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: BLANKS stored in VARCHAR fileds of a dataset
Replies: 8
Views: 1663

I just did a test - if I declare a dataset with one column of VarChar(1024) and fill it with just a single character per line, my test job of 500K rows generated a data set 263479K, whereas if I remove the length then the same number of rows only takes up 2752K. I wasn't aware of that change in beha...
by ArndW
Thu Sep 20, 2007 6:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: BLANKS stored in VARCHAR fileds of a dataset
Replies: 8
Views: 1663

I am going to have to check that up to see if using unbounded strings changes the DataSet behaviour on my system as well. If so, it is an interesting way of making sure that datasets use less space.
by ArndW
Thu Sep 20, 2007 6:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: sequential File
Replies: 22
Views: 3256

Does your job have the path to the "tr" executable set? Check the 1st line of the log file where it shows the environment and compare it to the environment setting for your terminal command session.
by ArndW
Thu Sep 20, 2007 6:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: BLANKS stored in VARCHAR fileds of a dataset
Replies: 8
Views: 1663

DataSets store the data in fixed width format internally - so "hello" stored in a VarChar(1000) field will use up 1002 bytes.
by ArndW
Thu Sep 20, 2007 6:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Not able to delete job
Replies: 4
Views: 1017

It isn't easy to determine which users are in which projects on a busy system with many users and projects. I sometimes use the device and inode to locate the physical file; but that is a lot of effort. Or you can look at the age of the processes to see what has been around a while. In addition, do ...
by ArndW
Thu Sep 20, 2007 5:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: sequential File
Replies: 22
Views: 3256

...but it is gving me the error..
What error message are you getting? Remember, your current working directory will be that of the DataStage project, you should always use fully qualified pathnames.
by ArndW
Thu Sep 20, 2007 1:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash file stage-Active or passive stage?
Replies: 2
Views: 1160

See this post for the answer to this duplicate post.
by ArndW
Thu Sep 20, 2007 1:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash file stage-Active or passive stage?
Replies: 7
Views: 2612

Your understanding is correct, and by that token a Hashed file stage (notice the difference in spelling, otherwise Ray will pounce on you) is a passive stage.