Search found 15603 matches

by ArndW
Tue Jun 28, 2005 11:58 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to Total no.of jobs in a Project
Replies: 6
Views: 1719

If you mean the UniVerse/DataStage environment command line mode, you can execute COUNT DS_JOBS WITH JOBTYPEIND NE ''

If you mean Unix, you could do a "dsjob -ljobs {yourprojectname} | wc -l"
by ArndW
Tue Jun 28, 2005 11:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Different
Replies: 3
Views: 1306

snassimr, the hash mechanism in a default Hash file using the dynamic file type can be slow when writing a lot of data. If you ensure that your minimum modulus is not the default of 1 but a larger number when you create the file the speed at which data is written is much, much faster. You can search...
by ArndW
Tue Jun 28, 2005 11:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Output file full--File size limitation?
Replies: 5
Views: 1457

look up ulimit in UNIX using your DataStage userid and see what the limits are; you can also search this forum using ulimit to get a number of posts along a similar vein. You might have a soft or a hard limit on file sizes, this is the most likely cause as DataStage Px and Server limits on file outp...
by ArndW
Tue Jun 28, 2005 11:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using routine read Hash file,generate 500 records of eachrow
Replies: 10
Views: 2760

Anu_1981, Write a routine called ExpandMe(A,B,C,D,E) EQUATE ColSep TO ',' ;** comma separator EQUATE LineSep TO CHAR(13):CHAR(10) ;** windows CRLF Ans = '' InternalDate = ICONV(E,'D4-YMD') FOR Index = 1 TO 500 OutputLine = A:ColSep:B:ColSep:C:ColSep:D:ColSep:OCONV(Interna...
by ArndW
Tue Jun 28, 2005 10:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Mail Notification
Replies: 3
Views: 1129

Shiva459, on page 6-188 of the BASIC Guide you will find the exact description on how to do this; as this is very straightforward programming I am not sure where your problem is. You need only add: ParameterString = "From:Pseudo@Nominus.Com\nTo:Shiva459@SFBay.Org\nSubject:DSSendMail Function Ca...
by ArndW
Tue Jun 28, 2005 10:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logical Count
Replies: 10
Views: 2632

kcshankar,

you haven't replied to the question posed earlier - which configuration file do you use in this job? This is the only way that you would get a different distribution UNLESS you changed the partitioning algorithm explicitly in your job.
by ArndW
Tue Jun 28, 2005 6:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Client-side backups using " dscmdexport"
Replies: 15
Views: 3231

Garth, I use a windoze .bat file as follows, but I get the popup windows, if you change the backup command to dscmdexport it will work flawlessly: @Echo OFF REM *************************************************************************** REM ** Accept the name of a DataStage Project and create the ba...
by ArndW
Tue Jun 28, 2005 5:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: filesystem related error
Replies: 3
Views: 3378

Ok, that is some new information. Does the file exist before you run the job? If so, check the access right - perhaps they are not sufficient to delete or update it via the DataStage useid you are using. If the file does not exist, try doing a "touch" in the directory (again with the userid that you...
by ArndW
Tue Jun 28, 2005 4:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Why Rnd() function generates same number twice?
Replies: 10
Views: 2965

Saad, another way to look at the RND() function not duplicating results is - what does RND(10) return when called for the 11th time? Or, to use a physical example, how can a dice be rolled 100 times without duplicating results. There are two popular algorithms that generate pseudo-random numbers tha...
by ArndW
Tue Jun 28, 2005 3:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logical Count
Replies: 10
Views: 2632

The job will normally distribute the processing across all of your nodes. This changes if you alter the partitioning schemes or if you specify a different $APT_CONFIG_FILE - i.e. if the other job uses a configuration file which contains just one node. Look at the 1st data line in the director log fi...
by ArndW
Tue Jun 28, 2005 3:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: filesystem related error
Replies: 3
Views: 3378

(a) Access rights to target directory
(b) disk space available
by ArndW
Tue Jun 28, 2005 1:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logical Count
Replies: 10
Views: 2632

Since this is a parallel job, each node only sees it's own records, and in this case you looked at node 0, which did half the processing. Later in your log you should see the numbers for node 1, which will have done the other half.
by ArndW
Tue Jun 28, 2005 1:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Px DataSet information
Replies: 6
Views: 2052

Vincent, thanks for the pointer, I'll have to look at the stylesheets. The problem we have here is from the other side - we have thousands of descriptors and datafiles and occasionally need to clean up. So I am writing some code which gets all descriptors in the system, links them to the actual data...
by ArndW
Tue Jun 28, 2005 1:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning while reading from Sequential File.
Replies: 3
Views: 1043

thebird,

if this error is only issued once, it might be that the last line in the file contains neither a record or file delimiter.
by ArndW
Tue Jun 28, 2005 1:19 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Source Report
Replies: 4
Views: 1131

nataly, since the source file path and name is very frequently not hard-coded but is a parameter value, this type of report is not possible to do. One of the quick methods that I have used is to do a .dsx export of the sources and then use my favorite text editor to find the string in question. Ther...