Search found 2886 matches

by qt_ky
Fri May 16, 2014 11:50 am
Forum: General
Topic: Active Memory Expansion (AME) and Information Server
Replies: 5
Views: 1375

Yes, good point--compression requires some CPU cycles (be careful). There could be some CPU impact, depending on the factor you choose and your hardware. The monitoring commands should be used to check. The amepat utility reports with my factor of 1.8 on my server, which is not a "plus" mo...
by qt_ky
Fri May 16, 2014 11:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: To handle empty file/only hd tr file
Replies: 6
Views: 2509

The unix test -s tests if the specified file exists and has a size greater than zero.

Code: Select all

if [ -s /path/file ] then ...
by qt_ky
Fri May 16, 2014 5:48 am
Forum: General
Topic: Active Memory Expansion (AME) and Information Server
Replies: 5
Views: 1375

Examine output from these commands:

lparstat -i

amepat
by qt_ky
Thu May 15, 2014 9:29 pm
Forum: General
Topic: Active Memory Expansion (AME) and Information Server
Replies: 5
Views: 1375

Surely I'm not the first to try this... Actually, an IBM contact confirmed that AME was tested successfully with DataStage a few years ago. A few weeks ago I had this feature enabled using a memory expansion factor of 1.8 which is close to the value that the AME planning tool had recommended. Now In...
by qt_ky
Thu May 15, 2014 6:10 pm
Forum: General
Topic: Determining Config File Nodes on SMP system
Replies: 6
Views: 3524

Re: Determining Config File Nodes on SMP system

Second to that, is there a method to monitor and determine if the configuration is helping or hurting? Method: focus on single a job to tune, or a single set of jobs that represent your typical workload, use a significantly sized set of data, and run repeatedly. Change only one thing at a time and ...
by qt_ky
Thu May 15, 2014 8:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Date Conversion?
Replies: 3
Views: 1809

MonthDayFromDate() would not be necessary, as the resulting day of the month is always day 1. Make sure to test dates ranges including January 1st through 20th, to ensure it falls back to the previous year. :idea: You may be able to avoid the "check the date if day is > 20" and similar &qu...
by qt_ky
Wed May 14, 2014 6:51 pm
Forum: General
Topic: Convert UNIX Epoch to Timestamp
Replies: 1
Views: 699

Yes:

Code: Select all

TimestampFromTimet()
Conversely:

Code: Select all

TimetFromTimestamp()
by qt_ky
Wed May 14, 2014 6:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: binding input interface field error
Replies: 5
Views: 1897

I would be surprised if it did not complain about putting a space into a date data type.
by qt_ky
Wed May 14, 2014 12:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to see the non printable characters
Replies: 6
Views: 2383

Are you asking how to determine what character the delimiter is? From unix command line, this command will tell each character's value in hex. I suggest you run it on a small 1 or 2 line sample file.

Code: Select all

od -x file.txt
by qt_ky
Wed May 14, 2014 5:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connecting to SQL server using windows authentication
Replies: 2
Views: 1169

From a server on UNIX, the answer always used to be no.

I have not yet tested the newer ODBC drivers myself, but the docs had said this feature was coming.

viewtopic.php?t=145443&start=15
by qt_ky
Tue May 13, 2014 2:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Adding Business days to a date (i.e Excluding Sat and Sun)
Replies: 8
Views: 2377

If your incoming dates can fall on Saturdays or Sundays then you have to follow business rules to reject the records, or add 1 or 2 more days to the new date, or subtract 1 or 2 days, etc. First after you convert your incoming varchar string to a date, you can test for Sat or Sun using this function...
by qt_ky
Tue May 13, 2014 1:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Adding Business days to a date (i.e Excluding Sat and Sun)
Replies: 8
Views: 2377

Ignoring holidays, 15 business days typically equates to 21 calendar days, unless you're in a country with a six day work week... Some of the new tech startup companies now honor a 4 day work week to attract employees! Is your requirement equivalent to adding 3 calendar weeks (21 calendar days) to t...
by qt_ky
Tue May 13, 2014 9:21 am
Forum: General
Topic: Ports used for DataStage 8.7
Replies: 4
Views: 1972

If the installation response file is still on the server, it has a good starting list of ports that were chosen during the install. The default install path on UNIX is /opt/IBM/InformationServer. Yours may be different.

Code: Select all

grep -i port response.txt
by qt_ky
Tue May 13, 2014 9:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: fixed length file : Abort when the record is longer
Replies: 1
Views: 1408

The file is not fixed length. The record length is fixed. Commonly known as a fixed-width file. It's not very forgiving when you read fixed-width files.

If you really want to force such records onto a reject link, you could try to read it as a delimited file and Char data type.
by qt_ky
Tue May 13, 2014 9:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing rank
Replies: 3
Views: 2183

What is the connection to DataStage Server Edition forum? All I see is a bunch of SQL. :?: