Search found 44 matches

by PeteM2
Wed Apr 18, 2012 3:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuration File Tuning
Replies: 2
Views: 1968

Configuration File Tuning

We currently have a 2 node enterprise configuration but are thinking of increasing this. We can create as many file systems as required with each file system being allocated as much disc storage as required. Below is our current AIX server configuration. what is the optimum node and resource disk co...
by PeteM2
Wed Apr 18, 2012 2:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: parallel datasets
Replies: 7
Views: 2709

Is it the case that If the resource disks allocated to the 4 nodes will not be the same as the original disks allocated to the 2 node configuration .

Then there will be orphan data files and the dataset utility can identify these files for deletion?
by PeteM2
Tue Apr 17, 2012 5:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: parallel datasets
Replies: 7
Views: 2709

I take it that after the job has run with the new config file, the header component will point to the new 4 partitions of data. It will no longer reference the original 2 partitions of data.

Therefore does the dataset utility easily identify these orphaned data partitions?
by PeteM2
Mon Apr 16, 2012 10:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: parallel datasets
Replies: 7
Views: 2709

parallel datasets

Given the scenario of a dataset being defined as 'overwrite' in a job using 2 nodes and each node had a seperate disk resource file system. If the nodes was increased to 4 nodes with each node having seperate disk resource file systems, would the file be seamlessly re-created across the 4 file syste...
by PeteM2
Mon Apr 16, 2012 3:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuration of RAM disk for scratch pad usage
Replies: 3
Views: 3268

Configuration of RAM disk for scratch pad usage

Problem description we configured datastage to use RAM disk when using the scratch pad resource, please see config file below:- node "node1" { fastname "cb17biretlprd" pools "" resource disk "/opt/dstransfer/Datasets" {pools ""} resource scratchdisk ...
by PeteM2
Tue Apr 10, 2012 10:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Moving 'dataset' data segment files to new file systems
Replies: 3
Views: 1485

Is there an option for orchadmin whereby the descriptor file remains in the same file location but the data segments are moved to the locations specified in the config file?
by PeteM2
Tue Apr 10, 2012 7:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Moving 'dataset' data segment files to new file systems
Replies: 3
Views: 1485

Moving 'dataset' data segment files to new file systems

Currently all our data segment files for datasets reside on the same file system. I would like to spread the segment files across a number of file systems to reduce the I/O bottleneck but have the file descriptor remain on the current file system.

What is the best method of achieving this?
by PeteM2
Thu Apr 05, 2012 10:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: location of 'datasets'
Replies: 5
Views: 1969

Does the config file node 'dataset' file system only relate to where new data files should be located?

Therefore is it the case that the location of existing data files would be derived from the decriptor file without any reference to the config file?
by PeteM2
Thu Apr 05, 2012 9:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: location of 'datasets'
Replies: 5
Views: 1969

location of 'datasets'

Does having the dataset descriptor file is on a different file sytem than the data files cause any problems? The reason i am asking this is that the descriptor and data files are currently on the same file system and in order to reduce I/O queuing i would like to keep the descriptor file for new dat...
by PeteM2
Fri Mar 30, 2012 9:28 am
Forum: General
Topic: Project File system Location
Replies: 8
Views: 2523

The disks are on SAN and their performance is fine. The issue is that on the AIX server side we are seeing queuing whilst the disks respond to each request for data. The issue is caused by batch wanting to access the same disks for data - when you have 40 batch jobs running at the same time all want...
by PeteM2
Fri Mar 30, 2012 2:26 am
Forum: General
Topic: Project File system Location
Replies: 8
Views: 2523

The datastage projects reside in one file system and nothing else is on this file system.
by PeteM2
Wed Mar 28, 2012 8:43 am
Forum: General
Topic: Project File system Location
Replies: 8
Views: 2523

Project File system Location

We are currently experiencing I/O bottlenecks on the unix file system that contains all our datastage projects.

Is there any benefit in creating seperate file systems for each project?
by PeteM2
Mon Jan 09, 2012 9:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Assigning RAM disk to scratchdisk resource on AIX 5.3
Replies: 1
Views: 1098

Assigning RAM disk to scratchdisk resource on AIX 5.3

I have read a number of articles around improving job performance by assigning RAM disk to the scratchdisk resource entry in the config file.

Will this work for AIX verion 5.3 and above?