Scratch Space and Resource Disk in Datastage
Posted: Tue Apr 03, 2007 5:11 am
Hello there...
Well I have this job running at the client end and it processes real heavy gusts of data...
Now some time back the jobs fails saying
"APT_CombinedOperatorController,0: write failed: Output file full, and no more output files
write failed: Output file full, and no more output files"
Now This message says that Output file is full but this does not indicate that whether it is Datasets or Some Temporary Files being full.
Doubt arises when we see the error message in the next run
APT_CombinedOperatorController,0: Fatal Error: Tsort merger aborting: Scratch space full
(there is some sorting logic in the job)
1)Now I need to know what is the Scratch Space
2) Also when I see the Environment settings of my project I see that
something called as resource disk also being used.
Can you tell me what exactly are Scratch Disk and the Resource Disk.
Also there is an all together different temporary directory being used in Datastage in the variable TMPDIR
This TMPDIR is not specific to our project it is standard to Datastage.
and can bee seen in the administrator's general Settings Tag
So if this TMPDIR is there then what is the need of Scratch Space to be used
[If my assumption that scratch space is a temporary space used while executing a job is correct ]
Well I have this job running at the client end and it processes real heavy gusts of data...
Now some time back the jobs fails saying
"APT_CombinedOperatorController,0: write failed: Output file full, and no more output files
write failed: Output file full, and no more output files"
Now This message says that Output file is full but this does not indicate that whether it is Datasets or Some Temporary Files being full.
Doubt arises when we see the error message in the next run
APT_CombinedOperatorController,0: Fatal Error: Tsort merger aborting: Scratch space full
(there is some sorting logic in the job)
1)Now I need to know what is the Scratch Space
2) Also when I see the Environment settings of my project I see that
something called as resource disk also being used.
Can you tell me what exactly are Scratch Disk and the Resource Disk.
Also there is an all together different temporary directory being used in Datastage in the variable TMPDIR
This TMPDIR is not specific to our project it is standard to Datastage.
and can bee seen in the administrator's general Settings Tag
So if this TMPDIR is there then what is the need of Scratch Space to be used
[If my assumption that scratch space is a temporary space used while executing a job is correct ]