SFTP issues

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Aquitaine
Premium Member
Premium Member
Posts: 12
Joined: Thu Feb 01, 2007 8:51 am
Location: Somerset

SFTP issues

Post by Aquitaine »

We are using the FTP Enterprise transform to write files directly from Datastage to a remote server, however we occasionally get a failure of the job with the following sort of error:

ftp msg: File "/tmp/pftpData0.31592." not found.

If the job is re-run, it works fine and may continue working for a number of days before falling over again with the same issue (different temp file name)

Has anyone come across this issue?
Cheers
Mark
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

As a guess, I'd think your /tmp space is filling up. Is it being monitored?
-craig

"You can never have too many knives" -- Logan Nine Fingers
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

are you running in a GRID environment where you are being dispatched to various servers at runtime?
Aquitaine
Premium Member
Premium Member
Posts: 12
Joined: Thu Feb 01, 2007 8:51 am
Location: Somerset

Post by Aquitaine »

I am in the process of gathering usage stats for the /tmp disc space so will let you know if this is the issue.

PaulVL - We are not running a GRID environment.

Thanks
Mark
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

What is your TMPDIR environment variable set to?
Aquitaine
Premium Member
Premium Member
Posts: 12
Joined: Thu Feb 01, 2007 8:51 am
Location: Somerset

Post by Aquitaine »

Well from the monitoring I have available to me, it looks like we are only using 11% of the avilable space in /tmp

PaulVL - The TMPDIR environment variable is not set so uses the default /tmp

Does anyone have any ideas why we are getting this failure?
ftp msg: File "/tmp/pftpData0.31592." not found :?

Cheers

Mark
FranklinE
Premium Member
Premium Member
Posts: 739
Joined: Tue Nov 25, 2008 2:19 pm
Location: Malvern, PA

Post by FranklinE »

Judging from your initial post, I am guessing you have a runtime problem, not an environment problem. I suggest you expand your examination to other processes that are running at the time of the failure, and compare that to the processes that are running (or not running) when the process completes successfully.

Edit: I forgot to add that a "not found" can sometimes be a resource contention error, hence my guess.
Franklin Evans
"Shared pain is lessened, shared joy increased. Thus do we refute entropy." -- Spider Robinson

Using mainframe data FAQ: viewtopic.php?t=143596 Using CFF FAQ: viewtopic.php?t=157872
Post Reply