ExecSH to remove dataset in After-Job subroutine

[ASU_ETL_DEV]

Hello,
I am trying to delete three work datasets after the job is done. I placed this command statement in the After-Job subroutine of the parallel job:

$orchadmin rm #$TEMP_FILES_DIR#dset_BB_USERS_aft.ds; $orchadmin rm #$TEMP_FILES_DIR#dset_BB_USERS_bef.ds; $orchadmin rm #$TEMP_FILES_DIR#dset_BB_USERS_ccap.ds

The command gets executed but only the descriptor gets deleted. The data files connected to the descriptor remain on the node directories specified in the config file.
What am I doing wrong?

Thanks
Marco

[rkashyap]

Path issue. $orchadmin is getting substituted by null so Unix is executing "rm #$TEMP_FILES_DIR#dset_BB_USERS_aft.ds" and deleting the descriptor file.

In order to fix this issue:
a) You can create a Unix script and invoke it in "After job subroutine." See steps in technote.
Or
b) Give complete path to orchadmin. i.e.

Code: Select all

$APT_ORCHHOME/bin/orchadmin rm #$TEMP_FILES_DIR#dset_BB_USERS_aft.ds

[ASU_ETL_DEV]

Thank you! So could I add $APT_ORCHHOME/bin to the PATH variable in dsenv and keep the ExecSH command as is (without the $ signs)?

[rkashyap]

Yes, assuming all requisite variables are correctly setup in dsenv. Try it and share the results.

[ASU_ETL_DEV]

Just to test, I created a variable, ORCHADMIN_PATH, added it to the command and it worked:

#$ORCHADMIN_PATH#/orchadmin rm #$TEMP_FILES_DIR#/dset_BB_USERS_aft.ds

I'll add it to the PATH in dsenv.

Thanks for your help.

[rkashyap]

Please note that "After Job Subroutine" will run even on jobs fails.

It will be a good idea to push deletion to a subsequent step which is only invoked on job's success.

[chulett]

Please note the option / check box to only run on job success.

[rkashyap]

Craig, Thanks for pointing this.