Dataset Deletion Error

[Nageshsunkoji]

Hi Dsxians,

We are facing one strange issue in Ds Parallel 7.5, related to dataset. In one of our job, its a simple job extracting the data from DB2 API stage and loading into a dataset. With the first run, we got the warning When deleting data set PROD_DS, previous delete attempt not complete; removing PROD_DS.being_deleted in order to proceed. When We tried to ran once again the job is aborted with the belwo message :

main_program: Internal Error: (d->nPartitions()== nPartitions_): datamgr/segment.C: 276
Traceback: pureAssertion__13APT_FatalPathFPCcPCci() at 0xd2e68654
setPartitionDescriptor__13APT_DMSegmentFPC16APT_DMDescriptor() at 0xd2821ca4
setPartitionDescriptor__16APT_DMDescriptorFv() at 0xd281d788
readDescriptor__17APT_DMFileDataSetFv() at 0xd28c74b8
describe__17APT_DMFileDataSetFR16APT_DMDescriptor() at 0xd28c66b0
setFileMode__14APT_DataSetRepFRC11APT_UStringQ2_11APT_DataSet9DirectionQ2_11APT_DataSet10OutputFlag() at 0xd25cb714
__ct__11APT_DataSetFRC11APT_UStringQ2_11APT_DataSet9DirectionQ2_11APT_DataSet10OutputFlagRC11APT_UStringQ2_11APT_DataSet6DSType() at 0xd25c4dfc
instantiateAndInitializeDataSet__22APT_OSL_SIL_DataEntityFP20APT_OSL_SIL_StepSpecR12APT_ErrorLog() at 0xd4a8a04c
instantiateAndInitializeStep__20APT_OSL_SIL_StepSpecFR12APT_ErrorLog() at 0xd4a85e6c
createAndCheckStep__7APT_OSLFP20APT_OSL_SIL_StepSpecR12APT_ErrorLog() at 0xd4a4aa30

We tried to run 2 to 3 times, but all the times it was aborted. We tried to delete the dataset by using Dataset Management Utility/Orach Admin Rm command. But, Dataset is throwing the above warning when we tried to delete the dataset. Please share your ideas on the same. I Have searched the DSXchange Site, But I didn't get the releavent post.

[ArndW]

Please check the UNIX access rights to the DataSet descriptor file and to the partfiles referenced by the descriptor - do you have delete rights? When you used the "orchadmin -rm {dataset}" command what messages did you get?

[mantums]

Hi Dsxians,

We are facing one strange issue in Ds Parallel 7.5, related to dataset. In one of our job, its a simple job extracting the data from DB2 API stage and loading into a dataset. With the first run, we got the warning When deleting data set PROD_DS, previous delete attempt not complete; removing PROD_DS.being_deleted in order to proceed. When We tried to ran once again the job is aborted with the belwo message :

main_program: Internal Error: (d->nPartitions()== nPartitions_): datamgr/segment.C: 276
Traceback: pureAssertion__13APT_FatalPathFPCcPCci() at 0xd2e68654
setPartitionDescriptor__13APT_DMSegmentFPC16APT_DMDescriptor() at 0xd2821ca4
setPartitionDescriptor__16APT_DMDescriptorFv() at 0xd281d788
readDescriptor__17APT_DMFileDataSetFv() at 0xd28c74b8
describe__17APT_DMFileDataSetFR16APT_DMDescriptor() at 0xd28c66b0
setFileMode__14APT_DataSetRepFRC11APT_UStringQ2_11APT_DataSet9DirectionQ2_11APT_DataSet10OutputFlag() at 0xd25cb714
__ct__11APT_DataSetFRC11APT_UStringQ2_11APT_DataSet9DirectionQ2_11APT_DataSet10OutputFlagRC11APT_UStringQ2_11APT_DataSet6DSType() at 0xd25c4dfc
instantiateAndInitializeDataSet__22APT_OSL_SIL_DataEntityFP20APT_OSL_SIL_StepSpecR12APT_ErrorLog() at 0xd4a8a04c
instantiateAndInitializeStep__20APT_OSL_SIL_StepSpecFR12APT_ErrorLog() at 0xd4a85e6c
createAndCheckStep__7APT_OSLFP20APT_OSL_SIL_StepSpecR12APT_ErrorLog() at 0xd4a4aa30

We tried to run 2 to 3 times, but all the times it was aborted. We tried to delete the dataset by using Dataset Management Utility/Orach Admin Rm command. But, Dataset is throwing the above warning when we tried to delete the dataset. Please share your ideas on the same. I Have searched the DSXchange Site, But I didn't get the releavent post.

If the first run is not complete due to some memory or space issue ie, job got aborted while trunkating the dataset; while running 2nd time u will get the above specified error. So, u have to delete the dataset & its half deleted dataset manually then procedd with the run.

[snt_ds]

See we are focussing on the solution, can any one tell us what is the cause of this warning message, see we can't delete the datasets each time while running our job in all scenerios, atleast not possible in our case. Please help me to know the cause fo this warning.

[ray.wurlod]

If you choose Overwrite as the Data Set write method it is deleted and re-created. You can verify this by inspecting the score.