Columns being dynamically shuffled in a Dataset
Posted: Tue Apr 27, 2004 12:06 am
Hi,
We are facing a severe issue in our parallel jobs.
My jobs after processing the input data are writing it into a dataset. The table definition(order of columns) of the dataset and the mappings are in the correct order.
The issue is, when we make some minor changes to the code (not in the mappings or column definition) and run the jobs, the output columns in the dataset are not in the order as in the table definition for it i.e the schema of the dataset is changing dynamically with each such run and observed with the Dataset Management option in DataStage.
The dataset where this problem is observed is the final output dataset and hence the order of columns is very critical.
Please provide some suggestions/pointers as to the cause and solution to this issue.
Thanks in advance,
We are facing a severe issue in our parallel jobs.
My jobs after processing the input data are writing it into a dataset. The table definition(order of columns) of the dataset and the mappings are in the correct order.
The issue is, when we make some minor changes to the code (not in the mappings or column definition) and run the jobs, the output columns in the dataset are not in the order as in the table definition for it i.e the schema of the dataset is changing dynamically with each such run and observed with the Dataset Management option in DataStage.
The dataset where this problem is observed is the final output dataset and hence the order of columns is very critical.
Please provide some suggestions/pointers as to the cause and solution to this issue.
Thanks in advance,