DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message

Joined: 24 Aug 2006
Posts: 78
Location: india
Points: 1101

Post Posted: Wed Jun 01, 2016 5:02 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All,

We are just trying to understand how to set the limit for the Unhandled pattern which i do not think it is feasible:-)

I have got answers from forum ,to do token/word investigate,group by the pattern jobs on how to identify these patterns, after STAN to have an investigate stage again to find the patterns missed.

Say we have received sample file from src system1 and investigated/identified the unhandled pattern and tried to handle the same.

Now ,there is another sample file and we try to do the whole process.

Do we need to get all kind of sample files from each source systems,to come up with the list of unhandled patterns and then try to customize the rules.

But still when the code is prompted to higher environment, and new pattern is identified then it has to come to development again. is it how it is handled in other projects?

In real-time, is it then we cant' freeze that there will be no patterns that is left unhandled

Can someone put some thoughts.


Group memberships:
Premium Members

Joined: 21 Mar 2016
Posts: 362

Points: 3744

Post Posted: Wed Jun 01, 2016 10:38 am Reply with quote    Back to top    

Every company has its own policies.

In production you run it with the best set of rules you were able to come up with after doing analysis of all the input systems that feed the job.

Patterns that STILL fail are rejected and handled according to your policy, which depends on the # of records and what your company wants to do. Some places fix the data at the source, for example.

You should have done enough analysis of your data that you have handled the vast majority of patterns, say 95% as a rough starting point.
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours