DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
iamds
Participant



Joined: 13 Jan 2015
Posts: 3
Location: Hyderabad
Points: 25

Post Posted: Tue Jan 13, 2015 1:05 am Reply with quote    Back to top    

DataStage® Release: 8x
Job Type: Parallel
OS: Unix
Hi Guys,

I have couple of questions where need your advice.

Q1) My requirement is to read a mainframe file(ebcidic) having text data. The file is fixed width. I should read it through Complex file stage or Sequential file stage? It's simple file with volume not big enough. In term of performance wise which one is preferable? Overall which stage to use to read?

Q22) Can I read delimited file(pipe) through complex file stage?

Thanks
ArndW

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup

Joined: 16 Nov 2004
Posts: 16318
Location: Germany
Points: 92566

Post Posted: Tue Jan 13, 2015 1:19 am Reply with quote    Back to top    

1. Always try to use the simplest stage possible for a given task, that means in your case the normal sequential file stage is preferable for this file.
2. -not sure- at the moment, since I have only used the stage for COBOL non-delimited files, but if you have the stage in front of you, you should be able to find the section with the delimiters to see what options you have.
Checked the Stage - and the answer is that there is no way to specify a delimiter, variable length types get mapped to static lengths.

_________________

Image
Rate this response:  
Not yet rated
iamds
Participant



Joined: 13 Jan 2015
Posts: 3
Location: Hyderabad
Points: 25

Post Posted: Tue Jan 13, 2015 8:01 am Reply with quote    Back to top    

Thanks. So can we say complex file stage take more more
Resources than sequential file stage?
Rate this response:  
Not yet rated
vibwipro
Participant



Joined: 24 Jan 2013
Posts: 40

Points: 290

Post Posted: Tue Jan 13, 2015 8:31 am Reply with quote    Back to top    

Mainframe file(EBCIDIC) should be read with Complex Flat files, because this stage can handle decoding of Compressed and non- compressed fields based on Copy Book provided to CFF stage. Out put will be in ASCII format over which trannsformations rules can be implemented.

Yes you can recd (Pile) delimited files through CFF stage, by giving delimiter under "Record Option" Tab on CFF stage.
Rate this response:  
Not yet rated
FranklinE



Group memberships:
Premium Members

Joined: 25 Nov 2008
Posts: 739
Location: Malvern, PA
Points: 7018

Post Posted: Tue Jan 20, 2015 2:22 pm Reply with quote    Back to top    

Both answers are correct, almost. There is no reason to prefer CFF over Sequential except for one thing: multiple record types.

Edit: Sorry, there are other considerations. CFF lets you filter data rather than using a Filter stage, and CFF and Sequential have different compatibilities with source channels. For example, my previous design used FTP to stream data directly to the next stage instead of landing a file to the server, but CFF cannot be the next stage.

CFF's biggest advantage is reading multiple record types from one source.

Using a sequential file usually means needing a transformer to parse the record into the fields of the copybook.

In the mainframe legacy world, delimited records are rare. Storage is designed for efficiency, and adding one byte for every field takes up unnecessary space when you have fixed-width fields and records. There's no accounting for lazy developers, of course.

_________________
Franklin Evans
"Shared pain is lessened, shared joy increased. Thus do we refute entropy." -- Spider Robinson

Using mainframe data FAQ: http://www.dsxchange.com/viewtopic.php?t=143596 Using CFF FAQ: http://www.dsxchange.com/viewtopic.php?t=157872
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours