Sequential File Pattern Read Using Multiple Readers

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
jerome_rajan
Premium Member
Premium Member
Posts: 376
Joined: Sat Jan 07, 2012 12:25 pm
Location: Piscataway

Sequential File Pattern Read Using Multiple Readers

Post by jerome_rajan »

Hi All,
I've created a job that reads more a batch of files and pushes it further for processing. Using the file pattern tor read the files means that I am constrained to just one reader per node in the sequential file stage. Is there a way to increase the number of readers per node while using file pattern to read?
Jerome
Data Integration Consultant at AWS
Connect With Me On LinkedIn

Life is really simple, but we insist on making it complicated.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I am not sure at this time. How it behaves behind the scenes also depends on your version and settings. Please see this topic for more info, especially for the versions prior to 11.3.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply