Dataset - File Pattern workaround ?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vijayrc
Participant
Posts: 197
Joined: Sun Apr 02, 2006 10:31 am
Location: NJ

Dataset - File Pattern workaround ?

Post by vijayrc »

Hi,
We have 116 files and tried using Sequential file/File pattern read, but reading takes a long time, so thinking of an alternative.
Similar to Sequential file file pattern, is there any workaround to read a pattern of Datasets [using orchadmin commands or so] ?
Thanks in advance
Vijay
Top
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Contact ArndW

Post by ArndW »

There is no pattern equivalent for datasets. Have you tried adjusting the readers-per-node settings to add more parallelism to your sequential reads?
Top
Post Reply

Return to “IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)”