Reading a mainframe binary file using a CFF stage and simply dumping 5 million rows to a teradata table using Enterprise Stage. Takes anywhere 35-40 minutes to load. No transformation is happening.
(1) Any way to reduce the load time?
(2) Is Enterprise Stage the best way to load 5 mil rows in teradata table?
Performance Tune Teradata Load
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 71
- Joined: Mon Jul 09, 2007 1:12 pm
-
- Charter Member
- Posts: 193
- Joined: Tue Sep 05, 2006 8:01 pm
- Location: Australia
Re: Performance Tune Teradata Load
Enterprise stage will be much faster and in fact it may take only few minutes or even less and I hope this is just an truncate and load to the table.
Hmm i will fill this when ever i get one
Try setting the requestedsessions option to a smaller value. It defaults to the number of AMPs on your server, and the number of player processes is computed by requestedsessions divided by the sessionsperplayer. If you have a lot of AMPs, it results in too many player processes all competing to update the terasync table. Set requestedsessions to a smaller value like 8. How many nodes do you have in your PX config file? Optimally, you'd want to set requestedsessions to the number of nodes multipled by sessionsperplayer. That way you will not have any repartitioning.
-
- Participant
- Posts: 80
- Joined: Sat Mar 18, 2006 10:27 pm