Hi,
Which stage among the four stages below consumes less memory at the time of joining two inputs data --- Merge/Funnel/Lookup/Transformerstage? Could some one explain with little bit explanation please?
Memory space for the stages
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 1735
- Joined: Thu Mar 01, 2007 5:44 am
- Location: Troy, MI
-
- Premium Member
- Posts: 1735
- Joined: Thu Mar 01, 2007 5:44 am
- Location: Troy, MI
First of all Funnel does not perform join operation, it is similar to "Union all" in SQL. It does matter if its a interview question as we here in dsxchange strongly believe that the interview questions should be answered based on ones experience rather than re-iterating someone else's answer. But for your truthfulness below are the pointers.
The other 3 Join/Lookup/Merge stages can perform tasks of SQL joins. Please read parallel job developer guide where they have sections like Join Versus Lookup etc which should give a proper idea on their functionality and Memory uses.
To start with the lookup uses RAM to store data coming from reference link while others use disk to store the same.
The other 3 Join/Lookup/Merge stages can perform tasks of SQL joins. Please read parallel job developer guide where they have sections like Join Versus Lookup etc which should give a proper idea on their functionality and Memory uses.
To start with the lookup uses RAM to store data coming from reference link while others use disk to store the same.
Priyadarshi Kunal
Genius may have its limitations, but stupidity is not thus handicapped.
Genius may have its limitations, but stupidity is not thus handicapped.