Error in Join stage
Posted: Tue Jan 02, 2018 3:29 pm
Hi ,
I am getting the following error when trying to join two tables each having 40 million records .
Source 1 -->Checksum-->Join (Primary link )
Source 2 --> Join (reference )
No other complex transformation involved. The Partition is Auto on the Join stage .Job runs on 4 Node in Big Integ environment.
APT_CombinedOperatorController,0: APT_IOPort: read failed on [fd 5: L16.34.70.10:40212, R16.34.70.10:11028], errno 104 (Connection reset by peer)
APT_CombinedOperatorController,0: Virtual data set.; input to "inserted tsort operator {key={value=C1, subArgs={asc, nulls={value=first}, cs}}, key={value=C2, subArgs={asc, nulls={value=first}, cs}}, key={value=C3, subArgs={asc, nulls={value=first}, cs}}, key={value=C4, subArgs={asc, nulls={value=first}, cs}}, key={value=C5, subArgs={asc, nulls={value=first}, cs}}}(1)": getRecord DM read error; returning false.
Please help .
Thanks,
I am getting the following error when trying to join two tables each having 40 million records .
Source 1 -->Checksum-->Join (Primary link )
Source 2 --> Join (reference )
No other complex transformation involved. The Partition is Auto on the Join stage .Job runs on 4 Node in Big Integ environment.
APT_CombinedOperatorController,0: APT_IOPort: read failed on [fd 5: L16.34.70.10:40212, R16.34.70.10:11028], errno 104 (Connection reset by peer)
APT_CombinedOperatorController,0: Virtual data set.; input to "inserted tsort operator {key={value=C1, subArgs={asc, nulls={value=first}, cs}}, key={value=C2, subArgs={asc, nulls={value=first}, cs}}, key={value=C3, subArgs={asc, nulls={value=first}, cs}}, key={value=C4, subArgs={asc, nulls={value=first}, cs}}, key={value=C5, subArgs={asc, nulls={value=first}, cs}}}(1)": getRecord DM read error; returning false.
Please help .
Thanks,