teraread error in Datastage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
trammohan
Participant
Posts: 47
Joined: Thu Nov 13, 2003 12:47 pm

teraread error in Datastage

Post by trammohan »

Hi ,

When I use a teraread through datastage I am getting the following error after processing some records

##I TOSH 000010 18:28:34(000) <main_program> orchgeneral: loaded
##I TOSH 000010 18:28:34(001) <main_program> orchsort: loaded
##I TOSH 000010 18:28:34(002) <main_program> orchstats: loaded
##I TFSC 000000 18:28:34(003) <main_program> APT configuration file: /apps/opt/aedw/source/config/config.apt
INFO:TCOS 18:28:35(000) <main_program> Echo:
teraread
-query 'select cust_id, cmpy_cd from bcadprd_tblsv.PWBTCDB1'
-server veritt4
-dboptions '{ user=z159203, password=z159203}'
-dbname WORK_TBLS_EXPORT >| /apps/opt/aedw/source/bcad_data/PWBTCDB1.TXT;

##W TTER 000703 18:29:14(000) <teraread> When checking operator: There will be some skew in the usage of the server b
ecause the number of players (15) is not evenly divided by the number of available nodes (8).
##W TFIG 000431 18:29:14(001) <APT_RealFileExportOperator in autoexport(0)> When checking operator: When validating e
xport schema: At field "CMPY_CD": Exporting nullable field without null handling properties
##I TTER 000741 18:30:07(000) <teraread,0> 100000 records processed
##I TTER 000741 18:30:12(000) <teraread,5> 100000 records processed
##I TTER 000741 18:30:36(000) <teraread,7> 100000 records processed
##I TTER 000741 18:30:38(000) <teraread,10> 100000 records processed
##I TTER 000741 18:30:38(000) <teraread,3> 100000 records processed
##I TTER 000741 18:30:42(000) <teraread,9> 100000 records processed
##I TTER 000741 18:30:43(000) <teraread,4> 100000 records processed
##I TTER 000741 18:30:44(000) <teraread,12> 100000 records processed
##I TTER 000741 18:30:45(000) <teraread,0> 200000 records processed
##I TTER 000741 18:30:52(000) <teraread,6> 100000 records processed
##I TTER 000741 18:30:54(000) <teraread,7> 200000 records processed
##I TTER 000741 18:31:01(000) <teraread,9> 200000 records processed
##I TTER 000741 18:31:03(000) <teraread,10> 200000 records processed
##I TTER 000741 18:31:05(000) <teraread,12> 200000 records processed
##I TTER 000741 18:31:07(000) <teraread,0> 300000 records processed
##I TTER 000741 18:31:09(000) <teraread,3> 200000 records processed
##I TTER 000741 18:31:12(000) <teraread,6> 200000 records processed
##I TTER 000741 18:31:21(000) <teraread,9> 300000 records processed
##I TTER 000741 18:31:22(000) <teraread,7> 300000 records processed
##I TTER 000741 18:31:24(000) <teraread,12> 300000 records processed
##I TTER 000741 18:31:26(000) <teraread,4> 200000 records processed
##I TTER 000741 18:31:26(000) <teraread,10> 300000 records processed
##I TTER 000741 18:31:43(000) <teraread,0> 400000 records processed
##I TTER 000741 18:31:59(000) <teraread,8> 100000 records processed
##I TTER 000741 18:32:01(000) <teraread,3> 300000 records processed
##I TTER 000741 18:32:02(000) <teraread,9> 400000 records processed
##I TTER 000741 18:32:05(000) <teraread,7> 400000 records processed
##I TTER 000741 18:32:06(000) <teraread,6> 300000 records processed
##I TTER 000741 18:32:07(000) <teraread,10> 400000 records processed
##I TTER 000742 18:32:07(000) <teraread,0> 439678 total records processed.
##I TTER 000742 18:32:09(000) <teraread,9> 440180 total records processed.
##I TTER 000741 18:32:10(000) <teraread,12> 400000 records processed
##I TTER 000742 18:32:12(000) <teraread,7> 440235 total records processed.
##I TTER 000742 18:32:18(000) <teraread,10> 440275 total records processed.
##I TTER 000742 18:32:19(000) <teraread,12> 439515 total records processed.
##I TTER 000741 18:32:20(000) <teraread,8> 200000 records processed
##I TTER 000741 18:32:23(000) <teraread,6> 400000 records processed
##I TTER 000742 18:32:29(000) <teraread,6> 439728 total records processed.
##I TTER 000741 18:32:30(000) <teraread,4> 300000 records processed
##I TTER 000741 18:32:32(000) <teraread,3> 400000 records processed
##I TTER 000741 18:32:40(000) <teraread,8> 300000 records processed
##I TTER 000742 18:32:41(000) <teraread,3> 439639 total records processed.
##I TTER 000741 18:33:21(000) <teraread,8> 400000 records processed
##I TTER 000742 18:33:26(000) <teraread,8> 440223 total records processed.
##I TTER 000741 18:33:30(000) <teraread,4> 400000 records processed
##I TTER 000742 18:33:39(000) <teraread,4> 439635 total records processed.
##E TTER 000620 18:34:56(000) <teraread,13> APT_TeraUtils: Slave session CLI Error:: 'Fetch failed: Error Code = 220
', error code = 1 message: 'Fetch failed: Error Code = 220'
DBCAREA msg_txt: MTDP: EM_DBC_CRASH_A(220): Network connection to the DBC was lost.

##E TFOR 000146 18:34:56(001) <teraread,13> Failure during execution of operator logic
##I TFOR 000143 18:34:56(002) <teraread,13> Output 0 produced 24300 records
##F TUXX 000002 18:34:56(003) <teraread,13> Internal Error: (0): terasession.C:1162: cliGetRespParcel: fetch failure
Traceback: (gdb) Detaching from program: /apps/opt/ascential/apt/bin/osh, process 4545

##E TFPM 020092 18:34:56(000) <node_dreamG5> Player 2 terminated unexpectedly.
##E TFPM 020192 18:34:56(000) <teraread,6> Unexpected exit status 1
##E TFOR 000146 18:34:56(000) <APT_RealFileExportOperator in autoexport(0),0> Failure during execution of operator lo
gic
##I TFOR 000142 18:34:56(001) <APT_RealFileExportOperator in autoexport(0),0> Input 0 consumed 4293872 records
##F TFIO 030045 18:34:56(002) <APT_RealFileExportOperator in autoexport(0),0> waitForWriteSignal(): Premature EOF on
node ewttlt01 No such file or directory
##E TFPM 020192 18:34:56(001) <APT_RealFileExportOperator in autoexport(0)> Unexpected exit status 1
##E TFSR 000002 18:35:01(000) <main_program> Step execution finished with status = FAILED.
INFO:TCOS 18:35:01(000) <main_program> Schemas:
Data set "teraread[o0].v":
record
( CUST_ID: decimal[12,0];
CMPY_CD: nullable string[4];
)
Operator "teraread":
output 0 interface:
record
( CUST_ID: decimal[12,0];
CMPY_CD: nullable string[4];
)
Operator "{natural="/apps/opt/aedw/source/bcad_data/PWBTCDB1.TXT", synthetic="autoexport(0)"}":
input 0 interface:
record
( CUST_ID: decimal[12,0];
CMPY_CD: nullable string[4];
)

INFO:TCOS 18:35:01(001) <main_program> Startup Time 0:49 Production Run Time 5:38


please help me

thanks

ram
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Isolate the actual error messages. What do these tell you?

APT_TeraUtils: Slave session CLI Error:: 'Fetch failed: Error Code = 220', error code = 1 message: 'Fetch failed: Error Code = 220'
DBCAREA msg_txt: MTDP: EM_DBC_CRASH_A(220): Network connection to the DBC was lost.

(The next piece reports the fetch failure on node 13. This almost certainly results from losing the connection.)

Premature EOF on node ewttlt01 No such file or directory

(This may be a consequent error, or may be a separate error. Without your configuration file I cannot tell if node ewttl01 is node number 13.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
bigpoppa
Participant
Posts: 190
Joined: Fri Feb 28, 2003 11:39 am

teraread error in Datastage

Post by bigpoppa »

It is recommended to run PX on an even number of nodes. If you set the config to be 14-way or 16-way, do you still get the same problem?

-BP
xli
Charter Member
Charter Member
Posts: 74
Joined: Fri May 09, 2003 12:31 am

Re: teraread error in Datastage

Post by xli »

We have got the EE job failed with the same issue :

ExtPATY_ACCTFrmGDW..AcctIFound: MTDP: EM_DBC_CRASH_A(220): Network connection to the DBC was lost.

BTW, we have 4 nodes in the configuration file.

Any advice ?

Thanks
bigpoppa wrote:It is recommended to run PX on an even number of nodes. If you set the config to be 14-way or 16-way, do you still get the same problem?

-BP
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Get a more reliable network.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

:lol: In other words, talk to your SAs and/or Network guys.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply