Problem when filtering an input file

Archive of postings to DataStageUsers@Oliver.com. This forum intended only as a reference and cannot be posted to.

Moderators: chulett, rschirm

Locked
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Problem when filtering an input file

Post by admin »

Hi forumers.

I have a huge problem when I filter an input file, using a tramsformer
stage.

The input file has 24000 records, and from these records about 16000 match
the selection criteria. But only 9500 are selected (all numbers were
rounded).

Is there any limit in DataStage for the process of records, or filters, or
whatever can make this process fail ?

Any help will be appreciated.

Thanks in advance.

P.S.: I checked out the condition and everything is fine.


Guillermo P. Barsky - gbarsky@osde.com.ar
Gerencia de Sistemas - Desarrollo

OSDE Binario - Filial Metropolitana
Alem 1067, Piso 16
(5411)4510-4330
http://www.osde.com.ar
<b>PLEASE READ</b>
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
admin
Posts: 8720
Joined: Sun Jan 12, 2003 11:26 pm

Problem when filtering an input file

Post by admin »

Guillermo,

Try checking for null values on the input file. If they exist, but are not
handled in the transformer by an "If IsNull()..." check, they diappear
quietly. Another option would be to create a reject file to capture the
records which don't match your selection criteria and see if anything
interesting shows up.


Julie




gbarsky@osde.com.
ar To: datastage-users@oliver.com
cc:
11/04/2003 12:21 Subject: Problem when filtering an input file
PM
Please respond to
datastage-users










Hi forumers.

I have a huge problem when I filter an input file, using a tramsformer
stage.

The input file has 24000 records, and from these records about 16000 match
the selection criteria. But only 9500 are selected (all numbers were
rounded).

Is there any limit in DataStage for the process of records, or filters, or
whatever can make this process fail ?

Any help will be appreciated.

Thanks in advance.

P.S.: I checked out the condition and everything is fine.


Guillermo P. Barsky - gbarsky@osde.com.ar
Gerencia de Sistemas - Desarrollo

OSDE Binario - Filial Metropolitana
Alem 1067, Piso 16
(5411)4510-4330
http://www.osde.com.ar








*************************************************************************
PRIVILEGED AND CONFIDENTIAL: This communication, including attachments, is for the exclusive use of addressee and may contain proprietary, confidential and/or privileged information. If you are not the intended recipient, any use, copying, disclosure, dissemination or distribution is strictly prohibited. If you are not the intended recipient, please notify the sender immediately by return e-mail, delete this communication and destroy all copies.
*************************************************************************
<b>PLEASE READ</b>
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Locked