Hi All, I had an informal discussion my lead today regarding datastage architecture. We had a bit of conflict of interest on the logical/physical node. I told him the actually if we have a single CPU setup then basically it can be considered as a physical node. Whereas multiple logical node can be c...
Hi, I have requirement where we need to process multiple files(say 100) on a daily basis. The mapping is a simple one-to-one i.e. 100 target tables for 100 files. I face two challenges :- a) All the files will have different metadata i.e different columns and will be loaded to different tables. b) T...
@Priya, Can you tell me what's an OP ? And where Kiran has mentioned that he has used Join Stage ? Because below line appears ambigous to me Actually they were used sparse lookup. I thought this was wrong and changed to Normal lookup and Join and tried. Also, Also Reading 90 million records will cre...
Lookup stage is normally used when the reference data is small(Normal Lookup) or the source data is small(Sparse Lookup). In your case neither the source nor the refernce input is small. Try using Join Stage instead of Lookup and then rerun the job. @ArndW 5.7 million is the source count and 90 mill...
Use DB2 Connector Partitioning in the target stage for better performance. And for Transaction and Array size, give them a decent value i.e. not so big and not so small. Now you have to determine the best combination for both as everybody have said that there's no best value. It depends upon various...
This error normally occurs when you try to store a value in a column whose datatype is lesser than the original value. Also whenever your data contains junk value and if its length is greater than the column datatype, you will get the above said error. The only solution for this sort of error is to ...
Hi All, I have both 8.1 and 8.7 clients installed on my machine In 8.1 version, I am able to see Teradata API, Load, Multiload and Enterprise stages. But in 8.7 version, only Teradata connector stage is available. By searching here in dsxchange, I found out that:- 1) all the utilities of teradata li...