DSXchange

Please post your table structure and column types

Repeating on the above reply, just pass the path of where your .TXT file resides and use it like below in your shell script. SERV=$1 USER=$2 PASS=$3 DBN=$4 BTEQ_DIR=$5 BTEQ_FILE=$6 bteq << EOF .logon $SERV/$USER,$PASS database $DBN; .SET ERRORLEVEL 3807 SEVERITY 0; . run file = $5/$6 .LOGOFF; .QUIT;

Select DatabaseName, TableName, ColumnName, ColumnFormat, ColumnTitle, SPParameterType, ColumnType, ColumnUDTName, ColumnLength, DefaultValue, Nullable, CommentString, DecimalTotalDigits, DecimalFractionalDigits, ColumnId, UpperCaseFlag, Compressible, CompressValue, ColumnConstraint, ConstraintCount...

Create two files (1) 1 shell script (example- loadcountry.sh) that will execute your job can be like one below START SHELL SCRIPT . /companydir/paramfiles/paramvalues.txt ###################################################################### # DataStage Parameter Processing: ########################...

Agree with asorrell. We had 1 ftp via datastage that took 35 minutes for about 500,000 rows but we changed it to load via ftp script and it took only 2 minutes.

Basically just extending the reply by Chulet. (1) Design a job that gets file from using FTP Stage OR (1) Write a shell script that get's the file using FTP to ETL Server.(abc.txt) Once the file is downloaded, just rename it (def.txt) (2) Design a master sequencer that calls above job. In a routine ...

There are some parameters that are used when uploading files on Mainframe, You might want to use something like below FTP www.hostname.com user myuser mypasswd ascii (or binary whatever the case may be) Quote Site Tracks Primary=NN Secondary=NN Quote Site LRECL=NN PUT abc.txt 'fprod.test.abc.txt' By...

Directory for Data and Command Files This folder on your ETL server will hold the .CTL and .DAT file. Make sure datastage user has write permission to this fodler. When you use bulk load, ETL creates the .DAT file that contains data and a .CTL file that is nothind but command file to load the .dat ...

There might be just 1 function but below is the logic that should work within a TRANSFORMER stage Let's say data comes as "20070112.0" (1) Step1: Get everything before decimal (2) Step2: Data is now in YYYY-MM-DD format. So use StringtoDate() How to do that:- (1) Find position of decimal i...

You may want to use conversion function as below:-

StringToDecimal(Column,[ceil])

If this doesn't work, simply round the value and get left[1,3] from the converted string

In order to be sure that nextkeyvalue is not messed up, I always use this option: (1) Once I am at the transformer where all database column is ready, I drag a query and do a select MAX(KeyCol) from Table and then get that value through a lookup. Once you get the MAX value from target table, you can...

(1) Please post all your 5 statements clearly, so that we can what exactly is being done. (2) How much data is being processed .i.el loaded to DB2 table? (3) Any other transformation happening in the ETL flow, or just select and dump data in DB2? Replies to above will help to answer how to performan...

The way I do is, First dump all the Columns I need in a text file. So, now I have all the metadata I need for the table. Then, from the same transformer that feeds the text file, I take 1 more link and connect to a teradata Table Stage (Enterprise, API) [if one is using teradata] On the Table proper...

Few years back, I had a long discussion with some Datastage people regarding this same issue while working on performance tuning project on Datstage and UDB DB2. Basically, they were setting the ArraySize=1, in almost all the jobs they had because they wanted to capture any rejects from the database...

If I understood your question correctly, why not to run a simple SQL statement? Bascially, you want to get all values on COLA from Table DEF that doesn't exist in Table ABC and then write those values to ABC table. How is this SQL? Use UserDefined SQL at the DB2 source, get the rows in transformer a...