DSXchange

We primarily use DataStage 8.5/11.5 for our data integration needs and soon will also be using Information. Currently all our ETL testing are manual. I am looking for tools/softwares that can be used to "AUTOMATE ETL TESTING" mainly for Datastage and Informatica. Any suggestion will be app...

At this time we migrate the dsx code from one environment to another by exporting and importing dsx code and compiling them manually. The dsx is first sent to ACCUREV for version control and then migrator will pick up the dsx and move to newer environment. My question is "Do we have ANY tool ou...

Lets assume that even if there won't be a deadlock issue, why would you want to have a job that reads and update the same table? Isn't one of the best practice is to separate each database operation (insert, delete, update etc)?

Can there be 2 routines, one for DATE CHECK and one for NUMBER CHECK. Just pass the column value to the routine and get either a value or NULL as OUTPUT. Then insert into table.

Even if you are using multiple node, you can force the file to be read sequentially so that each row gets the next value. Look into the file property and there is a setting to read it sequentially

Are you downloading the file from mainframe system?

This is more of a logical design rather than using the tool to get the job done. Once you extract data from source, check what rows doesn't exist in target and only "insert" new rows. In first run, when you extract 100 rows from source, and all are new, your code will insert all 100 in tar...

Need to know if anyone has used Teradata BTEQ script in Datastage 8.5 and came across any issues?

Password file is just a plain text file that contains the password. It is stored on the ETL Server. If Datastage has access to a particular directory you can create it yourself.

I assume what Tej needs has been already answered by MK. I would make no such assumption, especially considering the questions asked so far and the shear amount of guessing going on in what is being posted. :? When the question is not very clear and we sort of know what he means I guess we can atle...

Martin, This might not be the answer you looking for but whenever we have to sort and rearrange huge amount of data, we do it via a UNIX script rather than using the ETL Tool. UNIX does these operation fairly quickly and efficiently and we never had any memory issues etc. The only catch is you will ...

I assume what Tej needs has been already answered by MK. If you are processing some logic in the first Sequence/Job and the result of the first Sequence needs to be passed to the Second Sequence, then store all the parameter name and value pair from the First Sequence in a sequential file. Then in t...

May be worth trying this

(1) First HardCode Timestamp value and insert in target table and see if
jobs runs successfully.
(2) If it works fine, treat your input timestamp as character column and
then format the input value in the same way as the hardcoded value.

Since you are mentioning that when hardcoding from UNIX works, I bet you it's the password file or the parameter file that you have created for DB2 password. Even though the password looks fine, it might not be !!! I suggest delete the parameter file/ password file and then run your Shell Script wit...

If you are allowed to create a temporary table in Oracle, dump the dataset data into a table where the child oracle table resides and then push down the join operation as SQL between both tables, the temp table as outer joined table.