DSXchange

Can you partition your database? This would speed up load times. How fast is your pure extract without upsert? Can you split your update and insert statements? If not, is your insert/update or update/insert order correct? Does the table have constraints or indices?

You have 2 types of arrays in DataStage BASIC - static and dynamic. The static arrays are one or two dimensions and declared as DIM MyArray({Ycols},{Ycols}) . The other type are dynamic arrays and they are not limited in either total length or number of dimensions by DS. Dynamic arrays are very powe...

I assume you mean a .csv comma-separated Excel file; since as far as I know DS cannot create excel files.

What call are you using to send the finished file, is it the DSSendMail function call from the sequence and if so, what are the paramters?

Take one of your rejected rows and manually put in the SQL in your favorite tool and see if the row is inserted correctly or if you get an error message.

Hello Prasanna, could you elaborate a bit on what you are doing? To "spool" a file means to print it so your question confuses me a bit. Is this a DataStage batch/Sequence? Which program is generating the error you posted?

You need to specify a reject link in your transform stage and capture rejected rows in there (along with the SQL error codes) and see why the database is rejecting messages. Perhaps you have additional constraints on the key?

There are no Info/Basic programming instruction books out there, as far as I know. The only material that exists are training and similar guides for the full spectrum of the programming language (with a lot of stress put on the database aspects, which are less important in DataStage). You can search...

Stage variables are derived in the order in which they show up in the designer. Your variable SVUPDATE refers to both SVCRCIN and SVRCLKP of the last row's data.

The default file limit depends upon the flavour of UNIX you are using and the version. It seems that files greater the 2Gb are enabled on your system. I'll save you the effort of doing a search for 64BIT and point you at this sample thread that deals with how to create a 64BIT hashed file to store m...

Sure, he can do that - but using Rows/Second numbers is meaningless with so many different factors so I wanted to get a rough idea of the system's speed. If the poster can only extract rows from that table to DataStage at 250 rows/second then the current speeds aren't bad. If, on the other hand, the...

Can you have your DBA run your job using his DB/2 userid/password just to make sure that the DB/2 permissions are sufficient? If the error persists even with the godlike DBA access rights then you will be certain that the error lies on the DataStage side.

Loading 200-500 rows per second is quite slow for a load. If you do a simple extract from that table in a datastage job that writes to a sequential file on /dev/null what speed do you get -- this will allow you to see what your best extract speeds are and your writes to the same table will be slower...

Since you are doing a lookup you are going to be restricted to using either a Hashed file or another type of table lookup. The limit on sequential file sizes is imposed by your operating system, some systems still have a 2Gb limit in place, on many systems this limit can be changed either at the fil...

Please look at page 6-16 of the Install and Upgrade Guide. It tells you exactly what grants are needed for DB/2 and includes the syscat.tables.

Singhal, a quick use of the search facility would have shown you that this type of file corruption has been encountered before and many people have posted responses. The file needs to be repaired. If you go into TCL or the ADMIN command mode you can do a "CLEAR.FILE RT_LOG161" and this will most lik...