DSXchange

If you use FTP to get the files to/from the mainframe you can let FTP do the ASCII/EBCDIC conversion for you as well. Word of warning about using FTP. This works great if the record is all text. However, if you have fields that really need to be packed data (ex. target COBOL fields is a comp-3), th...

There is a variable that we set at the project level (can also be set for each job) called APT_RDBMS_COMMIT_ROWS. By default, DataStage commits every 100 rows - which creates a lot of overhead and slows things down when you are processing potentially millions of records. We set the var to 8192 for t...

Not sure if this is the 'best' way to do it, but it worked well for us. We had a file that had both header and footer records. On import, we specified the main record layout and then made sure there was a reject link. The reject from an import leaves the data as a raw field so on the reject link we ...

Perhaps I spoke (bragged?) too soon. It looks like you're one (or more?) up on us in terms of versions. We are using DS PX 7.1r2 and when we switch to 64-bit AIX, we are staying with 5.1. That probably would explain the difference in our experiences. Did you ever try any older versions (DataStage or...

If you are trying to export data to a flat file, use the Sequential file stage as the target for your data stream. In other words, if the link goes INTO the Sequential file stage, the stage will be treated as an export. If the link COMES OUT OF the Sequential file stage, then the stage is treated as...

Robert The volume of records are high and we avoided the Aggregator Stage. I was looking at the forum and there were some discussion about using dsrecords. Did anyone managed to use this and get the count from dataset. Thanks I use dsrecords all the time - from the command prompt. Not sure, off han...

I don't know about a 64-bit DataStage, but the normal version should be able to run on 64-bit AIX. We are currently on DB2 7.2 and AIX 5.1, 32-bit and are upgrading to 64-bit (AIX 5.1 and DB2 8.2) next month. As for 'not stable on AIX' as a 32-bit app, then our last year of processing hundreds of Da...

Thanks to all for your help. I also worked with some guys from my team that have more experience with the config files (they built the ones we use with DB2), and with Glenn Bryan from Ascential. The fix is a mix of config file and an additional option for the Teradata Enterpise Stage (undocumented i...

This actually looks more like an import error as opposed to a database error. What is the field definition (from the file's layout, like a COBOL copybook - not DataStage)? What is the field definition in DataStage? It sounds like there is a mismatch between what the file has and what DataSTage is ex...

Found the docs. They unfortunately do not come with the DataStage installation. We downloaded them from Ascential's website ( http://www.ascentialsoftware.com/eservice/index.jsp , then click on Product Docuementation on the left side of page). They did help, thanks! We still need to update our confi...

No, they don't need to be hard coded. Our shop started out using Torrent, the predecessor to the DS PX, and it was much easier to write the buildops with hardcoded schemas because we generated everything. In DataStage, it is much easier to simply propogate fields, so we are hard-coding the schemas a...

You need to look at the Orchestrate doc and This is from the Orchestrate Operator's Reference manual. Are you referring to the old Torrent documentation (pre DataStage PX)? I looked at ours, and while I found a chapter entitled "Teradata Interface Library", it was not Chapter 37. Am I loo...

Small pedantic point. Surrogate keys don't need to be a sequence of numbers, they don't even have to be numbers; all they have to be is unique within the table. You're right, but for some reason the Surrogate Key stage in DS (in the Processing group) only uses 16,32, or 64 bit integers. If you want...

BuildOps are actually pretty easy, and you don't have to do them completely by hand (manual compile, etc). You can build them either in Manager or Designer. Right Click on Stage Types and go to New Parallel Stage/Build.... This opens a new window for building your new Stage. There are 4 main tabs, b...

I assume you need this in Parallel and not Server, right? If so, then the conversion is handled upon import. Define your file as binary EBCDIC on import. To do this, in your import File stage, Output/Format tab, Type defaults group, General Category, add the following options: Character Set, Data fo...