DSXchange

The physical system limits are quite large, most likely limited by the amount of memory you have and disk space you allocate or point to in the configuration files.
The practical limits to file size are much smaller - think of how long it takes to build the lookup table.

Since you didn't mark your problem as resolved - the column name "File_TBLEID" isn't in the schema and thus the stage won't work.

There is currently no way to hide link lines (and it seems that those pesky link names cannot remember where to stay, either)

Insufficient access rights on the secondary keys (look at directories starting with I_)?

No, I don't know the limit. But I just tested a job with 1000 columns and derivations and it compiled and ran without a problem. The compilation took about 10 minutes and as a comparison my current PX job compiles in about 30 seconds ( ~80 stages, no transforms).

If you have DataStage installed, you will have all the relevant documents in PDF form installed in your PC's \Program Files\Ascential\DataStage7.5\Docs directory. The Parallel Job Developer's Guide and the Parallel Job Advanced Developer's Guide are good starting points.

I am sure that there is a limitation on the number of columns, but it is certainly higher than what you currently have.

I am confused, you state that the compile hangs forever, yet you have a message "compile failed" - which is it? If the compile failed, there will be additional error messages.

I like using the command line tool orchadmin ll {dataset} ; that gives me the number of records per partition, total bytes, etc.

You could try to get a 2nd opinion on the number of the records in the dataset.

"Time" contains no notion of time zone, so there is no actual patch possible for this issue. You need to know what your source time location is (Standard) and then use the daylight savings rules for switching between PDT and PST to convert to appropriate "local time". If your UNIX server is setup co...

Are you sure that you are looking at the actual record counts and not some limit placed by the "view data" in the Data Set Management tool?

Transform PX stages can take a long time to generate and compile. On some systems the C++ compiler has a concurrent user limit, so you not only need to wait the time for the compile but you might also be waiting for someone else to finish using a C++ license. I have waited 10-15 minutes for a compil...

Do things change if you add a semicolon? Also, this will get executed on each processing node (in this case it wouldn't make much of a difference, but it is important to realize what DS does).

So you have a column that, according to the DDL in the database, is NOT NULLABLE, and when you import that via the manager it also states NOT NULLABLE yet when you view or run a job using that metadata you get the warning message regarding the nullable-to-not-nullable conversion? How did you get the...

...Can we import the .gz files which are in remote unix server using FTP satge in datastage... Sort of - but I wouldn't recommend doing it that way. If you "fake" the metadata in the FTP stage to be one (binary) column and pipe the incoming binary stream into a unzip program it will work (I have do...

I haven't actually installed the patch so I don't know what is involved; although if it was a "packaged" install it should be removable from the control panel and the system state prior to the patch will be restored upon deletion.