DSXchange

Just wanted to highlight something Ray didn't specifically call out on his IsValid example... IsValid returns a Boolean value of "0" or "1". In DataStage, False is represented by a value of "0" and True is represented by a value of "1". That's why Ray eliminat...

However, to integrate DataStage as an "always on" service behind a web (or other application) your site must have purchased the InfoSphere Information Services Director (IISD) product, which is somewhat pricey. As such, most sites do not buy it by default, and only purchase it when required.

Longer answer...

The tech note does state: "set both the user process limit (ulimit -u) and file handle limit (ulimit -n) to 10000 or more."

So insure that both "nofile" and "nproc" are set appropriately.

The target of the extension mapping (The mainframe file) should be imported into the repository using IMAM, as an Implemented data resource. Then it should show up in the lineage when DataStage processes that data resource.

Yes we connect to Hive Server2, but our URL looks slightly different... jdbc:ibm:hive://hiveserver.company.com:10000;AuthenticationMethod=kerberos;ServicePrincipalName=hive/hiveserver.company.com@KERBEROS_DEFAULT_REALM;loginConfigName=JDBC_DRIVER_USERID Look in /etc/krb5.conf under libdefaults for t...

Two questions: 1) Does your site use Kerberos for security? If so, I might be able to help (I have only worked at Kerberos sites). 2) Have you or your admin setup the config file for Hive? https://www.ibm.com/support/knowledgecenter/en/SSZJPZ_11.7.0/com.ibm.swg.im.iis.conn.hive.usage.doc/topics/hive...

Raven received...

Famingoy banned... posts deleted.

Paul's suggestion to use the SGID bit is a good one, it also insures that all new files are owned by the dstage group, even if the creator doesn't have dstage as their primary group. It can also be set with the "g+s" option of chmod: $ ls -ld DevProject drwxrwxr-x 7096 root dstage 4096 Aug...

Just worked for an hour trying to diagnose a strange problem where a transformer would not compile, and kept failing with these two errors: ##W IIS-DSEE-TFTM-00012 10:46:02(011) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of...

Unfortunately , most of the documentation, videos and manuals out there are in English (including this site). Though IBM stopped producing manuals after 11.3, the 11.3 ones are still mostly current and are still very usable, and more importantly, are available in multiple languages. InfoSphere Infor...

You will need to install the DB2 client software. You can usually use the newest client, but confirm that it is compatible and supported by your DB2 database version as well as your DataStage version. No, you cannot use just a driver, the client must be installed. As you yourself noted, the database...

What you are describing is only done automatically (and transparently) if your Oracle database is using Oracle Real Application Cluster (RAC) software that is separately purchasable. If you have an Oracle RAC, here is how it can be done... How to define Data Source for ODBC to Oracle RAC in IBM Info...

Wow... You really necro'd this dead thread from 2013... and I believe BluePrint Director is dead as well. It is in 11.3, but not visible in 11.5 or later. I never saw an announcement, it just disappeared. It may just be out of the suite (separate), but I doubt it. Doesn't seem to be anything current...

chulett wrote:...after sitting here and staring at my answer while the site slowly attempts to move elsewhere...

Just got them to reboot the server. MUCH better now...

Per what Arndt said, the descriptor file is tiny - it just describes where the parts are - no impact on performance. The data portion of the dataset may actually be located in HDFS. That depends on the settings in the $DSHOME/yarn.config file. In it there's the following section: APT_YARN_USE_HDFS=t...