Folks,
One of the ETL guys here was able to secure a patch from IBM that allowed him to create a DS 9.1.2 job in AIX that connected to HDFS.
Rob
Search found 206 matches
- Tue Mar 11, 2014 11:24 am
- Forum: General
- Topic: Big Data File Stage on Solaris.
- Replies: 6
- Views: 3707
- Fri Feb 14, 2014 2:28 pm
- Forum: General
- Topic: DataStage Upgrade
- Replies: 5
- Views: 3844
Looks like the concierge program is done, as is the migration tool.
The InfoSphere Information Server Concierge Program is withdrawn as of Dec 21, 2013
See this link: http://www-01.ibm.com/support/docview.w ... wg21445403The "migration tool" is no longer generally available
- Thu Jan 16, 2014 1:03 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Load a packed decimal field from an EBCIDIC file
- Replies: 4
- Views: 3163
- Thu Jan 16, 2014 12:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Load a packed decimal field from an EBCIDIC file
- Replies: 4
- Views: 3163
See this post that does an excellent job of summarizing the interaction between mainframes and DataStage.
viewtopic.php?t=143596
viewtopic.php?t=143596
- Thu Dec 12, 2013 11:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: special character in schema file
- Replies: 0
- Views: 2646
This character corresponds to xA7 in the 8859-1 (Latin 1) code page. It has been my experience that it's best to avoid characters above the standard set, i.e. anything above x7F, especially for delimiters. This avoids problems such as the one you're are experiencing. My favourite delimiter over the ...
- Wed Dec 11, 2013 2:03 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to retain £ symbol
- Replies: 2
- Views: 3631
Hi HemaV, Your data source is using a different code page than your DataStage environment. The pound Sterling sign is Hex A3 in the extended characters of the Latin 1 (8859-1) code table (the most commonly used code table). Your source and/or your DataStage environment is using a code table that has...
- Thu Dec 05, 2013 12:49 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataStage Sort Stage vs Inline Link Sort
- Replies: 5
- Views: 4252
From the IBM doco for 8.5 =========== Restrict memory usage This is set to 20 by default. It causes the Sort stage to restrict itself to the specified number of megabytes of virtual memory on a processing node. The number of megabytes specified should be smaller than the amount of physical memory on...
- Thu Dec 05, 2013 12:32 pm
- Forum: General
- Topic: DataStage Job Standards Checking Tool
- Replies: 7
- Views: 4468
- Wed Dec 04, 2013 9:18 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataStage Sort Stage vs Inline Link Sort
- Replies: 5
- Views: 4252
- Wed Dec 04, 2013 8:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataStage Sort Stage vs Inline Link Sort
- Replies: 5
- Views: 4252
DataStage Sort Stage vs Inline Link Sort
Folks, The sort Stage in 8.X works much better than it used to in 7.X. We did some benchmarks which indicated that for our test file / environment the sort stage was about twice as fast, presumably because the sort stage can allocate more memory to the sort. Is everyone seeing this kind of performan...
- Wed Dec 04, 2013 7:06 am
- Forum: General
- Topic: DataStage Job Standards Checking Tool
- Replies: 7
- Views: 4468
My approach has always been to create templates of each data flow pattern. I ensure that the pattern adheres to all the standards. Each detail design specifies a starting pattern and adherence to the pattern / standards is enforced at code review time. IBM is suggesting much the same approach. Some ...
- Tue Dec 03, 2013 2:58 pm
- Forum: General
- Topic: DataStage Job Standards Checking Tool
- Replies: 7
- Views: 4468
DataStage Job Standards Checking Tool
Folks, On a bit of a trolling mission here... I'm documenting ETL best practices and standards at my current client. One of the managers had experience with a tool that would check 3GL code for naming conventions, code layout, commenting, etc. and wondered if such a thing exists in our world. While ...
- Wed Oct 30, 2013 6:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Balanced Optimizer - Transform Stage
- Replies: 8
- Views: 4998
Within the Balanced Optimizer dialog you can specify the range of stages to push into the source/target database. Have you investigated this feature which, I believe, is new in version 9.1? Hi Ray, We're still getting access to 9.1. The admin hasn't yet gotten the GCC compiler installed, this is th...
- Wed Oct 30, 2013 6:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Balanced Optimizer - Transform Stage
- Replies: 8
- Views: 4998
You can't force datastage to push down when it doesn't want to do so. Your only option would be to manually manipulate the job if it didn't push as much logic into the database as you were hoping. Hi Keith, That's exactly what I'm talking about. Determining the tricks needed to manually manipulate ...
- Wed Oct 30, 2013 1:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Balanced Optimizer - Transform Stage
- Replies: 8
- Views: 4998
Hi Ray, While we may find some jobs that we can push down without any logic that would require a transform stage, I don't want to limit myself. My expectation is that I would very quickly get to jobs that have that sort of complexity. Of course, this will lead to a whole different exercise. We will ...