DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 193 matches
Author Message
 Topic: Separating Services and Repository tiers from Engine
thompsonp

Replies: 2
Views: 191

PostForum: General   Posted: Thu Jan 18, 2018 5:16 am   Subject: Separating Services and Repository tiers from Engine
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: RHEL
If we start with a basic installation topology where the Services, Repository and Engine tiers are all on the same server, how easy is it to separate the Engine tier from the other two at a later date ...
 Topic: Fork-join with condition
thompsonp

Replies: 1
Views: 258

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Jan 17, 2018 9:36 am   Subject: Fork-join with condition
What are you hoping to see in col1 on the output?

If it's just the col1 value from the row that had the last non zero value in col2 then it's straightforward.

Filter out all the rows where col2 ...
 Topic: Intel Kernel design flaw / bug
thompsonp

Replies: 6
Views: 324

PostForum: General   Posted: Thu Jan 04, 2018 3:37 am   Subject: Intel Kernel design flaw / bug
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Any idea what impact the patches to Linux and Windows to address the Intel cpu flaw will likely have on typical DataStage workloads?

I've been reading that workloads with lots of network and i/o ma ...
 Topic: Webinar vNext
thompsonp

Replies: 8
Views: 480

PostForum: General   Posted: Wed Dec 13, 2017 8:44 am   Subject: Webinar vNext
Seems not - I've had nothing since the slide deck was sent after the first webinar.
 Topic: Webinar vNext
thompsonp

Replies: 8
Views: 480

PostForum: General   Posted: Wed Dec 13, 2017 2:34 am   Subject: Webinar vNext
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Does anyone have any updates on when the next version of Information Server will be released?
The webinar in November was interesting but it's gone quiet since.
 Topic: Problem joining four tables
thompsonp

Replies: 7
Views: 796

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Dec 08, 2017 5:50 am   Subject: Problem joining four tables
Your sql is wrong.
and B.ID3 = C.ID3 should be and B.ID3 = D.ID3

back to DataStage and are you trying to do all this is one join stage?

The inputs need to be partitioned and sorted correctly so ...
 Topic: tuning a massive checksum job
thompsonp

Replies: 3
Views: 554

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Nov 17, 2017 3:35 am   Subject: tuning a massive checksum job
Can you provide some more details about the job?

What are the source and targets?
Are you reading from the database in parallel?
What else is the job doing if anything?
In the checksum what opti ...
 Topic: Automate loading flat files
thompsonp

Replies: 8
Views: 614

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Oct 13, 2017 8:22 am   Subject: Automate loading flat files
What is the source of the census data?
Doesn't the source / supplier have meta data for each one? If not how are you determining what each one contains?
 Topic: Environment Isolation
thompsonp

Replies: 6
Views: 887

PostForum: General   Posted: Fri Oct 13, 2017 8:13 am   Subject: Environment Isolation
One thing we have done at the hardware level is to carve out the licensed number of cores into a shared cpu pool, which is shared by multiple LPARs. That allows us to stand up a new LPAR having a newe ...
 Topic: Environment Isolation
thompsonp

Replies: 6
Views: 887

PostForum: General   Posted: Tue Aug 15, 2017 9:25 am   Subject: Environment Isolation
We have limitations on the size of virtual servers (a la carte from 3rd party).
The physical servers are larger and cheaper.

Two goals for isolation; security and performance impact from other pro ...
 Topic: Environment Isolation
thompsonp

Replies: 6
Views: 887

PostForum: General   Posted: Tue Aug 15, 2017 5:03 am   Subject: Environment Isolation
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: Linux
On a single large physical server what are the best ways to isolate environments?
For example we might have dev, test and uat environments.
I could have a simple install with all non client tiers on ...
 Topic: Performance Issue in DataStage 11.5
thompsonp

Replies: 8
Views: 845

PostForum: General   Posted: Thu Aug 10, 2017 6:55 am   Subject: Performance Issue in DataStage 11.5
This is not what you would expect.

You have also posted about whether the driver might affect the data.

Both the functionality and the performance need regression testing after the upgrade to id ...
 Topic: Want to fix a particular warning with Funnel stage
thompsonp

Replies: 5
Views: 1213

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Aug 10, 2017 6:42 am   Subject: Want to fix a particular warning with Funnel stage
Firstly - no need to post the same thing in two places.
Hopefully one of the admins can remove the duplicate in the General section.

Have you checked that diff_3_sku exists on all the input stream ...
 Topic: Grid storage NAS vs SAN
thompsonp

Replies: 6
Views: 1443

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Jul 25, 2017 8:56 am   Subject: Grid storage NAS vs SAN
Paul,
I'm still not clear on what is required of the file system and what the issues with having a SAN might be.
We have two head nodes sharing the compute nodes and some parts of the file system us ...
 Topic: Grid storage NAS vs SAN
thompsonp

Replies: 6
Views: 1443

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 03, 2017 7:44 am   Subject: Grid storage NAS vs SAN
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: RHEL
I have seen a few posts about the choice between NAS or SAN in a grid environment and some dsx members appear to prefer NAS, mostly for simplicity.

In one of the redbooks it states:
•In a SAN conf ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours