SSD (Solid State Drives) and Information Server 8.5

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
sparq
Premium Member
Premium Member
Posts: 21
Joined: Wed Jun 09, 2010 6:06 am
Location: Australia

SSD (Solid State Drives) and Information Server 8.5

Post by sparq »

Hi,

We are looking at speeding up our DataStage jobs with the use of SSD technology (enterprise SSD).

Our main bottleneck is the Disk I/O, so the idea is to try and decrease this bottleneck. We would mainly use the SSD for Scratch/Temp/Sorting.

Has anyone implemented SSD's with Information Server ?
Did you face any challenges ?
Did the SSD make much difference ?

Thanks in advance.


Krisztian
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I haven't seen or heard of anyone making the leap to Enterprise SSDs yet for DataStage but I imagine the only challenge would be to cut through all of the vendor hype and find out how well the various models actually perform. From what I've seen (looking for and implementing a personal SSD boot drive on my PC) it's like the wild west out there and vendors can make up pretty much any benchmark they like.

Found this article online with some interesting thoughts along those lines on standards. Also some notes there about performance over time and reads v. writes v. the 'moving the data around' management that they do. I'm sure there are other articles out there with similar information.
Last edited by chulett on Wed Dec 07, 2011 7:48 pm, edited 1 time in total.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I am aware of a colleague who used a 16GB thumb drive for extra scratch disk when no other disk was available, but have no information about performance other than that it was successful.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
sparq
Premium Member
Premium Member
Posts: 21
Joined: Wed Jun 09, 2010 6:06 am
Location: Australia

Post by sparq »

I am aware of larger companies (AMAZON for example) that have made the move of replacing their HDD with SSD.

For our purpose it would be mainly for temporally storage due to the high throughput and extremely low access times.

For example the OCZ Z-Drive R4 models use the PCIE bus (x8) and reach 2800MB/sec (Read/Write). These can also be fitted in 1U blades.
The new generation PCIE drives remove the bottleneck from the SATA interface.

Here is an article comparing a few different SSD for Oracle performance
http://www.anandtech.com/show/4879/ocz- ... d-review/7

Krisztian
aartlett
Charter Member
Charter Member
Posts: 152
Joined: Fri Apr 23, 2004 6:44 pm
Location: Australia

Post by aartlett »

A little off topic but I helped a collegue use a 5 bay NAS fitted with 2.5"bays to hold 5 x 256GB SSD's in a raid 5 configuration for about 1TB fast access.

After the datamarts are created and cubes generated they are copied to the NAS for user access. 2 x 1GB ethernet links, paired into it to improve network performance to the unit and ... dayamn ... that thing is fast. Only one write a day for the data dump.

The solution was to fix bad performance on the cubes for reports. User requirements made the cubes just plain ugly so this $8K solution was a good stop gap to the $100K to "fix" the reports.

users happy, geeks happy ... management screaming over the $8K cost ... I don't get the screaming, but I'm techo geek anyway.
Andrew

Think outside the Datastage you work in.

There is no True Way, but there are true ways.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I just ran across this older SSD topic and was wondering, has anyone experimented any further in recent years with SSD's and DataStage?

This article describes a few SSD concerns to watch out for: The write endurance and lifecycle limitations, and the write cliff, where performance can apparently become bad.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply