DSXchange

I've got a book from IBM here called "An Overview of the IBM WebSphere Data Integration Suite", the section on SOA states the following benefits: * Scalable - They provide real-time scalability by distributing request processing and stopping/starting job instances across multiple WebSphere servers. ...

You can process it as a normal sequential file and parse the data in a transformer. It is worth installing the click pack routines as they will parse URLs for you without you needing to write the code. I found the log reader stage was very efficient and using the sequential file stage did not give a...

There was a session on this at AscentialWorld a couple years ago, from memory they were able to provide high availability by running the jobs through the RTI pack. The config files are hard coded to nodes, the RTI pack is more flexible letting jobs run on servers that are free or under utilised. You...

If you were doing a lot of these you could go for the RTI pack and call it as a web service.

There is a FAQ How do I remove duplicate rows from a data source? This will give you a few options.

You need to read the PDF and help file that comes with the click pack. The Log Reader stage has a property that defines the type of information to be retrieved from the log file using a set of character codes. There are also a set of routines installed including one that can parse a URL from a log e...

You can access all the release readme notes on the Ascential-IBM e.services web site. You will need your serial number to create a login.

I've been nominated for Best New Blog! Please head over to m and vote for me on the second voting screen. "An Experts Guide to WebSphere Information Integration" is currently running equal third on 12%. I'm up against some very good bloggers and I would like to thank everyone on the site who nominat...

If you use a lookup stage with 30 million rows you will find your job still needs to move most of that reference data into a lookup file. It cannot lookup directly against a dataset. The dataset will still be fast in that it is already partitioned and on the nodes. The lookup fileset will be faster ...

Seems like a perfect business case for use Real Time Integration. Currently it is an additional license fee, though in the Hawk release it may be free. It lets you turn any job into a web service. You can then write something that calls the web service and passes it the customer number.

I have always wanted a voting button on replies to indicate that a reply was useful or popular. Maybe a rating out of five. Similar to the voting on sites such as Yahoo Answers. This would make the search facility far more effective. I've lost count of the number of times I've searched for an answer...

Thanks for the great feedback, it is one of the things that makes blogging rewarding. You can also nominate one of my entries for best blog entry of 2005 but you need to choose entry from last year. For DataStage tips I recommend you read: DataStage server v enterprise: some performance stats If you...

The ittoolbox web site is running IT Community Choice Awards for favourite blogs. If you have read and enjoyed my blog An Expert's Guide to WebSphere Information Integration on that site please vote for me at: m I am hoping to sneak into the top 5 "Best New Blog" category. If you haven't seen my blo...

Yah, join with the reference data already sorted may be good as 2 billion will never fit into lookup RAM memory. Make sure your job doesn't try to resort the data. The lookup fileset would take a long time to load and may be an option if you use this particular 2 billion dataset in multiple jobs. Wi...

It is an interesting topic. I think both products will have a strong future. Informatica have bet on both horses with ELT ability built into the latest PowerCenter. IBM-Ascential have opted to bypass ELT and go with feature rich ETL, Hawk release sees better data quality plugins. If you tried to do ...