I have to test DS 4 jobs against migrrated DS 7 jobs on Informix. Can anyone point me in the direction of some scripts or tools to help
Thanks
Non Regression testing tools and scripts for Informix
Non Regression testing tools and scripts for Informix
Colin Larcombe
-------------------
Certified IBM Infosphere Datastage Developer
-------------------
Certified IBM Infosphere Datastage Developer
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
This is very much a do-it-yourself exercise. There's definitely nothing "out of the box". Because everyone's ETL is different (with the possible exception of PeopleSoft applications) there can never really be a generic solution. There are even differences in what different people want tested. I assume that, by "non regression" testing, you simply mean that the same job produces the same result and the execution times are comparable (or better in the newer release), all else being equal.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
Two things to look at are row comparisons, where you compare the number of rows for each link of a DS4 job against the DS7.x jobs, this requires some extraction of the row counts. This can be done via dsjob reports or by ETLStats, though I don't know whether there is a version 4 compatible ETLStats.
The other comparison is the data content. This could be done through a data comparison tool such as DB Diff, or by dumping the table contents into text files and using a windows comparison tools such as exam diff.
This lets you know whether there are any differences in processing between the version 4 and version 7 jobs.
The other comparison is the data content. This could be done through a data comparison tool such as DB Diff, or by dumping the table contents into text files and using a windows comparison tools such as exam diff.
This lets you know whether there are any differences in processing between the version 4 and version 7 jobs.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
To answer Ray's point, yes I need to ensure that the same number of rows are generated as well as each column is identical.
What worries me is that some of the developed routines will not work in the same way. Although I hope that this will be pretty obvious once run.
Oracle has some nice functionality to help regression testing and I wondered if Informix did to (I guessed wrong!)
I will do as Vince suggests and dump the files to text and then use Ultra Edit to compare them. The volumes are not huge so it shouldn't be too onerous
Thankyou for your assistance.
What worries me is that some of the developed routines will not work in the same way. Although I hope that this will be pretty obvious once run.
Oracle has some nice functionality to help regression testing and I wondered if Informix did to (I guessed wrong!)
I will do as Vince suggests and dump the files to text and then use Ultra Edit to compare them. The volumes are not huge so it shouldn't be too onerous
Thankyou for your assistance.
Colin Larcombe
-------------------
Certified IBM Infosphere Datastage Developer
-------------------
Certified IBM Infosphere Datastage Developer