Mark,
Where do you find the CRC32 function? Im running DS v6.0.1 on HP-UX and dont see it anywhere.
Thank you,
Tony
Mark Ewart-Phipps wrote:
Hi Lourenco
There is a function called CRC32 in DataStage which will allow you to do
this check. One concatenates the relevant columns together and passes this
long string to the function.
What you typically would do is the following:
1.The very first time you do the CRC32 check, write the integer the function
returns to the target table e.g. CRC_Value
2.Create a hash file with the natural key and the CRC_Value
3.Read the source table, performing a CRC32 function on the relevant columns
4.Lookup your hash file using the natural key and compare the CRC values, if
they are not equal u know theres a change.
5.Apply the appropriate changed dimension strategy you use
Be careful to ensure that the CRC you perform, when you read the source, is
based on the same string as the CRC stored in the target file.
Hope this helps.
-----Original Message-----
From: lourenco.arnasalon@itc.alstom.com
[mailto:lourenco.arnasalon@itc.alstom.com]
Sent: Friday, October 03, 2003 2:01 PM
To: datastage-users@oliver.com
Subject: Cyclic Redundancy Checksum
Anybody knows how to implement a CRC in datastage in order to avoid finding
the changed records by carefully
searching the whole table columns.
:.________________
CONFIDENTIALITE : Ce message et les iventuelles pihces attachies sont
confidentiels. Si vous njtes pas dans la liste des destinataires, veuillez
informer lexpiditeur immidiatement et ne pas divulguer le contenu ` une
tierce personne, ne pas lutiliser pour quelque raison que ce soit, ne pas
stocker ou copier linformation quil contient sur un quelconque support.
CONFIDENTIALITY : This e-mail and any attachments are confidential and
may be privileged. If you are not a named recipient, please notify the
sender immediately and do not disclose the contents to another person, use
it for any purpose or store or copy the information in any medium.
---------------------------------
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
Cyclic Redundancy Checksum
Hi Tony
When you are defining a derivation, click on the elipses (...) and select
Function. Then select Conversion. You will then see all the conversion
functions. You have the option of using either Checksum or CRC32. (There is
no help available for CRC32, but it works like Checksum, therefore read the
help on Checksum and you should be ok.)
Regards
-----Original Message-----
From: Tony Stark [mailto:tonystark622@yahoo.com]
Sent: Friday, October 03, 2003 3:52 PM
To: datastage-users@oliver.com
Subject: RE: Cyclic Redundancy Checksum
Mark,
Where do you find the CRC32 function? Im running DS v6.0.1 on HP-UX and
dont see it anywhere.
Thank you,
Tony
Mark Ewart-Phipps wrote:
Hi Lourenco
There is a function called CRC32 in DataStage which will allow you to do
this check. One concatenates the relevant columns together and passes this
long string to the function.
What you typically would do is the following:
1.The very first time you do the CRC32 check, write the integer the function
returns to the target table e.g. CRC_Value
2.Create a hash file with the natural key and the CRC_Value
3.Read the source table, performing a CRC32 function on the relevant columns
4.Lookup your hash file using the natural key and compare the CRC values, if
they are not equal u know theres a change.
5.Apply the appropriate changed dimension strategy you use
Be careful to ensure that the CRC you perform, when you read the source, is
based on the same string as the CRC stored in the target file.
Hope this helps.
-----Original Message-----
From: lourenco.arnasalon@itc.alstom.com
[mailto:lourenco.arnasalon@itc.alstom.com]
Sent: Friday, October 03, 2003 2:01 PM
To: datastage-users@oliver.com
Subject: Cyclic Redundancy Checksum
Anybody knows how to implement a CRC in datastage in order to avoid finding
the changed records by carefully
searching the whole table columns.
:.________________
CONFIDENTIALITE : Ce message et les iventuelles pihces attachies sont
confidentiels. Si vous njtes pas dans la liste des destinataires, veuillez
informer lexpiditeur immidiatement et ne pas divulguer le contenu ` une
tierce personne, ne pas lutiliser pour quelque raison que ce soit, ne pas
stocker ou copier linformation quil contient sur un quelconque support.
CONFIDENTIALITY : This e-mail and any attachments are confidential and
may be privileged. If you are not a named recipient, please notify the
sender immediately and do not disclose the contents to another person, use
it for any purpose or store or copy the information in any medium.
---------------------------------
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
When you are defining a derivation, click on the elipses (...) and select
Function. Then select Conversion. You will then see all the conversion
functions. You have the option of using either Checksum or CRC32. (There is
no help available for CRC32, but it works like Checksum, therefore read the
help on Checksum and you should be ok.)
Regards
-----Original Message-----
From: Tony Stark [mailto:tonystark622@yahoo.com]
Sent: Friday, October 03, 2003 3:52 PM
To: datastage-users@oliver.com
Subject: RE: Cyclic Redundancy Checksum
Mark,
Where do you find the CRC32 function? Im running DS v6.0.1 on HP-UX and
dont see it anywhere.
Thank you,
Tony
Mark Ewart-Phipps wrote:
Hi Lourenco
There is a function called CRC32 in DataStage which will allow you to do
this check. One concatenates the relevant columns together and passes this
long string to the function.
What you typically would do is the following:
1.The very first time you do the CRC32 check, write the integer the function
returns to the target table e.g. CRC_Value
2.Create a hash file with the natural key and the CRC_Value
3.Read the source table, performing a CRC32 function on the relevant columns
4.Lookup your hash file using the natural key and compare the CRC values, if
they are not equal u know theres a change.
5.Apply the appropriate changed dimension strategy you use
Be careful to ensure that the CRC you perform, when you read the source, is
based on the same string as the CRC stored in the target file.
Hope this helps.
-----Original Message-----
From: lourenco.arnasalon@itc.alstom.com
[mailto:lourenco.arnasalon@itc.alstom.com]
Sent: Friday, October 03, 2003 2:01 PM
To: datastage-users@oliver.com
Subject: Cyclic Redundancy Checksum
Anybody knows how to implement a CRC in datastage in order to avoid finding
the changed records by carefully
searching the whole table columns.
:.________________
CONFIDENTIALITE : Ce message et les iventuelles pihces attachies sont
confidentiels. Si vous njtes pas dans la liste des destinataires, veuillez
informer lexpiditeur immidiatement et ne pas divulguer le contenu ` une
tierce personne, ne pas lutiliser pour quelque raison que ce soit, ne pas
stocker ou copier linformation quil contient sur un quelconque support.
CONFIDENTIALITY : This e-mail and any attachments are confidential and
may be privileged. If you are not a named recipient, please notify the
sender immediately and do not disclose the contents to another person, use
it for any purpose or store or copy the information in any medium.
---------------------------------
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
Mark,
Thanks for the information. I had never seen these functions listed. I appreciate the help in locating them.
Tony
Mark Ewart-Phipps wrote:
Hi Tony
When you are defining a derivation, click on the elipses (...) and select
Function. Then select Conversion. You will then see all the conversion
functions. You have the option of using either Checksum or CRC32. (There is
no help available for CRC32, but it works like Checksum, therefore read the
help on Checksum and you should be ok.)
Regards
-----Original Message-----
From: Tony Stark [mailto:tonystark622@yahoo.com]
Sent: Friday, October 03, 2003 3:52 PM
To: datastage-users@oliver.com
Subject: RE: Cyclic Redundancy Checksum
Mark,
Where do you find the CRC32 function? Im running DS v6.0.1 on HP-UX and
dont see it anywhere.
Thank you,
Tony
Mark Ewart-Phipps wrote:
Hi Lourenco
There is a function called CRC32 in DataStage which will allow you to do
this check. One concatenates the relevant columns together and passes this
long string to the function.
What you typically would do is the following:
1.The very first time you do the CRC32 check, write the integer the function
returns to the target table e.g. CRC_Value
2.Create a hash file with the natural key and the CRC_Value
3.Read the source table, performing a CRC32 function on the relevant columns
4.Lookup your hash file using the natural key and compare the CRC values, if
they are not equal u know theres a change.
5.Apply the appropriate changed dimension strategy you use
Be careful to ensure that the CRC you perform, when you read the source, is
based on the same string as the CRC stored in the target file.
Hope this helps.
-----Original Message-----
From: lourenco.arnasalon@itc.alstom.com
[mailto:lourenco.arnasalon@itc.alstom.com]
Sent: Friday, October 03, 2003 2:01 PM
To: datastage-users@oliver.com
Subject: Cyclic Redundancy Checksum
Anybody knows how to implement a CRC in datastage in order to avoid finding
the changed records by carefully
searching the whole table columns.
:.________________
CONFIDENTIALITE : Ce message et les iventuelles pihces attachies sont
confidentiels. Si vous njtes pas dans la liste des destinataires, veuillez
informer lexpiditeur immidiatement et ne pas divulguer le contenu ` une
tierce personne, ne pas lutiliser pour quelque raison que ce soit, ne pas
stocker ou copier linformation quil contient sur un quelconque support.
CONFIDENTIALITY : This e-mail and any attachments are confidential and
may be privileged. If you are not a named recipient, please notify the
sender immediately and do not disclose the contents to another person, use
it for any purpose or store or copy the information in any medium.
---------------------------------
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
---------------------------------
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
Thanks for the information. I had never seen these functions listed. I appreciate the help in locating them.
Tony
Mark Ewart-Phipps wrote:
Hi Tony
When you are defining a derivation, click on the elipses (...) and select
Function. Then select Conversion. You will then see all the conversion
functions. You have the option of using either Checksum or CRC32. (There is
no help available for CRC32, but it works like Checksum, therefore read the
help on Checksum and you should be ok.)
Regards
-----Original Message-----
From: Tony Stark [mailto:tonystark622@yahoo.com]
Sent: Friday, October 03, 2003 3:52 PM
To: datastage-users@oliver.com
Subject: RE: Cyclic Redundancy Checksum
Mark,
Where do you find the CRC32 function? Im running DS v6.0.1 on HP-UX and
dont see it anywhere.
Thank you,
Tony
Mark Ewart-Phipps wrote:
Hi Lourenco
There is a function called CRC32 in DataStage which will allow you to do
this check. One concatenates the relevant columns together and passes this
long string to the function.
What you typically would do is the following:
1.The very first time you do the CRC32 check, write the integer the function
returns to the target table e.g. CRC_Value
2.Create a hash file with the natural key and the CRC_Value
3.Read the source table, performing a CRC32 function on the relevant columns
4.Lookup your hash file using the natural key and compare the CRC values, if
they are not equal u know theres a change.
5.Apply the appropriate changed dimension strategy you use
Be careful to ensure that the CRC you perform, when you read the source, is
based on the same string as the CRC stored in the target file.
Hope this helps.
-----Original Message-----
From: lourenco.arnasalon@itc.alstom.com
[mailto:lourenco.arnasalon@itc.alstom.com]
Sent: Friday, October 03, 2003 2:01 PM
To: datastage-users@oliver.com
Subject: Cyclic Redundancy Checksum
Anybody knows how to implement a CRC in datastage in order to avoid finding
the changed records by carefully
searching the whole table columns.
:.________________
CONFIDENTIALITE : Ce message et les iventuelles pihces attachies sont
confidentiels. Si vous njtes pas dans la liste des destinataires, veuillez
informer lexpiditeur immidiatement et ne pas divulguer le contenu ` une
tierce personne, ne pas lutiliser pour quelque raison que ce soit, ne pas
stocker ou copier linformation quil contient sur un quelconque support.
CONFIDENTIALITY : This e-mail and any attachments are confidential and
may be privileged. If you are not a named recipient, please notify the
sender immediately and do not disclose the contents to another person, use
it for any purpose or store or copy the information in any medium.
---------------------------------
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
---------------------------------
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search