Hierarchical stage is dropping rows with Ctrl-Z

[chanaka]

Hi Experts,

Wish you and your families a happy and prosperous new year ahead!

We have a hierarchy stage job that processes a large volume data file and put the modified records in to a DataSet. The problem we face is it is dropping the records whenever there are any free form texts within the incoming records that has a Ctrl+Z ascii control character. If we edit the file and remove the Ctrl+Z manually, that record will get processed without any issues. Just wanted to check to see if anyone else has faced a similar issue and have a way of making the hierarchy stage to process the problematic record by setting any environment variables.

Note: our intention is to not to do preprocessor step and remove the Ctrl+Z via a string replacement. Rather keep the special character as it is and process it.

Thanks in advance!

[ray.wurlod]

If you're on Windows this is difficult, because Ctrl-Z is the Windows internal end-of-file mark. You're probably going to need two string edits, maybe Ctrl-Z to something else (Ctrl-Y?) on input and back again on output.