DSXchange

Remember that datastage ftp stage is used to read files on remote systems and not for transferring them. Create a small script that ftp's your file and call that script in the before job subroutine 'ExecSh'.

Congrats narasimha. Keep up the good work

You are right. Its the pipe. Its working fine for any other character. Well, you can do it in the before job subroutine.

Try giving in

Actually you know what, this will work for you

do you need to provide the complete path for sed. What happens when you just provide sed, without its fully qualified path?

Is your output a flat file or a database stage? If the latter, then you can provide the appropriate TO_DATE() format for conversion. If the former, then I think, you need to tailor your own C function.

narasimha wrote:everything gets truncated when used in the Filter command.

What do you mean by that?

You mean the entire file's contents are deleted?
Try

Or just run it in ExecSh in before job subroutine.

I have never done anything like this before but I am assuming that a CD drive will be treated like just another drive. The ftp will be run from the unix box, so the id should have access to your windows platform. Rest is straight forward, fire the script, get the file, process it.

What happens when you ftp the file from command line? Does it work there?

Welcome Aboard
It will be a standard ftp script. Search for more details. I believe there is a script in one of the posts that does the same.
What is CD format anyways?

Its clearly a meta data issue. Change both to varchar and see if the error goes away.
Also, what is the length for this particular column.

Just change the type to Date. No explicit conversion is required.

It might be empty in the source.
The sort stage does not change the data, only re-arranges it.
EDITED:
Change the source meta data to Date as well. Both should be the same. Either varchar or Date.