DSXchange

vsanghvi, I intentionally don't complete code snippets - that way you need to look at it and understand what it does {so that you can complete it}. The code given will do what your initial query asked. Now your requirements are to ...I need to reset the variable again and again as the file might hav...

No, there is no need to do that, and with most naming standards in place for DS jobs you would be hard-pressed to fit the names into 18 characters.

Only the project is stored as a schema in the DS Engine.

EastMan,

I usually do a full export into a .dsx file and then search that using a small program for the hashed file name. You can also use an editor - look for the name then go backwards in the text until you find the name of the job.

Shivan,

please remember to post the cause for your problems when you find out so that others may profit from this thread.

Thanks,

DeepakCorning, that's the way it works. Declare it as a integer column reading from a text file and write it to a hash file stage as a char(10) and read it in another stage as a decimal(10,2) and it will still contain the original contents, regardless of it was "hello there" or Japanese text or "1.2...

Shivan, please, please, please RTFM ! I have no problem pointing you in the correct direction but if you are not willing to look up the syntax yourself in the handbook or even do a search on this forum to see how it has been used then there is not a chance that I will do so for you. (a) Convert() ha...

Shivan, You can see that generally DS handles large volumes. Most of us deal with files > 100Mb daily, so the opinions of your colleagues don't really affect us much; since we disprove their assertions each time we load or extract large amounts of data. 1. Sequential files. If you have limited your ...

If your rule is to not commit any data unless all input criteria are satisfied just playing with the builtin COMMIT options wouldn't help you. It might make sense in your case to write all your computed information to a sequential staging file, where all related records are written on a record toget...

Since positioning in a sequential file is not a good idea or practicable, you will need to process your data by reading through the source into a copy, modifying those records that have changed; then renaming your new file to overwrite the old. Since this is a column update, just about any database ...

Ultramundane, This is what I have talking about in my previous posts. By declaring different logical databases in PX I go through different subnets to listeners on the same box and same database. It would be nice to see PX automatically detect each physical interface and see which paths to which lis...

I think it is the same length as the maximum length of a filename in AIX (or on your specific filesystem).

saadmirza, The builtin functionality is called 'NLS' and there are hundreds of posts in this forum alone discussing aspects of this. DataStage will only translate at a character set level, but there are published conversion rules on the internet that explain what the normal latin alphabet representa...

Shivan, the OCONV(YourString,'MCP') function replaces all unprintable characters with a '.' (period). You can then convert all periods in that string to spaces using CONVERT() and you would be finished. There is an active thread from today describing how to do this.

Shivan, even a cursory look at some of the posts mention 'hundreds of thousands' and 'millions' of rows; so the answer to your question is - "Yes, DataStage has limits, but they quite high" {Often the OS limits files to 2Gb, but that can be overridden}. At my site a 100Mb file is usually used as a s...