DSXchange

You should post this to the Enhancement Wishlist forum. That would be a great option to have. We ran into this sitatuation as well, and it was kind of a pain to capture the duplicates. We ended up adding a separate surrogate key to each record. Then made a copy of the input data (pre-dedup), then de...

The hex text you sent is EBCDIC (40 = space, F1 = '1', F0 = '0', F9 = '9'). In your import / Sequential Stage you should be able to automatically convert from EBCDIC to ASCII.

Hi, i know ds/fs would maintain parallalism and would be more faster in performance when compared to sequential stage. But.... A sequential stage with bulk records need to be read twice. Rather than that i created a intermediate fileset from a sequential file, Then i used this fileset for the furth...

here my input column is CloseDate(in the varchar datatype) and output column(which is in timestamp datatype ) is outdate out.outdate= in.CloseDate ; out. myTmsp .set(in.CloseDate, "%yyyy-%mm-%dd %hh:%nn:%ss.000000"); I think you had some typos (see bolded and italicized code above) - what...

Okay, here's an example. Datafile: 0001|2005-07-04 10:15:01.123456 0002|2005-07-04 10:25:02.123456 0003|2005-07-04 10:35:03.123456 0004|2005-07-04 10:45:04.123456 0005|2005-07-04 10:55:05.123456 Sequential Stage input schema: -schema record {final_delim=end, record_delim='\\n', delim='|', null_field...

I'm sure I mentioned that! 8) Fixed width sequential files CAN be read in parallel mode. Each node reads 1/N of the lines in the file. Because it's fixed width (and therefore the row size and file size are quickly able to be calculated), each process can be given a specific seek() request about whe...

Another option if the names are consistent - you can use a fileset to pull them in. You may have 100 different files with a .dat extension, containing multiple layouts, but the fileset only grabs those files you have specified. The fileset is basically a list of files to process. Here's an example: ...

If you want to do this in a buildop, there are a few different options. If you can get the datetime into a string format, the set function will work. The definition is: /** Sets the timestamp object's state by parsing the supplied string, using an optional format string. @note If the string contains...

When you are extracting your data, are you converting it to char? Why would you expect it to convert to " "?

At a minimum, you could add a case statement to your SQL that would change the '0001-01-01' to '0001-01-03'.

You could use the Column Generator Stage to add a date column that contains the current date (the 'Use Current Date' option in the Column Meta Data editor).

Then your Filter Stage uses a where clause the compares your input date to the new current date field.

We have a similar process. We opted not to do a system wide search because we force all of our *.ds files to be written to a very select set of directories, and all of the physical data files (referenced by the dataset) are only written in one location. Made the search much quicker (the find command...

Remember, we use it in a buildop (Build/Logic/Definitions). I think there are ways to create your own C/C++ functions to be referenced from Transforms, but I do not know how. // Convert any non-graphical characters to ' ' APT_String stringToGraph(APT_String); APT_String stringToGraph(APT_String str)...

The inputs to the Change Capture stage are reads from 2 different DB2 tables with identical layouts (select *). The only other thing that I do to the input stream is sort and hash partition the data on the primary key.

I have created the following process: before_dataset > ChangeCapture > change_dataset after_dataset I specified a change key (cust_acct_id), Change Mode is Explicit Keys, All Values, and I have 2 excluded value fields (period_dt, load_ts). When I run this, I get change_code values of 1-3 (insert, de...

I have not used the Change Capture or Change Apply stages before, so I have been reading the documentation. Now, I understand the Change Capture (identify copies, deletes, inserts, and updates from before and after datasets). However, I am a little confused by the Change Apply stage. According to th...