DSXchange

Data in source is like '17-APR-10' and we have to load in format "2010-04-17 00:00:00". I tried to serach in forum but could not get format to covert string like '17-APR-10' . Shivinand, The beauty of the format string for StringToDate() is that you can tailor it to fit just about any for...

Im confused a bit here, why cant we use Hash Partitioning on join stage and set the stable sort option , is it absolutely necessary to have a sort stage inserted in between? Im sure i missed something here :( .. The purpose of Craig's suggestion was to avoid resorting the data, which has already be...

Thanks for reading. 1- So what will happen if in the sort stage on partitioning tab I only select hash partition and the the keys, but do not select perform sort and set the 'usage'? Usage is only available when I 'perform sort' on the partition tab? Your data will be partitioned and then sorted ac...

APT_CombinedOperatorController,0: Null string argument. [transform/tfmop_functions.C:1071] logic for svAddr1Null - If IsNull(Policy_Info_In.CO_ADR1) Then 1 Else 0 logic for svChkAddr1Null - If svAddr1Null = 0 Then (If Num(Left(Policy_Info_In.CO_ADR1,2)) Then 1 Else -1) Else -1 if we remove svChkAdd...

Hi wondering if someone can help me understand when to use sorting along with partition type = hash. For the questions below assume that I want to keep data with key columns together on the same processing nodes, APT_NO_SORT_INSERTION = FALSE, and APT_NO_PART_INSERTION = FALSE. 1 - If I'm in the so...

I can't use funnel because the transformer and seq file are put up in a parallel shared container which is used couple of times in a single parallel job. Instead of writing to the sequential file within the shared container, send the rows to the container's output, then funnel those outputs from th...

If I'm using a join stage to join two links having 10 million unsorted rows on each link, and set auto partitoning will auto partitioning take care of both sort and hash partitioning? Here is how my env variable are set APT_NO_SORT_INSERTION = FALSE APT_NO_PART_INSERTION = FALSE Partitioning and So...

we are trying to implement range look up using a combination of join stage and filter stage and for that we are thinking of putting the framework in a shared container which would be accesable in any job that requires a range look-up However the metadata varies from job to job (the number of column...

Make sure that when performing step 3: 1) Only one person is attempting to modify the parameter set (Designer should handle this) 2) After adding a new parameter, you have clicked on Ok and exited the parameter set (especially if running multiple Designer sessions). Have you identified the condition...

To simply use the comment "low volume of data" is inaccurate and limiting because it doesn't indicate which data is being described. You can process any number of records through a lookup stage. The limitation is the size of your reference data (lookup table)---how much memory will the loo...

If your situation is similar to that discussed in the linked thread (the transformer compiled object wasn't propogated to the other nodes in an MPP environment), another option is the environment variable APT_COPY_TRANSFORM_OPERATOR. This is documented in the Parallel Job Advanced Developer Guide. h...

10 records is too small a quantity with which to receive any useful results when using random sample, as 1 record = 10% of your source data. I would recommend at least 1000-10000 as a starting point if you wish to better see how sample is working. The percent option will keep approximately x percent...

Check to see if there are any spaces between the - and the 3 in COMP-3. I was able to import the definitions you show below into 8.1 FP1 without problem. If I forced a space, such as "COMP- 3" I received the error you show.

What is your desired outcome? As Ray has mentioned, the data IS sorted correctly. You are running a two node configuration, therefore your dataset by default contains two partitions. The Row Generator stage is running sequential by default, but the data is partitioned going into the sort stage, most...