DSXchange

We had a similar situation a few weeks ago. We almost ran out of disk-space so i wrote some code to search for 'orphaned' data files, and found that we had 142,000 data files with no descriptor... removing them released 60Gb! Anyway, the method i used was to use 'orchadmin -f' rather than '-l' and t...

Hi Yes it is possible to get more rows out than went in... It is the same as SQL if you dont make the full join between tables. I think its called a cartesian product. For example you could have 2 records in one table and 2 records in the join table and get 4 rows out (for each row in the first tabl...

I am trying to copy your set-up so that i can see the error - i have created a sequential using your data, but then i need to enter the column definitions as you have. For example; col_1 char 16 dat_1 date 10 col_2 char 18 dat_2 date 10 col_3 char 7 dec_1 decimal 12 2 This seems to work for me, so i...

Hi

What have you defined for the fields and field properties in the sequential stage? Also, do you have an example of the data in your sequential file?

Hi It sounds like there is more data on the row in the source file than has been declared in the schema. If the column is defined as CHAR(10) and the sequential file has a row with 20 characters in it, you will get a message similar to the one you got. The warning says that the column was defined as...

Hi It might be a problem if the two columns with name had different values in them for the same key values :) When you make a join, PX will propogate all the columns from the primary input link to the output link, plus any 'extra' columns that it finds from the join stage. If you have two non-key co...

Hi I have a document of unknown origin, and i am not sure if there are any non-disclosure agreements around it, but i can give you these snippets. I hope they mean something to you... APT_BUFFER_MAXIMUM_TIMEOUT is the largest value that the 'bufferop' write timeout will reach (default 600 seconds) A...

Hi You will get this warning message when you have columns in the join tables which have the same name but which are NOT key columns. The values from only one of these columns can be carried forward when the column names are the same, and these will be from the first link (as defined in the link-ord...

Hi I guess the maximum size of the dataset will be 150 million * the row width, plus a small amount for the 'file pointer', but the size of each of the actual files making up the dataset will depend on the number of nodes you are running. We have datasets in excess of 20 Gb, but we run with 8 nodes ...

Hi

This is what i found in a document on environment variables;

APT_IO_MAP and APT_IO_NOMAP : Control whether iomgr uses mapped IO for disk files. If neither env. var. is set, uses mapping by default except on AIX and HP, which uses read/write IO by default.

Hope this helps

If you are using the transformer, this method works too; create a stage variable of type varchar/char and length 10, and give the derivation as something like TimestampFromTimet ( TimetFromTimestamp ( LNK_IN.col1 [1, 8] : "01 00:00:00" ) -1 ) This example assumes the date is in yyyy-mm-dd ...

Hi

dsenv is usually found in $DSHOME/../DSEngine

Hi If you read the sequential file containing the timestamp value in your post, with the column defined as timestamp (which PX expects to be 19 characters in length) then you will get an error. I can replicate your error message by using the timestamp that you used, which is 26 characters long (it c...

On a "normal" installation of PX, you should be able to find it under "Stage Types - Parallel - Processing".

:D

With my new-found-knowledge i was going to go back and edit the posting, but everyone would wonder what Ray and Craig were talking about, so i didnt .... i mean "didn't"