DSXchange

How to constraining a job or stage to a particular node pool ? The configuration file will constrain a job to a particular node pool. If you desire to have different jobs run on different node pools, you will need to have separate configurations files for them. You could alternately use the node ma...

Abhi700 wrote:I am Writing to dataset.
And i have to use that Dataset.

Are you trying to write and read the same dataset in a single job? Can't do that...

Also, make sure that your filesystems are not full.

Regards,

Does it mean all inline sorts together form one tsort oerator ? No, it just means that one process (per partitiion) is performing all of the work. Each sort is still a separate "entity". Actually, for multiple input streams the sorts may not be combined as I am thinking. I'll need to veri...

Best Practices are rarely as simple as the examples you mention, quite often are dependent upon the situation. 1) Null handling must be done to examine and manipulate nullable columns within a transformer stage. 2) Parameters which are likely to change value from run to run, or over time, should not...

I too was facing this mmap issue with a job where a join stage has 32 links each with an inline sort, The most curious thing is that this job ran fine in our Development and Testing environment but failed in Production. when the operator combination was disabled it ran fine in Production Very curio...

Actually I am using the schema file to read the sequential file and hence there is no column defined in the job. It sounds like you have RCP enabled (yes?) within Designer, so a Filter stage would work in your case, as Ray suggested. Filter does not require that the column be defined in the job met...

Hi, When I use a BASIC transoformer in a parallel job, by default it runs in parallel on all the nodes as per the configuration file but it doesn't have partitionnum and numpartitions sytem varibales to generate a surrogate key. It only has @INROWNUM which is not sufficient when the job is running ...

DataStage jobs cannot be "opened" in Unix (I have to assume you are talking about opening to view/modify jobs as you would do with Designer--you did not specify in your post). The Designer client software is Windows-only. You can submit existing DataStage jobs from a unix prompt so long as...

Thanks for pointing that out to me, Andy! I somehow completely missed the O/S point of your post. Maybe my answer will be useful for someone anyway :) Regarding the different O/S versions and Information Server: yes, it's definitely not recommended for the reasons you point out but it can work well ...

epmenard wrote:Are parallel routines limited to C++ programs or can we also reference C code?

It's been a while since I've written one, but IIRC it needs to be compiled as a C++ routine but can be written in plain C if you wish.

Along the lines of different tasks, if Sort and Partition insertion has not been disabled, the engine likely inserted a sort/partition for each input for the merge if they weren't already in the job design. You wouldn't have the sorts inserted for a lookup stage, and typically Entire partitioning on...

Glad it worked! I hit the same wall early in my DS career and I'm sure there's many similar stories out there :) I haven't found any whitepapers surrounding the optimization options. There's no real optimization standard across different compilers so it's difficult to say that -02 does this and this...

Use a transformer to count the number of -99.00 columns and add that count as an output column, then sort using the count as the last sort key column (don't partition on it tho). If you sort in ascending order your desired record will be the first within a key group.

Regards,

Hi, I am generating surrogate key and also using flat file option. But the initial value for next run is not coming from the flat file. it is taking some random value. Can you guys please help me in what i should give in the block size, I think that is something i am missing. Appreciate your help. ...

Hi The file which one I need to load is:(example) ... 123502|78|42A|2010/05/07|2010/05/04|13|11|RR64/10|2010/05/04|10||||| ... The error message is: Sf_UsuarioMercury,0: Input buffer overrun at field "F_COB_FVSEEUC1", at offset: 64 if I check the lin it is 2010/05/04|10 Using the line you...