DSXchange

UCDI wrote:you can make routines in other languages that can use multi-threading if you really need the performance

The question here is not about improving performance, instead its on why the jobs is not utilizing additional free resources when more nodes are made available to it .

As noted I would assume it's simply the fact that you have a BASIC Transformer in the job and that it has no parallel capability, thus creating a choke point. From what little I recall, it is restricted to running on one specific node - head? conductor? Its an SMP server with just one physical node...

Hi Ray, These jobs were born in the earlier versions so the Server Routine. The routine has nothing but cascaded calls to Change() to replace a list of 200 substrings. We can break it down into stage variables in parallel transformer but this needs to replicated in all places the server routine is c...

Hi, There seems to be a situation which I cant fully comprehend. A job is reading data from sequential file feeding data to Basic Transformer and writing to sequential file. The basis transformer calls server routine which in turn calls Change() over 200 times, so is CPU intensive. The job when run ...

Having worked for 9 years on DataStage, I was baffled when I wasn't able to say by opening the transformer stage of a job whether it was Basic Transformer or parallel Transformer . Can it be found any where in the stage ? Both say Transformer Stage and I am currently opening Stage variable propertie...

Hi, I have inserted link sort over field "ENROLLEE_ID" in a job and I can find it in Generated OSH code but the tsort operator does not exist in the job score why appears confusing to me. Operator combination is disable still cant find the sort operator, should it not exist in the score ? ...

Yes, according to the official documentation of orchadmin, was not sure if there are any hacks that some one has tried and succeded.

Hi,

Is there a way to clear the Preserve Partitioning flag of a dataset via command line.

My problem will also be solved if there is any hidden option to clear the PP flag while copying a dataset to another where the source has PP flag set.

Thanks

Though I can't fully read it for now, Thanks for the reply Ray.

Realized my premium membership expired and its 3 days since I renewed but the same is not yet reflected

Looked into the options available with dsjob but this level of detail is not provided in the api.

Guess The column definitions should be in the universe tables, any way to get column names associated with a link from command line ?

Hi ,

I am need to get column names using job name, stage name & link name.

The column definitions could be imported into the stage using table definitions or hand coded.

tried the dsjob but doesnt help any ideas will definitely help

Thanks

Hi, I need to search for list of impacted jobs which are reading/writing a particular file, the file name is hardcoded in filename property. The DS_JOBOBJECTS search in some cases is not returning complete list hence I have exported 2500+ job in the project into XML format which is around 1.5 GB. Al...

Hi, I want to check from command line if a job is exactly in 'COMPILED' state as it appears in Director. After having looked at dsapi.h there is no exact code for 'COMPILED' the next close is #define DSJS_NOTRUNNING 99 by which I cant exactly say if its in compiled state. The below IBM link says 99 ...

Guess its time to start using metadata repository instead of Universe for more accurate information. Not sure if anybody has figured out a way to get similar report (one fetched by scanning entire DS_OBJECTS record for searching something) with metadata repository. you know what I am looking for, co...

Are you taking about XMETA Ray ?

Also, isnt this an issue ?