DSXchange

Well, how many cpus do you have? Are you using job instantiation to divide-and-conquer process your source file? If you have 24 cpus, you could use 24 job instances to process 1/24th of the source data and thus achieve 24X the throughput. What's sooo slow about that? Now, if you say you have 2 cpus,...

I think what the poster is asking to do is a pivot. In other words, take the source row and depending on the value place it into the appropriate column. Rather than put an If Then Else condition on every column derivation, he wants to know if there's a faster way if not easier way. One method is to ...

What do you mean by "explaining each stage"? Did you put comments in the comments box for each stage and want to display this? Or are you asking for a graphical output of the job design? Or do you want a textual regurgitation of the job design information? Or do you want a relational output of objec...

Since they come with the install, they are already compiled. Somehow you lost the compilation. This was covered on the forum within the last couple of months, I did a quick search but didn't find it. There's no need to compile SDK routines so it's nothing you didn't do. Somehow the compiled logic wa...

Yes, I have seen this problem many times. You need the benefit of a non-caching, instantly committed transaction without the performance overhead associated with such activity. If you look at the SCD question posted just a few days ago, where I listed a numerous number of links to posts covering thi...

Are you saying that the act of saving a job is generating this message? How about saving other jobs, do you have the same problem?

Why do you mention the ODBC stage as the problem? Does the job save fine up until you add an ODBC stage? I'm confused as to where your problem begins.

Did you search the forum for this topic? Start here:

http://www.dsxchange.com/viewtopic.php?t=86215&start=0

yes, i do agree that TOAD may have misled me (my query was the exact view defintion that i copied), but in the Datastage job data starts flowing in from the oraoci stage that reads from that view pretty soon, i mean in couple minutes and not hours.. its the processing thats taking so long. NO. Its ...

how long should a simple server job that reads from a view (view joins 4 tables.. but when i run this view in Toad, it gives results in 7 mins) This is invalid. Just running a query in Toad is not the same as spooling the data. If you do a "select count(*) from view" query, the database will optimi...

vijay_reddy wrote:These sites above mentioned are not anymore

I clicked on every one, and they opened a new Explorer. Perhaps you're blocking pop-ups?

You are using DataStage 5.x. This means that the jobs are single threaded, and have no inter-process stages. Because of this, a job will use only a single cpu. Run two jobs at the same time, you can use two cpus. If a job spends 1/4 the time on cpu #1 and 3/4 of the time on cpu #2, that's up to the ...

Just setup a symbolic link to point to the appropriately named file. This allows your job to have a fixed name, and the symbolic link switches between files. An alternative is to copy the landed file into a processing directory under the fixed name. What is a symbolic link (is it another stage) how...

Yes, I would like to have a data file with a file format. But I would like to get file format dynamically at runtime. Knowing a job name, a file name and a link name is it possible to access the job design at runtime and dump the file map into sum file where I can grep on field name and get a displ...

Just setup a symbolic link to point to the appropriately named file. This allows your job to have a fixed name, and the symbolic link switches between files. An alternative is to copy the landed file into a processing directory under the fixed name.

Are you asking about how to make a job publish a file format? Or how to extract the file definitions from the job design so that you can distribute a data file with a format file? You should be saving the file definitions for your output files in DS Manager. You do have options at this point on how ...